CompOfflineLSF < TOTEM

TOTEM Web>CompOfflineLSF (2016-09-29, JakubSebastianBujas) (raw view)

---+ LSF - lxbatch

[[http://en.wikipedia.org/wiki/Platform_LSF][Load Sharing Facility]] (or simply *LSF*) is a commercial computer software job scheduler sold by Platform Computing. It can be used to execute batch jobs on networked Unix and Windows systems on many different architectures. It is installed on Batch Farm of about 3000 machines providing computing power to CERN users needed for data analysis and simulation tasks.

---++ Documentation

   * [[http://batch.web.cern.ch/batch/][CERN Batch Service]]
   * [[http://www.ibm.com/support/knowledgecenter/SSETD4/product_welcome_platform_lsf.html][IBM documentation - many useful commands]]

---++ Useful commands

   * bsub
   * bjobs
   * bkill

---++ Example usage

In order to use LSF, you need to login to lxplus machine, then you can submit your jobs, requesting resources and choosing queue:

   * =bsub -R "swp>2000&&pool>30000" -q 8nh /afs/..../script.csh=

Try not to use "type==SLC4".

---++ Useful commands extended edition

   * If you want to kill all jobs for user:
        bkill -u [username] 0 (0 will force killing without waiting for job ending properly)
   * [[http://delphiwww.cern.ch/offline/computing/bjobs.html][A lot of info about command bjobs, flags, triggers, etc.]]
   * As default when job ends we get message on our e-mail with output of the job. However, sometimes you submit many jobs on batch and don't want have hte mailbox spammed. To avoid getting mails put 'LSB_JOB_REPORT_MAIL=N' before bsub command.

---++ Monitoring lxbatch jobs
   * [[https://lsf-rrd.cern.ch/lrf-lsf/info.php?group=u_zj][Monitoring for zj group]]
   * You can monitor your jobs by using the same page as above filling 'Search User' input.

---++ Helpful information
   * If jobs you tries to submit are always in PENDing state, than check lxbatch monitoring for queue, which you use. Sometimes there is big load on specified queue and you have to wait a lot of time to get your turn. 
   * When you submit job, the output job information is saved in your actual submit directory. Better make new directory for jobs outputs in case not having spammed your submit directory.
 

-- Main.JakubSebastianBujas - 21 Sept 2016

Topic revision: r7 - 2016-09-29 - JakubSebastianBujas

TOTEM

TOTEM TWiki
DETECTOR
SOFTWARE
- Offline Software
- Monitor
- TotemDQM
- Trigger/DAQ
- DCS
ANALYSIS
PHYSICS
DOCUMENTATION

TWiki help
TWiki formatting rules

Create personal sidebar

- Cern Search
- TWiki Search
- Google Search
TOTEM All webs

Copyright &© 2008-2021 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback