Configure ES PandaQueue

Here is some instructions to configure Panda queue to run EventService on HPC.

setup the queue on schedconfig

objectstore: used to store output event service files and logs

                   objectstore:   "s3://cephgw.usatlas.bnl.gov:8443/|eventservice^/atlas_pilot_bucket/eventservice|logs^/atlas_pilot_bucket/logs"
        
catchall: used to control whether RunJobHpcEvent will be executed. Here is an example for catchall.
                   catchall:  "HPC_HPC,mode=normal,queue=debug,backfill_queue=regular,max_events=2000,initialtime_m=8, time_per_event_m=13,repo=m2015,nodes=2,min_nodes=2,max_nodes=3,partition=edison,min_walltime_m=28,walltime_m=30,max_walltime_m=30,cpu_per_node=24,mppnppn=1,ATHENA_PROC_NUMBER=23"
                   catchall:  "HPC_HPC,mode=backfill,queue=debug,backfill_queue=regular,max_events=2000,initialtime_m=8, time_per_event_m=10,nodes=2,min_nodes=2,max_nodes=3,partition=edison,min_walltime_m=28,walltime_m=30,max_walltime_m=30,cpu_per_node=24,mppnppn=1,ATHENA_PROC_NUMBER=23"
        
for catchall, required items are HPC_HPC. The default queue is 'regular'., If you want to run in backfill mode, you need to add 'mode=backfill,backfill_queue=regular' and you need to add 'partition' too. 'partition' is used to get free resources. It 'partition' is not set, it will ignore 'mode=backfill' and run on normal mode.

-- WenGuan - 2015-02-24

Edit | Attach | Watch | Print version | History: r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r1 - 2015-02-24 - WenGuan
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    PanDA All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback