Panda Pilot Multitasking

Introduction

Pilot multitasking refers to the pilot ability to run a production job at the same time as consecutive user analysis jobs. It should be stressed that this is controlled by a single pilot forking and monitoring up to two jobs at the time, one being the long running production job and the other being the shorter running user analysis job. If the production job (i.e. the primary job sent to the pilot) finishes, the pilot will finish as soon as the user analysis job finishes. If the production job is still running when the user analysis job is running, the pilot will request a new user analysis job from the job dispatcher. This will continue until the primary job finishes.

diagram

Further details

User analysis jobs will be given a higher priority than the production jobs. The user analysis jobs will be given a normal priority by the operating system upon launch, while the production job will get a lower priority, corresponding to a renice of +10, set by the pilot. The production job will only be reniced when the pilot is running in multitasking mode.

In addition to running the pilot in multitasking mode, special queues have been setup for user analysis jobs; the short and long queue respectively. Details can be found in the Distributed Analysis on Panda tutorial.


Major updates:
-- PaulNilsson - 05 Oct 2006



Responsible: PaulNilssonSecondary

Topic attachments
I Attachment History Action Size Date Who Comment
JPEGjpg PandaMultitasking.jpg r1 manage 63.5 K 2006-10-05 - 16:23 UnknownUser Activity diagram for multitasking pilot
PNGpng pilotMultitasking.png r1 manage 19.9 K 2006-10-10 - 17:07 UnknownUser Multitasking pilot (draft 2)
Edit | Attach | Watch | Print version | History: r4 < r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r4 - 2006-10-10 - PaulNilssonSecondary
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    PanDA All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback