Merge with https://twiki.cern.ch/twiki/bin/view/CMSPublic/CompOpsWorkflowOperationsWMAgentScripts and move under Production and Reprocessing

Workflow Operations Scripts


Twiki Guide

Through this twiki we are going to go inside every single script on the WMAgent and Unified site, in order for us to understand each one of the possible procedures inside the workflow operation.
The goal of this exercise is to document what does every script, how to use it, and establish if it is still useful or usable.

WMAgent Scripts

abortAndClone.py

[Description]

[Usage]

[Examples]

[Comments]

abortWorkflows.py
analyzeDuplicates.py
announceWorkflows.py
assignProdTaskChain.py
assignWorkflow.py
changePriorityWorkflow.py
changeSplittingWorkflow.py
closeOutWorkflowsFiltered.py
closeOutWorkflowsManual.py
closeOutWorkflows.py
closeOutWorkflowsWeb.py
condor_global_overview.py
condor_overview.py
createSitesBackfill.py
dataLock.py
dbs3Client.py
DBS3SetDatasetStatus.py
deleteInvalidOutput.py
duplicateEvents.py
extendWorkflow.py
findOrphanACDCs.py
findWorkflows.py
fix_merge_acdc.py
fixPhEDEx.py
forceCompleteWorkflows.py
getDatasetStatus.py
getInputLocation.py
killWorkflowAgent.py
lastWeekProcessing.py
listWorkflows.py
makeACDC.py
makeAllACDCs.py
McMClient.py
notCustodialDatasets.py
phedexClient.py
pledged.py
processingCampaignOverview.py
rejectAndClone.py
rejectWorkflows.py
reqMgrClient.py
reqmgr.py
resubmit.py
resubmitUnprocessedBlocks.py
resubmitWithBlockBlacklist.py
setCascadeStatus.py
setDatasetStatusDBS3.py
site_view.py
stuckRequestDiagnosis.py
undealtWorkflows.py
unprocessedBlocks.py
utils.py
WorkflowJobInfo.py
WorkflowPercentage.py
WorkflowSummary.py

Unified Scripts

Listed in the order they are called in cycle.sh

injector.py

Get the workflow in/back-in the system

equalizor.py

equalize site white list at the condor level

assignor.py

early assignment with all requirements included

checkor.py

verify sanity of completed workflow and pass along

recoveror.py

initiate automatic recovery

closor.py

close the workflow

completor.py

force-complete wf according to rules ## tagging phase

subscribor.py

finsih subscribing output blocks

lockor.py

unlock dataset that can be unlocked and set status along

addHoc.py


-- PaolaKatherineRozoBernal - 2016-03-16

Edit | Attach | Watch | Print version | History: r3 < r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r3 - 2017-01-09 - JeanrochVlimant
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback