vocms0303

Agent tweaks

  • AgentStatusWatcher disabled ==> OK
  • Set maxRetries to 0 ==> OK
  • Restart the necessary components ==> OK
    $manage execute-agent wmcoreD --restart --components=RetryManager,ErrorHandler,AgentStatusWatcher
  • Enable ALL sites and set a high number of thresholds for them ==> OK
    $manage db-prompt wmagent
    UPDATE wmbs_location SET state=(SELECT id from wmbs_location_state where name='Normal') WHERE state!=(SELECT id from wmbs_location_state where name='Normal');
    UPDATE wmbs_location SET running_slots=2000, pending_slots=1000;
    UPDATE rc_threshold SET max_slots=2000, pending_slots=1000;

Draining logs

cmst1@vocms0303:/data/srv/wmagent/current $ python drainAgent.py 

Drain check time: Fri, 10 Mar 2017 08:06:56 +0000
*** Amount of jobs in condor per workflow, sorted by condor job status:
{}

*** WORKFLOWS: found 2 distinct workflows in this agent.
pdmvserv_task_HIG-RunIISummer16DR80Premix-01911__v1_T_170116_133411_9741                                                     	completed
pdmvserv_task_TOP-RunIISummer16DR80Premix-00083__v1_T_161219_123711_1390                                                     	completed

*** WORKFLOWS: there are 0 distinct workflows not completed.

*** WORKFLOWS: found 0 workflows not fully injected.

*** WMBS: amount of wmbs jobs in each status:
[{'count': 71037, 'name': 'cleanout'}]

*** SUBSCRIPTIONS: subscriptions not finished: 0

*** SUBSCRIPTIONS: found 0 files available in WMBS (waiting for job creation):
[]

*** SUBSCRIPTIONS: found 0 files acquired in WMBS (waiting for jobs to finish):
[]

*** DBS: found 0 blocks open in DBS. Printing the first 20 blocks only:
[]

*** DBS: found 0 files not uploaded to DBS.


*** PHEDEX: found 0 files not injected in PhEDEx, with valid block id (recoverable).

*** PHEDEX: found 309372 files not injected in PhEDEx, with valid block id (unrecoverable).
==> Which maps to 1782 unique datasets:
set(['/ADDGravToGG_MS-5000_NED-2_KK-1_M-500To1000_13TeV-sherpa/RunIISummer15GS-MCRUN2_71_V1-v1/GEN-SIM',
     '/ttWJets_13TeV_madgraphMLM/RunIISummer16DR80-80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/AODSIM'])
... that were NOT produced by any agent-known workflow. OR, the wfs are gone already.


I'm done!

GOOD TO GO!

Edit | Attach | Watch | Print version | History: r16 < r15 < r14 < r13 < r12 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r16 - 2017-03-10 - AlanMalta
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback