Difference: DiracPopularityService (5 vs. 6)

Revision 62012-02-26 - DanielaRemenska

Line: 1 to 1
 
META TOPICPARENT name="DanielaRemenskaWork"

Points to remember (compiled from meetings and notes):

Line: 101 to 101
 ALERT!The AnalyseXMLLogFile implementation parses the application log AND the summary.xml, but it uses LHCbDIRAC/Core/Utilities/ProductionXMLLogAnalysis.py which requires step_commons['listoutput'] to be defined.. user jobs may lack it, so it crashes :-/ Example output
Changed:
<
<
2012-01-11 03:14:59 UTC dirac-jobexec/AnalyseXMLLogFile INFO: Initializing $Id: DiracPopularityService.txt,v 1.5 2012/01/21 22:28:54 danielar_40nikhef_2enl Exp $
>
>
2012-01-11 03:14:59 UTC dirac-jobexec/AnalyseXMLLogFile INFO: Initializing $Id: DiracPopularityService.txt,v 1.5 2012/01/21 22:38:58 danielar_40nikhef_2enl Exp $
 2012-01-11 03:14:59 UTC dirac-jobexec/AnalyseXMLLogFile DEBUG: {'ParametricInputData': '', 'TotalSteps': '1', 'JobName': 'Name', 'Priority': '1', 'SoftwarePackages': 'DaVinci.v29r2', 'JobReport': <DIRAC.WorkloadManagementSystem.Client.JobReport.JobReport instance at 0xd11bcf8>, 'LogLevel': 'debug', 'OutputSandbox': '*.log;summary.data;summary.xml', 'JobType': 'User', 'SystemConfig': 'ANY', 'JOB_ID': '00000000', 'StdError': 'std.err', 'Request': <DIRAC.RequestManagementSystem.Client.RequestContainer.RequestContainer instance at 0xd0eec68>, 'AccountingReport': <DIRAC.AccountingSystem.Client.DataStoreClient.DataStoreClient instance at 0xd19a830>, 'ParametricInputSandbox': '', 'JobGroup': 'lhcb', 'StdOutput': 'std.out', 'Origin': 'DIRAC', 'Site': 'ANY', 'PRODUCTION_ID': '00000000', 'MaxCPUTime': '5000', 'LogFilePath': '/project/bfys/dremensk/ctmdev/LHCbDirac_v6r8p2/etc', 'InputData': ''} 2012-01-11 03:14:59 UTC dirac-jobexec/AnalyseXMLLogFile DEBUG: {'applicationName': 'DaVinci', 'STEP_DEFINITION_NAME': 'DaVinciStep1', 'applicationVersion': 'v29r2', 'JOB_ID': '00000000', 'optionsLine': '', 'STEP_NUMBER': '1', 'StartStats': (4.2199999999999998, 0.23999999999999999, 0.0, 0.0, 8676995.6999999993), 'STEP_INSTANCE_NAME': 'RunDaVinciStep1', 'inputDataType': 'DATA', 'applicationLog': 'Step1_DaVinci_v29r2.log', 'optionsFile': '/project/bfys/dremensk/DaVinci-Default.py', 'PRODUCTION_ID': '00000000', 'STEP_ID': '00000000_00000000_1', 'StartTime': 1326251676.3210549, 'inputData': 'LFN:/lhcb/LHCb/Collision11/BHADRON.DST/00012957/0000/00012957_00000753_1.bhadron.dst'} 2012-01-11 03:14:59 UTC dirac-jobexec/AnalyseXMLLogFile INFO: Input data defined in workflow for this Gaudi Application step
Line: 262 to 262
  Question I guess in such a case we can only report the SITE and the PFN, not the SE?
Added:
>
>
In either case it's not really possible (or not trivial, for now) to extract the exact SE within LHCbDIRAC itself, so the "/LocalSite/LocalSE" parameter will be used instead, to send only the SITE parameter together with the hit count.
 

Local testing of new modules:

In dirac.cfg, important lines for local testing (LHCb-Development to test on volhcb12, comment out other servers, leave only volhcb18, since it times-out with the rest.., there must be LocalArea and SharedArea defined in LocalSite)
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback