Dashboard ProdAgent Monitoring
- Common schema of Dashboard ProdAgent monitoring:
The main goal of PA monitoring is to collect job monitoring info from the local PA databases into Dashboard repository and to provide an interface to that data. The application is installed on lxarda18. It consists of 2 parts:
- The action for getting xml reports which contain job processing report and recording this info into Dashboard repository.
One can test it by performing the commandcurl -d report="$(cat prodmon_report.xml)" http://lxarda18/dashboard/request.py/getPAinfo
And this is an example of a report file.
- Web user interface to retrieve the data collected for future plot construction at CMS Prodmon
page. To get plot data you should use the link like http://lxarda18/dashboard/request.py/PAquery?list_of_parameters
Here is a list of the obligatory parameters and their description:
| Parameter | Values | Description |
|---|---|---|
| plot | pie, bar, cumulative and data | Type of the plot |
| what | evts_read_failed, evts_read_success, evts_read_any (both success and failed) | You should use it in case you want to get the sum of the events read |
| evts_written_failed, evts_written_success, evts_written_any | You should use it in case you want to get the sum of the events written | |
| time_failed, time_success, time_any | SUM("jobs_length"/3600) | |
| jobs_failed, jobs_success, jobs_any | SUM("inst_num") | |
| CMSSW_fail_codes | Retrieves the data for the "CMSSW Application failure codes" plot | |
| time_by_span | Use it when you want to get the data for the "Approximate resources utilized" or "Approximate batch slot count by ..." plots | |
| reco_rate | For "Tier 0 reco rate" plot | |
| jobs_success_rates | For "Jobs success rates" plot | |
| dts_timings | For "Unnormalized dataset timings" plot | |
| jobs_failure_types | For "Job failure type" query | |
| sortby | prod_team, prod_agent, wf, dts, site, exit_code | It's like the GROUP BY clause in a query |
| job_type | Merge, Processing, Any | Type of the jobs |
| starttime | Date like YYYY-mm-dd hh24:mi:ss | For example, 2010-06-28 13:54:17 |
| endtime | like the starttime parameter | |
| Parameter | Values | Default value | Description |
|---|---|---|---|
| prod_team | a team name or a list of them | any team | For example, prod_team=Team1&prod_team=Team2&... |
| dts | a dataset name or a list of them | any dataset | dts=dts1&dts=dts2&... |
| prod_agent | a production agent name or a list of them | any agent | prod_agent=Agent1&... |
| wf | a workflow name or a list of them | any workflow | wf=wf1&wf=wf2&... |
| site | a site name or a list of them | any site | site=site1&... |
| span | 3600, 86400 | 3600 | One can select the span=3600 for the data retrieval for the previous 7 days and 86400 - in other cases |
| exit_code | the numbers of the exit codes | any exit code | |
- ProdAgent merged events read by site
- Jobs by exit codes
To get a cumulative plot do the same but change the plot type from bar to cumulative. Also you can specify teams, agents, workflows, sites, exit codes if you need it.
Almost all the queries are performed in the same way but there are some exceptions.
- Unnormalized dataset timings http://lxarda18/dashboard/request.py/PAquery?starttime=2010-06-10 12:00:00&endtime=2010-06-15 12:00:00&what=dts_timings&job_type=Processing&plot=bar&sortby=wf
- CMSSW application failure codes http://lxarda18/dashboard/request.py/PAquery?starttime=2010-06-17 12:00:00&endtime=2010-06-20 12:00:00&what=CMSSW_fail_codes&job_type=Processing&plot=bar&sortby=exit_code
- Tier 0 reco rate http://lxarda18/dashboard/request.py/PAquery?starttime=2010-06-12 12:00:00&endtime=2010-06-18 12:00:00&what=reco_rate&job_type=Any&plot=bar&sortby=wf
- Jobs success rates http://lxarda18/dashboard/request.py/PAquery?starttime=2010-06-10 12:00:00&endtime=2010-06-12 12:00:00&what=jobs_success_rates&job_type=Any&plot=bar&sortby=site
and arda.dashboard.web-cmspa
-- IrinaSidorova - 25-Jun-2010 
| I | Attachment | History | Action | Size | Date | Who | Comment |
|---|---|---|---|---|---|---|---|
 jpg |
PAMonitoring_small.jpg | r1 | manage | 54.4 K | 2010-06-25 - 20:07 | UnknownUser | Common schema of Dashboard ProdAgent monitoring |
 xml |
prodmon_report.xml | r1 | manage | 0.8 K | 2010-06-25 - 21:19 | UnknownUser | an example of prodmon report |
Edit | Attach | 
- ArdaGrid Web
- ArdaGrid Web Home
- Changes
- Index
- Search
- ABATBEA
- ACPP
- ADCgroup
- AEGIS
- AfricaMap
- AgileInfrastructure
- ALICE
- AliceEbyE
- AliceSPD
- AliceSSD
- AliceTOF
- AliFemto
- ALPHA
- ArdaGrid
- ASACUSA
- AthenaFCalTBAna
- Atlas
- AtlasLBNL
- AXIALPET
- CAE
- CALICE
- CDS
- CENF
- CERNSearch
- CLIC
- Cloud
- CloudServices
- CMS
- Controls
- CTA
- CvmFS
- DB
- DefaultWeb
- DESgroup
- DPHEP
- DM-LHC
- DSSGroup
- EGEE
- EgeePtf
- ELFms
- EMI
- ETICS
- FIOgroup
- FlukaTeam
- Frontier
- Gaudi
- GeneratorServices
- GuidesInfo
- HardwareLabs
- HCC
- HEPIX
- ILCBDSColl
- ILCTPC
- IMWG
- Inspire
- IPv6
- IT
- ItCommTeam
- ITCoord
- ITdeptTechForum
- ITDRP
- ITGT
- ITSDC
- LAr
- LCG
- LCGAAWorkbook
- Leade
- LHCAccess
- LHCAtHome
- LHCb
- LHCgas
- LHCONE
- LHCOPN
- LinuxSupport
- Main
- Medipix
- Messaging
- MPGD
- NA49
- NA61
- NA62
- NTOF
- Openlab
- PDBService
- Persistency
- PESgroup
- Plugins
- PSAccess
- PSBUpgrade
- R2Eproject
- RCTF
- RD42
- RFCond12
- RFLowLevel
- ROXIE
- Sandbox
- SocialActivities
- SPI
- SRMDev
- SSM
- Student
- SuperComputing
- Support
- SwfCatalogue
- TMVA
- TOTEM
- TWiki
- UNOSAT
- Virtualization
- VOBox
- WITCH
- XTCA
 |
|
Copyright &© 2008-2022 by the contributing authors. All material on this collaboration platform is the property of the contributing authors. or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback