Requesting access to the SAM programmatic interface

Due to unexpected high load on SAM DB in the past, when we had extremely high number of concurrent requests, we have temporary restricted the access to the programmatic interface (XML queries) using IP based rules. So for the time being, if you want to get the access to SAM XML based query interface (sqldb and same-pi areas) please let us know by opening a GGUS ticket specifying the following details:

• support unit: SAM/SFT
• reason why you need access
• type of queries you plan to execute
• frequency of your queries
• data ranges (for example: getting the history of all test results for one site, 1 day of history)
• IP address(es)

Thanks for your understanding.

Current SAM programmatic interface ACL

Grid level access

VO Dashboard (Julia Andreeva <ANDREEVA@MAIL.CERN.CH>)

• IP: 137.138.171.43

QMUL: GridPP (s.l.lloyd@qmulNOSPAMPLEASE.ac.uk)

• queries: Full history of all critical tests for one year for 20 sites, and then one day history.
• frequency: 1/day
• IP: 138.37.51.*
• status: ALLOWED

RAL-LCG2: GoogleMap (Dave Kant)

• queries: http://lcg-sam.cern.ch:8080/sqldb/last_service_status_per_site.xsql?vo_name='OPS'
• frequency: 1/hour
• IPs:
  • 130.246.143.237
  • 130.246.187.181
• status: ALLOWED

Hellasgrid: GRID enabled nagios service

• requestor: Christos Triantafyllidis (ctria@gridNOSPAMPLEASE.auth.gr) HG-03-AUTH
• query: latest status
• frequency: 1/hour for HG-*, GR-* sites
• IPs: 195.251.55.124

Wuppertal: (mechtel@physikNOSPAMPLEASE.uni-wuppertal.de)

• queries: ?
• frequency: ?
• IP: 132.195.104.102
• status: ALLOWED

Cyprus: (Kyriacos Neocleous kyriacos@csNOSPAMPLEASE.ucy.ac.cy)

• queries: history of service metrics for all sites, for approximately the last 6 months (http://lcg-sam.cern.ch:8080/same-pi/servicemetrics_history.jsp?...)
• frequency: each production site will be queried once for the entire period (+ test queries)
• IPs:
  • 194.42.27.181
  • 194.42.27.182
  • 194.42.18.194
• Status: ALLOWED

ENOC: network monitoring - comparisons with SAM (guillaume.cessieux@ccNOSPAMPLEASE.in2p3.fr)

• queries: http://lcg-sam.cern.ch:8080/same-pi/service_endpoint_status.jsp for each VO
• frequency: 1/hour
• IPs:
  • 134.158.69.160
  • 134.158.71.203
• status: ALLOWED

SAMAP: SAM Admin Pages queries (syriusz@manNOSPAMPLEASE.poznan.pl)

• queries:
• frequency:
• IPs:
  • 150.254.149.152
  • 150.254.149.153
  • 150.254.161.65
  • 150.254.173.162
  • 134.158.69.31
  • 134.158.69.32
  • 134.158.69.36
  • 134.158.69.37
  • 134.158.105.193
  • 131.154.100.164

CIC Portal

• type of queries you plan to execute: http://lcg-sam.cern.ch:8080/same-pi/service_endpoint_status.jsp?VO_name'.$vo.'&Site_name='.$sitename.'&show_details' http://lcg-sam.cern.ch:8080/same-pi/services_per_vo.jsp?Site_name='.$sitename/
• frequency of your queries : once / hour
• data ranges : 1 day of history
• IP:
  • 134.158.105.195: automatic queries
  • 134.158.71.217, 134.158.71.226: Cyril & Osman's laptop, only for occasional access

WLCG monitoring

WG profile:

• nagiosgrid.na.infn.it 192.167.203.222 (spardi@SPAM_NOT_na.infn.it)
• grisu002.dsf.unina.it 143.225.204.26 (spardi@SPAM_NOT_na.infn.it)
• tbn12.nikhef.nl 192.16.186.237 (ronalds@nikhefNOSPAMPLEASE.nl)
• riek.nikhef.nl 192.16.186.223 (ronalds@nikhefNOSPAMPLEASE.nl)
• argus.up.pt 193.137.35.39 (Rui Ramos <RRAMOS@REIT.UP.PT>)
• mon.grid.sara.nl: 145.100.32.252 (Ron Trompert <RON@SARA.NL>)
• hg-mon.marie.hellasgrid.gr: 195.251.54.8 (Marios Chatziangelou <MHAGGEL@IASANOSPAMPLEASE.GR>)
• wod13-001.cern.ch: 137.138.238.31 (Pranabesh Kanti Thander)
• suchak.vecc.EU-India.res.in: 144.16.112.147 (Gaurav Saxena)
• svr031.gla.scotgrid.ac.uk: 130.209.239.31 (Andrew Elwell <A.ELWELL@PHYSICSNOSPAMPLEASE.GLA.AC.UK>)
• pcitgd14.cern.ch: 137.138.41.165 (Ian.Neilson@cernNOSPAMPLEASE.ch)
• lxvm0250.cern.ch: 128.142.129.202 (Ian.Neilson@cernNOSPAMPLEASE.ch)
• IN2P3/CNRS
• ccgridli07.in2p3.fr : 134.158.105.170 (Pierre-Emmanuel Brinette)
• ccgridvmli11.in2p3.fr : 134.158.105.241 (not cclcgvmli11) (Pierre-Emmanuel Brinette)
• ccgridli01.in2p3.fr : 134.158.105.151 (Pierre-Emmanuel Brinette)
• ccsvli29.in2p3.fr : 134.158.105.103 (Pierre-Emmanuel Brinette)
• ccsvli30.in2p3.fr : 134.158.105.115 (Pierre-Emmanuel Brinette)
• ccsvli34.in2p3.fr : 134.158.105.226 (Pierre-Emmanuel Brinette)
• cclcgsrvli01.in2p3.fr : 134.158.105.227 (Pierre-Emmanuel Brinette)
• cclcgsrvli02.in2p3.fr : 134.158.105.228 (Pierre-Emmanuel Brinette)
• cclcgvmli17.in2p3.fr : 134.158.105.137 (Pierre-Emmanuel Brinette)
• nanx33.in2p3.fr : 134.158.24.63 (Pierrick Le Corre)
• lpnaii.in2p3.fr : 134.158.159.254 (Victor Mendoza)
• lpnd322.in2p3.fr : 134.158.159.99 (Victor Mendoza)
• =polgrid11.in2p3.fr = : 134.158.132.131 (Pascale Hennion)
• KR-KISTI-GCRT-01: 150.183.220.57 (Nguyen Dang Nhan)
• zeus16.cyf-kr.edu.pl : 149.156.9.26 (Malgorzata Krakowian)
• NDGF: chaperon.ndgf.org : 193.10.122.2 (Anders Rhod Gregersen)
• lxn1191.cern.ch, lxn1193.cern.ch : (Laurence Field)
• nagios2p.pic.es: Fernando L�pez Mu?oz <FLOPEZ@PIC.ES>
• ccgridvmli06.in2p3.fr: 134.158.105.236 (Pierre-Emmanuel Brinette)
• cms-nagios.caltech.edu: 131.215.207.114 (Michael Thomas)
• gaewatch.ciemat.es: (130.206.40.81) Antonio Delgado Peris
• castor05.ciemat.es: (130.206.40.167) Antonio Delgado Peris
• krypton.ph.unimelb.edu.au (128.250.50.225) Tom Fifield
• atlasnagios.ph.unimelb.edu.au (128.250.51.246) Tom Fifield
• t2wlcgnagios.physics.ox.ac.uk: (163.1.5.3)
• 192.54.208.2: gate02.datagrid.cea.fr (Christine Leroy)
• 192.54.208.23: node08.datagrid.cea.fr (Christine Leroy)
• 192.54.208.189: node59.datagrid.cea.fr (Christine Leroy)
• 134.226.53.39: cagraidsvr23.cs.tcd.ie (Stuart K. Lenny)
• 131.154.101.60 (Giuseppe Misurelli)
• 131.154.101.62 (Giuseppe Misurelli)
• 134.219.108.127: mulberry.pp.rhul.ac.uk (Duncan Rand)
• 161.53.0.230: igtf-mon.srce.hr (Emir Imamagic)
• 195.113.219.28: mon1.egee.cesnet.cz (Tomas Kouba)
• 147.231.25.244: elf.farm.particle.cz (Tomas Kouba)
• 147.231.25.8: monitoring.farm.particle.cz (Tomas Kouba)
• 152.84.101.12: gridmon.cat.cbpf.br (Edgar Sanabria)
• 152.84.101.12: gridmon.cat.cbpf.br (Edgar Sanabria)
• 85.254.226.22: ng.grid.etf.rtu.lv (Lauris Cikovskis)
• 158.195.25.237: lcgmonitor.dnp.fmph.uniba.sk (Vladimir Fekete)
• 130.104.133.246: ingrid-monbox.cism.ucl.ac.be (Pavel Demin)
• 193.48.95.201-193.48.95.240: ccegeevmli01.in2p3.fr - ccegeevmli40.in2p3.fr (Pierre-Emmanuel Brinette)
• 193.48.86.173: sbgpcs1302.in2p3.fr (Eric Kieffer)
• 195.194.110.4: UKI-NORTHGRID-LANCS-HEP, UKI-NORTHGRID-LIV-HEP, UKI-NORTHGRID-MAN-HEP, UKI-NORTHGRID-SHEF-HEP (Alessandra Forti)
• 193.219.146.216: mon.grid.vgtu.lt (Karolis Eigelis)
• 146.48.85.*-146.48.87.*: isti.cnr.it (Luca Frosini)
• 161.53.0.229 (Emir Imamagic)
• 192.54.208.188: node58.datagrid.cea.fr (Christine Leroy)
• 134.158.121.44: clrmonitor.in2p3.fr (Jean-Claude Chevaleyre)
• 134.157.247.167: magellan.datagrid.jussieu.fr (David Weissenbach)
• 134.158.32.159: ccvisit29.in2p3.fr (Nicolas Clementin)
• 193.40.150.98: titan.hep.kbfi.ee (Ilja Livenson)
• 193.40.150.248: neptune.hep.kbfi.ee (Ilja Livenson)
• 193.109.174.50: coresrv02.pic.es (Fernando Lopez)
• 193.109.175.6: (Fernando Lopez)

• 147.188.46.5: epgmo1.ph.bham.ac.uk (Yves Coppens)
• 163.1.5.5: gridppnagios.physics.ox.ac.uk (Kashif Mohammad)
• 193.206.210.60, 193.206.210.33: prod-ui-02.pd.infn.it, cert-30.pd.infn.it (Simone Dalla Fina)
• 193.48.244.66: grid-mon.esrf.eu (Fernando Calvelo Vazquez)
• 193.48.244.70: grid-ui02.esrf.eu (Fernando Calvelo Vazquez)
• 141.85.224.184: wn001.seegrid.grid.pub.ro (Alexandru Herisanu)
• 194.190.165.226: mon0002.m45.ihep.su (Victor Kotlyar)
• 147.122.18.115: nagios.grid.sissa.it (Iztok Gregori)
• 130.209.239.18: svr018.gla.scotgrid.ac.uk (Sam Skipsey)
• 193.170.243.38: panda1.oeaw.ac.at (Dietrich Liko)
• 117.103.105.134, 117.103.100.18: rocnagios.grid.sinica.edu.tw, w-wn0316.grid.sinica.edu.tw (Jhen-Wei Huang)
• 134.76.97.121: nagios-goegrid.gwdg.de (Stefan Birkholz)
• 212.35.134.136: testbed004.grid.ici.ro (Alexandru Stanciu)
• 193.11.167.118: sg2-nagios.pdc.kth.se (Zeeshan Ali Shah)
• 147.231.25.35: goliasx35.farm.particle.cz (Jan Svec)
• 130.239.81.251: glite04-kvm.hpc2n.umu.se (Ake Sandgren)
• 130.246.180.225: nagger.gridpp.rl.ac.uk (Gareth Smith)
• 157.253.81.31: tibana.uniandes.edu.co (Andres Holguin)
• 129.177.20.53: duneik.bccs.uib.no (Csaba Anderlik)
• 193.10.122.26: sam.ndgf.org (Anders Rhod Gregersen)
• 142.90.90.87: roc-nagios.triumf.ca (Di Quing)
• 131.154.101.200: (Paolo Veronesi)
• 130.246.182.49, 130.246.182.51: csflnx418.rl.ac.uk, csflnx420.rl.ac.uk (Tiju Idiculla)
• 193.206.210.127: gimo.pd.infn.it (Simone Dalla Fina)
• 132.230.207.234: sfc.bfg.uni-freiburg.de (Jan Erik Sundermann

CERN: nagios-based prototype (Ian Neilson)

• 1. queries: http://lcg-sam.cern.ch:8080/same-pi/service_endpoint_status.jsp?VO_name'.$vo.'&Site_name='.$sitename.'&show_details' http://lcg-sam.cern.ch:8080/same-pi/services_per_vo.jsp?Site_name='.$sitename
• frequency: 1/hour/host
• IPs:
  • lxb2003.cern.ch: 128.142.200.10
  • lxb1910.cern.ch: 128.142.199.150
  • lxb1779.cern.ch: 128.142.199.60
  • 150.183.220.49
• status: ALLOWED

NAGIOS-CE: (Emir)

• queries: only latest status
• frequency: ?
• IPs:
  • 161.53.254.82
  • 161.53.1.226
  • 161.53.0.228
  • 161.53.0.233
  • 161.53.0.236
  • 161.53.0.237

• status: ALLOWED

NAGIOS related:

• IPs:
  • ndias@lip.pt 193.137.99.*
  • ronalds@nikhef.nl 192.16.186.223
  • matt hodges 130.246.180.62 @ RAL
  • Stefan.Birkholz@phys.uni-goettingen.de 134.76.97.107
  • jwhuang@twgrid.org 117.103.105.134
  • gvetois@cgg.com 84.14.104.246
  • koubat@fzu.cz 147.231.25.216

NAGIOS monitoring of SAM results:

• Who: Eygene Ryabinkin @ 144.206.66.62 lair.grid.kiae.ru
• Queries: To get the status and historical tests results;
• Frequency: one query per 2 hours;
• Data range: one week of history for the machines of RRC-KI site.

Site-level access

FNAL: Catalin Dumitrescu <CATALIND@FNAL.GOV>

• purpose: feed results to FNAL monitoring system
• queries: latest query
• frequency: 1/hour
• IPs:
  • 131.225.207.94
  • 131.225.84.9
  • 131.225.83.3

VO level access

CMS: (Andrea Sciaba)

• XSQL
  • queries: http://lcg-sam.cern.ch:8080/sqldb/sites_in_sam_db.xsql http://lcg-sam.cern.ch:8080/sqldb/last_service_status_per_site.xsql?vo_name='CMS' http://lcg-sam.cern.ch:8080/sqldb/test_history.xsql?startTime=&endTime=&vo_name=CMS&node_name=&test_name=
  • frequency: 1/day Collecting the history information for one month requires approximately this number of queries: (80 CEs / 2 ) * 6 tests * (30/2) = 3600 queries An incremental update (independently of the time inverval up to two days) would need (80 CEs / 2) * 6 tests = 240 queries
  • IPs:
    • webafs3.cern.ch 137.138.28.235
    • webafs02.cern.ch 137.138.28.229
    • fkw.ucsd.edu 132.239.69.122 -- SUSPENDED
    • bloomlap.unl.edu 129.93.32.10
    • pclx06.ts.infn.it 140.105.6.165
    • unixts1.ts.infn.it 140.105.6.250
    • otonashi.cern.ch 137.138.171.53
    • cmslpc01.fnal.gov-cmslpc11.fnal.gov 131.225.205.243-131.225.205.253
    • ayukawa.cern.ch 137.138.252.80
  • status: ALLOWED

• SAM PI
  • IPs:
    • pclx06.ts.infn.it 140.105.6.165
    • unixts1.ts.infn.it 140.105.6.250

CMS: Simon Metson mailto:s.metson@bristol.ac.uk)

• query: results for https://cmsweb.cern.ch/sitedb/, for tests
  • CE-sft-job
  • CE-cms-basic
  • CE-cms-squid
  • CE-cms-frontier
• IPs:
  • 128.142.129.68
  • 128.142.129.69

ALICE: (Costin.Grigoras@cernNOSPAMPLEASE.ch)

• IPs:
  • 137.138.47.208 - ALICE MonALISA repository
  • 137.138.170.204 - development
• queries: http://lcg-sam.cern.ch:8080/same-pi/last_service_status_per_site.jsp?VO_name=Alice&Service_type=VOBOX&show_details
• frequency: 2h for each distinct URL
• status: ALLOWED

Region-level access

• frequency: 1-2 times per hour
• data range: results of the last set of tests for all sites in the region Russia
• IPs involved:
  • 213.131.4.7 (lav07.sinp.msu.ru) - development and debugging
  • 213.131.5.63 (grid.sinp.msu.ru.ru)
  • 213.131.5.20 (grid.sinp.msu.ru)

SWE: (asimon - cesga.es)

• frequency: once per hour
• Queries: SWE region sam latest status
• IPs involved:
  • 84.21.169.36
  • 84.21.169.79

Site level access

RAL: (Chris Brew)

• queries:
  • /same-pi/service_endpoint_status.jsp?VO_name=OPS&Site_name=UKI-SOUTHGRID-RALPP
• frequency: every 5 minutes.
• IP: 130.246.47.200, 130.246.132.26, 130.246.132.27, 130.246.135.176
• status: ALLOWED

DESY-HH: (Yves Kemp)

• queries:
  • /same-pi/service_endpoint_status.jsp?VO_name=OPS&Site_name=DESY-HH
• frequency: twice per hour.
• IP: 131.169.223.*
• status: ALLOWED

epcc.ed.ac.uk: (Greig Alan Cowan)

• queries:
  • /same-pi/servicemetrics_history.jsp?start_time=2008-01-30T00:00:01Z&end_time=2008-01-30T23:59:59Z&VO_name=OPS&Service_endpoint=srm-atlas.gridpp.rl.ac.uk&Service_endpoint=srm-cms.gridpp.rl.ac.uk&Service_endpoint=srm-lhcb.gridpp.rl.ac.uk&Service_endpoint=srm.triumf.ca&Service_endpoint=cmssrm.fnal.gov&ServiceMetric=SE-lcg-cp&ServiceMetric=SE-lcg-cr&ServiceMetric=SE-lcg-del&ServiceMetric=SRM-put&ServiceMetric=SRM-get&ServiceMetric=SRM-advisory-delete
  • /same-pi/services_per_vo.jsp?VO_name=OPS&Service_type=SE
  • /same-pi/site_names.jsp
• frequency: around 60 per day.
• IP: 129.215.175.66
• status: ALLOWED

IN2P3: (Frederique.Chollet@lappNOSPAMPLEASE.in2p3.fr)

• queries: http://lcg-sam.cern.ch:8080/sqldb/site_avail.xsql
• frequency: every 3 months, to to establish quarterly reports including the site availability metrics for the french sites.
• IP: 134.158.98.28 (lappc-p114.in2p3.fr)
• status: ALLOWED

IN2P3-CC: (lionel.schwarz@in2p3NOSPAMPLEASE.fr)

• queries: http://lcg-sam.cern.ch:8080/sqldb/node_status.xsql?node_name=ccsrm.in2p3.fr
• frequency: on demand (1 request/node/minute)
• IP: 134.158.69.227
• status: ALLOWED

AEGIS01-PHY-SCL: (Dusan)

• queries: http://lcg-sam.cern.ch:8080/sqldb/last_service_status_per_site.xsql?vo_name='OPS'&site_name='AEGIS01-PHY-SCL' http://lcg-sam.cern.ch:8080/same-pi/service_endpoint_status.jsp?VO_name=OPS&Site_name=AEGIS01-PHY-SCL http://lcg-sam.cern.ch:8080/same-pi/service_endpoint_status.jsp?VO_name=OPS&Site_name=AEGIS07-PHY-ATLAS
• frequency: on demand, few times per hour
• IPs:
  • 147.91.84.20 (ce.phy.bg.ac.yu)
  • 147.91.84.10 (paradox.phy.bg.ac.yu)
• status: ALLOWED

FZK: (andreas.heiss@iwrNOSPAMPLEASE.fzk.de, wen.mei@iwrNOSPAMPLEASE.fzk.de)

• query: http://lcg-sam.cern.ch:8080/same-pi/service_endpoint_status.jsp?VO_name=OPS&Site_name=FZK-LCG2
• frequency is once every 10 minutes.
• IPs:
  • 192.108.45.9
  • 192.108.45.50
  • 192.108.45.113
• status: ALLOWED

FZK: (Stefan Birkholz)

• query: current test results (no history) for the FZK Cloud
• frequency is once per hour.
• IPs:
  • 134.76.86.144
• status: ALLOWED

LAL:

• query: http://lcg-sam.cern.ch:8080/sqldb/tests_history.xsql?startTime=2006-08-00T00:00:00Z&endTime=2007-07-31T23:59:59Z&vo_name=OPS&service_name=voms.cern.ch&service_name=lcg-voms.cern.ch&test_name=cert
• frequency: quarterly
• IPs:
  • 134.158.90.1
  • 134.158.91.15
  • 134.158.91.66
  • 137.138.33.188
• status: ALLOWED

CSCS-LCG2:

• query: http://lcg-sam.cern.ch:8080/same-pi/service_endpoint_status.jsp for VOs: ops, dech, atlas, cms, lhcb
• frequency: 1 hours
• IPs:
  1. 187.67.2

BEIJING-LCG2

• reason: use the information to monitor the LCG station.
• queries: latest status and latest service status of BEIJING-LCG2
• frequency: 2/hour
• IPs:
  • 202.122.33.68
  • 202.122.33.24
• status: ALLOWED

T1-INFN (Felice Rosso)

• reason: monitoring and accounting T1-INFN
• queries: http://lcg-sam.cern.ch:8080/same-pi/site_status.jsp?VO_name=OPS&Site_name=INFN-T1
• frequency: Every 15 minutes
• IPs:
  • 131.154.128.106
• status: ALLOWED