CRAB Logo

CRAB3 Team New Member Setup

This document is a checklist of things a new CRAB3 operator/developer should do in order to get started with CRAB3. For the next steps you should already have a CERN computing account in order to access all URLs, if don't have one or even if you don't know what is this, please go to the Users Office and finish your paperworks.

New Operator Checklist

Accounts etc.

have a valid CERN computer account in `zh` group (CMS)

Grid certificate

You need a grid certificate to run all CRAB3 commands, if you already have great but if not, please go to CERN Certification Authority and get one. As soon as you get you grid certificate you will be able to create a grid proxy, but for CRAB3 you should be able to issue voms proxy for that you need to become a member of CMS VO. Go to https://lcg-voms2.cern.ch:8443/voms/cms/user/home.action and log in with your new grid certificate after that request you membership at least for the group /cms.

storage space for CRAB output

You will need to run test CRAB tasks. CRAB tasks produce output which needs to be stored on some T2. As full time at CERN, you are entitiled to a storage space on T2_CH_CERN, as the VOC for it

ask CRIC administrator (Stephan or Stefano) to give you CRAB Operator role there

  • to be specific, your CERN username should be a member of "CMS_CRAB3_Operator(none)"

Subscribe to HN

Hypernews is a communication channel heavily used by CMS to discuss, announce issues and interventions, etc. For a CRAB3 operator is good to subscribe the following foruns on HN:

Elog

Elog is an online log book used to report and keep track of the daily activities, for a CRAB3 operator is important to use "Analysis Operations" and "GlideInWMS", when you post your activities on elog you have a chance to get help from other peoples and in the end you will have a full track of everything you did to solve an issue which could be very useful in the future.

e-groups

go to https://e-groups.cern.ch/e-groups/EgroupsSearchForm.do and subscribe the following e-groups:

e-group Description
cms-service-crab3htcondor-admins Admins of the cms-service-crab3htcondor e-group
cms-service-glideinwms-admins Group of the people allowed to manage GlideinWMS / Condor Puppet configuration for all CMS puppet managed nodes
cms-service-htcondor-admins A list of admins for CompOps HTcondor nodes
cms-service-kibana Admin users of the CMS Kibana dashboards AFS area
cms-service-crab3htcondor-monitor Monitor for the CRAB3 services
cms-service-webtools operators and developers of CMSWEB applications like CRABServer and CRABCache
cms-service-crab3htcondor Announcements from IT to CRAB3-HTCondor Project
You can join to these e-groups by yourself, but if need any help you can ask anyone around since e-groups are quite common. e-groups serve a dual role in CERN computing infrastructure, they are mailing lists, but also many tools allows to use e-groups to assign specific right to people, avoiding the need to individually list all users. You will find e-groups all over the places at CERN.

Access rights

As an operator/developer you should connect to some machines to see logs, run commands, start/stop services and for do this you should have access to some set of machines like CRAB3 schedulers, HTCondor Collectors, ASO server and TaskManager. To get access to those machines, please drop a message with a minimum information about who are you, the name of you job position and finally why you need access to that machines to one or more of the following groups :

Machine set Drop a message to
CRAB3 schedulers cms-service-crab3htcondor-admins@cernNOSPAMPLEASE.ch
HTCondor Collectors cms-service-glideinwms-admins@cernNOSPAMPLEASE.ch
ASO server cms-service-crab3htcondor-admins@cernNOSPAMPLEASE.ch
TaskManager cms-service-crab3htcondor-admins@cernNOSPAMPLEASE.ch
After send the message for one of those e-groups you should wait until some off his members apply the configuration changes and until this changes take place which could take at most 1 hour.

Communication Channels

CMS-CRAB3 Monitoring Links

See https://monit-grafana.cern.ch/d/000000530/cms-monitoring-project?orgId=11&fullscreen&panelId=20

Beware that at timed link may change due to the way Grafana manages dashboard saves and changes, whenever in doubt check the main index page https://monit-grafana.cern.ch/d/000000530/cms-monitoring-project?orgId=11

Tutorials and other docs

  • CRAB3 Tutorial Follow this tutorial to get learn how configure a CRAB3 environment to submit jobs to the grid and get used with its commands.
  • CRAB3 Documentation for Beginners all CRAB3 documentation for beginners CRAB3 task flow, Quickstart guide for CRAB3, CRAB tutorial (advanced), CRAB commands, CRAB user functions, Tips and tricks about CRAB, CRAB3 frequently asked questions, CRAB3 common errors.
  • Documentation for CRAB3 operators Install instructions for backend, frontend and client software

Meetings

See [https://indico.cern.ch/category/1366/overview?period=week][Indico]]
  • CentralOperation is part of Facilities meeting: Monday 4pm - attend whenever possible, but not mandatory
  • General C&O meeting: Wednesday 3pm - attend whenever possible
  • CRAB DevOps Meeting: Thursday 3pm - This is absolutely mandatory. Notify in advance if you can't attend
  • Submission Infrastructure meeting: Thursday 5pm - mandatory for the operator involved in schedd operations

-- JadirSilva - 2015-06-16

Edit | Attach | Watch | Print version | History: r6 < r5 < r4 < r3 < r2 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r6 - 2020-02-29 - StefanoBelforte
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback