Results from ArdaGrid web retrieved at 22:42 (GMT)

ATLAS accounting and job processing Hand over Guide Applications Accounting...
DRAFT Agent Factory DRAFT LQCDAgentFactoryDataFiles Usage: acrontab / screen AgentFactory is a Ganga script which is a part of diane distribution. Thus, it is imperative...
AMGA stuff AndrewMaier 24 Jul 2006
The mdclient AMGA metadata client application and its usage (hands on) The AMGA metadata catalog can be accessed using both the mdclient client application or a...
ViliusVisocka 29 Apr 2010 Main information The latest sources of the api are kept at SVN repository https://svn.cern.ch/reps/dashboard/trunk/arda.dashboard.jobsmry...
Applications ported and deployed on the Grid This is a list of non LHC applications ported and deployed using ARDA technologies. name who/when scale...
ARC Academy 2010 Introduction Welcome to the ARC Academy, part of the NGIn School at NorduGrid2010. The aim of this short course is to give novice grid users a feel...
ARDA and EIS activities (LCG/EGEE) ED section in IT/PSS group at CERN Papers and reports Presentations and contributed papers IEEE NSS conference in San...
JakubMoscicki 09 May 2006 ArdaGrid is a web page for IT/PSS ARDA team collaboration. More information about the ARDA project: http://cern.ch/arda
Arda Index ARDADocumentsIndex AndrewMaier 24 Jul 2006
MassimoLamanna 22 Jan 2007 ARDA Test Bed machines (probably incomplete and a bit obsolete) lxarda01 CPUserver: LHC L B development and testing machine...
Databases Migration Summary Query Results (3rd Nov 2009) Dashboard Account Tables Size (GB) Indexes Size (GB) Total Size (GB)...
Pledged Spacetokens ATLAS DDM Accounting Visualisation The accounting data are retrieved from the backend service as summary text files, eg. http://voatlas...
Experience of installation of integration server for ATLAS DDM Dashboard 1. Machine dashb ai 677 was created with the same parameters as dashb ai 611 (existing...
ATLAS DDM Dashboard Rucio Migration This page documents the migration of the ATLAS DDM Dashboard to support Rucio Overview The proposal is summarised in the following...
ATLAS DQ2 Get / Put Monitoring This page documents the development of DQ2 get / put transfer monitoring within the ATLAS DDM Dashboard. This feature has now been...
ATLAS Job (and Task) Monitoring User Interface changes Query modifications (from http://svnweb.cern.ch/guest/dashboard/trunk/arda.dashboard.dao oracle...
ATLAS Job Monitoring development (via MSG) Structure ATLAS Job Monitoring consists of 3 main parts: MSG Consumer User Interfaces Database structure...
Ganga Atlas Milano 2006 Tutorial JakubMoscicki 21 Sep 2006 tutorial.tar.gz: tutorial demo scripts jtm milano 22 09 2006.ppt: Introduction to Ganga...
ATLAS Panda Troubleshooting Guide Panda Collector The Panda collector is running on the dashb ai 566 virtual machine. In order to restart the collector, log...
Default values and column mapping for HOUR and DAILY SMRY tables : VOName: CERN T0 Cloud: CERN (for entry in site table) DestCloud: CERN Tier: 0 (for site table...
Rationale An ability to handle user authentication is very important part of every web framework. This functionality was missing for a long time in dashboard framework...
Design of an Expert System based on found Association Rules in Grid Job Monitoring Data Abstract Given the complexity of a Grid infrastructure it is impracticable...
Avian Flu Data Challange Press EGEE Press Release: http://www.eu egee.org/pr/uk/nr avianfluegee eng.pdf BBC: http://news.bbc.co.uk/2/hi/technology/...
The policy: when to close bug reports in savannah Check if the bug report contains a vaild request. If it is a non issue then close the report immediately with a comment...
CERN managed services and tools There are several tools and services that have been historically maintained by CERN staff, and which will need to be picked up by other...
Check the attached pictures for schedule and phone numbers. WLCG Data Transfer Dashboards If plots seems to be up to date (data in the last hours) then everything...
Chep 07 Talk I have attached the talk I am going to present at CHEP. Comments welcome. Andrew AndrewMaier 30 Aug 2007
Cloud monitoring Introduction The motivation for this development is to offer a common solution for monitoring of the performance of the VMs used for the VO processing...
Collection of resources on Cloud Computing http://www.gridtoday.com/grid/2396035.html https://edms.cern.ch/file/925013/3/EGEE Grid Cloud.pdf JakubMoscicki...
BOOT FULL ALARM Boot full alarms happen when we have several kernels installed. In case of boot full alarms: 1. Check how many kernels are installed: root@dashb...
CMS Critical Services Introduction This is the new CMS Critical Services monitoring system. As before it uses treemap visualization technique. In this new version...
CMS Job Monitoring collectors Contents: Overview New implementation of CMS job monitoring collector for the Experiment Dashboard monitoring project. This page at...
Dashboard ProdAgent Monitoring Common schema of Dashboard ProdAgent monitoring: The main goal of PA monitoring is to collect job monitoring info from...
From: Tony Cass Sent: Thursday, June 22, 2006 6:56 AM To: info experiments (Master list for IT to broadcast to all experiment lists); it dep service managers (IT Service...
Dashboard Earth: Grid Activity Monitoring with Google Earth Documentation Please check the Documentation or the Documentation Maintenance of the Application...
ARDA Dashboard Quick Links Homepage Cluster (dashboard) Demo Guidelines Support For other doubts or if you could not find us there, please send an email...
Dashboard Authentication and Authorisation Authentication module (dashboard.auth) This module`s purpose is to set up the CERN SSO Portal over any dashboard application...
24 10 2011 SSB: Running in a dedicated server All the latest changes in collectors Google analytics since 10 days Plan to move...
WLCG Data Analytics platform data analytics platform on Hadoop friends. LucaMagnoni 2015 04 02
How to create a personalised dashboard (mashup) Introduction This document gives step by step instructions on how to create a personalised view (mashup) of Dashboard...
Siteview GridMap: A Monitoring Application for Grid VOs activities at the Sites Siteview application: the status of VOs activity in a given site summarized in...
Metrics currently available item ALICE ATLAS CMS LHCb general site status yes yes (extracted from Dashboard API) yes yes total...
The Siteview collector The Siteview collector has been developed in the framework of Dashboard. How to stop and start the collector The collector is stopped and started...
Savannah tasks Savannah bugs here To do list: Change the collector. Compute the total values for data transfer and job processing in the end of the loop Done...
How many data to store for the data transfer Some considerations about the amount of data to be stored about data transfer. From a mail thread between Pablo and Julia...
The Siteview Database schema The data relative to the four LHC experiments are stored in the same schema. Description of the schema table by table: SITEVIEW This...
The GridMap display of Siteview General introduction on GridMap technology The GridMap developed for Siteview Configuration of the GridMap Connection to the database...
Activities and metrics that we want to monitor There are 2 main activities: job processing and data transfer. For each main activity, there is a group of sub activities...
Siteview collector Structure of the collector Where it runs System hosting the collector of all dashboard applications here How to start/stop it Logfiles Configuration...
Gridmap server System hosting the server... Configuration... How to start and stop... ElisaLanciotti 18 Nov 2010
Ongoing activity 18.11.2010: understand who takes care of producing the XML files containing the VO topology for the other experiments and why they don`t follow...
Site naming convention We use the BDII names. The site names displayed in the Siteview GridMap interface are downloaded from the gridops web site. For ALICE For...
What information experiments can provide? The type of information strictly depends on every VO specific monitoring system. See a review for each of them. LHCb: Dirac...
Definition of targets The targets should be defined by the experiments. This monitoring tool can only publish the targets to that the user can see them and have an...
The format to provide the data For the job processing activities each line should have the following format: 9 fields comma separated. For example: CERN,job processing...
Currently available URL where the metrics are published To get all the active URL read by the Siteview collector execute the query: select from siteview urls where...
Commit rights to Dashboard SVN repository All areas julia, psaiz, dtuckett, rocha, libdashb ATLAS modules In /trunk : client gwt, server proddb, server storage...
SVN repository access: svn co https://svn.cern.ch/reps/dashboard/trunk check out current development version Branches are in https://svn.cern.ch/reps/dashboard...
Data Transfer Tools for Theory QCD Application Grid Tools We investigate xrootd and FTS for this purpose. xrootd lxplus.cern.ch : the tools are already installed...
ATLAS DDM Dashboard Architecture User interface Collectors Architecture RPM packages Configuration files Log files Data flows Database Accounts...
ATLAS DDM Dashboard Hand over Guide Overview The ATLAS DDM Dashboard monitors the ATLAS Distributed Data Management (DDM) system. The DDM system is currently being...
Google Earth Installation Installation instructions can be found here. Steps for demo 1. Zoom out to show the full globe activity 2. Explain 1. Fixed...
DIANE DIstributed ANalysis Environment This page contains the working documents for the DIANE project. The official homepage is at http://cern.ch/DIANE User documentation...
Build external dependencies from sources Typically you would build external dependencies from sources if there are no precompiled binaries for your platform,...
DIANE2 Ganga integration Currently Ganga is only used as a worker agent submission framework. Master is always run locally (as a ganga job?). Overview DIANE worker...
How to enable secure connection based on GSI In the run file you should define: omni config type `gsi` Before you start a diane program (master, worker, directory...
Installation Cookbook DIANE is developed, compiled and tested on Scientific Linux 5, however it will work on any Unix based platform. DIANE has intentionally few package...
Central release (AFS) Refresh the TRUNK (development) release preview cd /afs/cern.ch/sw/arda/diane/install/TRUNK svn update cd /afs/cern.ch/sw/arda/diane/etc ./repackage...
Configuration of transport layer (omniORB To enable Grid authentication see DIANE2GSI The DIANE transport layer (networking) is provided by omniORB which is an...
DIANE2 prototype errors This is a list of known problems of DIANE 2.0 prototype. In progress testOK50.py: WorkerServlet: CORBA.INV OBJREF Run: lxplus219.cern.ch...
DIANE2 Testing Basic DIANE tests are kept in: python/diane/test . run.py main test driver test individual test cases .cfg predefined system...
List of mandatory issues to be done before 2.0 release can be made Documentation TODO generate web help for config options and scheduler policies DOC:...
DIANE2 Worker Environment Goal Review and migrate the current app/ init .py:BOOT mechanism into 2.0 Use cases: preconfig is used to set maxGIOPMessageSize...
Directory Service Overview of DIANE When you have a job to execute, you start a master and submit some workers: diane.startjob job autodock.job...
DIANE Environment Scripts DIANE requires only very minimal environment to run user commands, without polluting your shell environment with many variables. The diane...
Future DIANE developments Infrastructure changes Release infrastructure Adapt to ganga infrastructure for the release, external packages, testing. Installation tree...
DIANE Geant4 Analysis Applications documentation I would like to write a part on: How to use ROOT alternatively to AIDA; I know that DIANE is independent to...
Using Ganga as a Job Submission Interface for the DIANE applications Using the Ganga arhitecture we developed a backend handler that may be dynamically loaded in the...
DIANE Integration with Ganga Proposal 1 Example 1 GPI code which corresponds to DIANE/dev/workspace/testErrorRecovery.job file: # master job j Job() j.backend...
DIANE Installation and Download DIANE is a prototype and the implementation serves as a proof of concept rather than production system. However current beta versions...
Installation mirrors By default DIANE is installed from http://cern.ch/diane website. Sometimes you may want to change this: if you want to modify the DIANE software...
DIANE Introduction for Students... Application Patterns iterative decomposition (looping) typical for many applications data analysis (ATLAS/Athena...
New DIANE logo Thanks to Eamonn! JakubMoscicki 04 Sep 2007 Check in the attachment table below for more sizes and formats. This is the official logo to be...
How to make DIANE release Currently we support slc3 gcc323 , slc4 ia32 gcc34 , slc4 amd64 gcc34 architectures Build on slc3 (lxslc3 machine) TAG DIANE 1 4...
DIANE monitoring service # ssh root@dianemon root@lxarda14 ~ # su monal ~/MLrepository diane/stop.sh ~/MLrepository diane/start.sh ~/archives contains the db backup...
DIANE Network Testing for SLAs The job consist of 3K short tasks of various durations: 0.1,1.0,2.0 seconds Each tasks returns via the network the data message...
Shell scriplets: CVS: cvs status 2 /dev/null grep Status: grep v Up to date for x in `seq 1 100`; do diane run 2 1 grep Error; done; Monitoring monitoring...
Official DIANE Documents This page contains links to official documentation. The official content is automatically embedded into DIANE homepage (http://cern.ch/diane...
Platform Doctor Platform Doctor is a script which helps you to diagnose and manage problems with external dependencies. Currently it fixes the problems with omniORB...
How to plugin your application into DIANE? This manual covers the python application adapters. For C application adapters have a look in G4Analysis application for...
DIANE Frequently Asked Questions and Cookbook Installation Which platforms are supported? See DIANE2Installation. The diane run command gives: ImportError: No...
Starting a worker agent on arbitrary host / node of a private cluster Documentation on how to user RemoteSubmitter.py here. JakubMoscicki 09 Feb 2011
Advanced scheduling with job requirements: matching task and worker capabilities The default scheduling mode in DIANE is first in,first out: a free worker picks the...
Source code tree organization bin : user commands etc : admin and helper files idl : idl source files (CORBA interface definitions) python...
Task monitoring for DIANE (dashboard) You may easily monitor your tasks here: http://dianemon.cern.ch/diane One of the new functions of DIANE Dashboard (available...
DIANE Tutorial Introduction DIANE is a tool for managing large number of small independent tasks (typically for parametric study). It works based on master worker...
WLCG Questionnaire Reference: http://indico.cern.ch/getFile.py/access?sessionId 4 resId 0 materialId 2 confId 20230 Describe in a schematic way all components of...
This wiki serves as a draft structure for the discussion of Documentation, Testing and Support issues during the GANGA Developers` Day. Documentation Review of online...
Downtime handling Goal Keep track of the downtime information of the different sites. It should be able to differentiate between scheduled or unscheduled transfers...
EGEE Budapest Contributions Demo (medical physics) These instructions have been provided from /afs/cern.ch/sw/arda/install/DIANE/Geant4/G4DIANEworkspace/jobs/README...
Advanced Tutorial: Genomic Search with BLAST This tutorial was developed for Baltic Grid Schoold 2009 by T.Szepieniec et al. and subsequently adapted and improved...
Ganga EGEE Tutorial Package Ganga is an easy to use Grid job submission framework homepage used in several activities in different application domains, supporting...
EGI Introductory Package: an easy start for new user communities Introduction EGI Introductory Package is a simple but complete solution for running and monitoring...
EGI User Forum 2011 This wiki explains the different activities that will be presented at the SA3 booth in the UF: CORAL: Main presenter: Alexander...
EGI User Forum 2011 SA3 Contributions This is an internal page to collect, edit and manage contributions for EGI 2011 User Forum: http://uf2011.egi.eu/Call for participation...
Evaluation of ElasticSearch Current evaluation Hassen has performed an evaluation of elasticsearch with the Aggregation module comparing the results with last year...
With the following changes a rolling restart will take 2.5 hours instead of a day (or even more). Optimisations to reduce the downtime The following changes that...
Disable puppet agent This way upgrade does not happen on a puppet run, and you can do it manually on each node. This works but affects both production and dev: aiadm...
Adding new application: In repo it puppet hostgroup dashboard, in data/hostgroup/dashboard/elasticsearch.yaml add the new application to the list elasticsearch index...
EnviroGRIDS Project Gridification of SWAT What is SWAT? The Soil and Water Assessment Tool (SWAT) is a physically based continues event hydrologic model developed...
WLCG Transfer Dashboard Applications FTS Dashboard Hassen phone : AAA and FAX Dashboard Luca phone: 166447 Swiss mobile:0041762174549 ,Cris phone:...
feynsect application We compute generic Feynman diagrams with one and two loops using a numerical method developed in the course of the last three years. The main...
Flexibility in Job Monitoring Problems: with 100s of active jobs in the repository, it`s too long to wait for the status updates of the user`s preferred jobs...
CristovaoCordeiro 21 Mar 2014
Rationale HTML comes with a form tag, which allows to create complicated forms with many different controls like check boxes, text areas etc. Unfortunately it lacks...
Support FTS Monitoring Dashboard This page documents the support of the FTS Monitoring Dashboard. FTS Infrastructure Prod: http://dashb fts transfers.cern.ch...
Support FTS Monitoring Dashboard This page documents the support of the FTS Monitoring Dashboard. FTS Infrastructure Prod: http://dashb fts transfers.cern.ch...
Priority list for tasks We will set priorities for all the tasks defined during the two days of the meeting. We then need to put this in the persopective of the available...
Introduction This page is designed as a simple user walkthrough of one of the latest features in Ganga 6. Ganga 6 sees the introduction of many changes over the last...
Ganga AFS administration Ganga top directory: /afs/cern.ch/sw/ganga This is a mountpoint only, do not put files directly at the top level! Access control groups...
Purpose The level of detail presented when printing a Ganga object (especially a Ganga job object) can be overwhelming. There needs to be some control mechanism to...
To enter onto the author list of a Ganga paper you should satisfy the following requirements Made contributions to the project for more than 6 months Made...
GangaBox Purpose of GangaBox The GangaBox was coded as a response to 46033; and should allow a user to store any Ganga Object in an easy to understand way...
At CERN there is a called CERNbox which will provide CERN users with a Cloud storage area. The backend storage for it will be EOS at CERN. It would be obvious that...
This document has been enchanced after the discussion between Alvin and Kuba at CERN on 13.09.2006 The issue Currently, Ganga 4.2, does not handle the shutdown of...
Ganga coding sprint July 2015 On the 7th of July 2015 we will meet at Imperial College for a Ganga coding sprint. The main topics of the day are: Refactoring...
Proxy objects and plugin classes Proxy objects All objects in ganga are derived from the GangaObject superclass and have to provide some metadata (defined as static...
Improvements to the configuration subsystem For description of the current configuration subsystem see Survival Guide The package location in CVS: python/Ganga/Utility...
Ganga configuration system Configuration in Ganga is centrally managed in these packages: Ganga.Utility.Config and Ganga.GPIDev.Lib.Config . Some design objectives...
Refer to initial document compiled by Alvin and Kuba at CERN on 13.09.2006 : GangaCleanShutdown The issue Currently, Ganga 4.2/4.3, does not handle the shutdown...
Introduction (Note that this will morph into an actual tutorial as we converge onto a solution!) It has been discussed for sometime now about giving the credential...
This page contains the service documentation card for Ganga/DIANE monitoring Deployment procedures and notes are available here: GangaMonAdmin JakubMoscicki...
GangaDirac3 This page will be used to track the issues related to supporting Dirac 3 with ganga. At the time of writing these are current Dirac 3 API docs. A branch...
To test possible tools for GANGA API documentation and following recommendations from Chun Lik Tan: with documentation tools for Ganga the HappyDoc was tested and...
Ganga External Monitoring This page describes the design and implementation strategy for Ganga to do external monitoring via systems such as Monalisa and Dashboard...
Ganga Framework Migration This page contains the information for Ganga developers what to do to migrate their code. Migration for Ganga 4.2.0 beta4 Summary of changes...
Publication We will write a peer review overview paper of Ganga. It should be around 20 pages long and contain an overview of the design goals, the architecture, the...
Submission mechanism in Ganga The job submission, j.submit() , is considered in two main cases: 1. simple jobs (no splitting) 2. master/subjobs (splitting enabled...
These pages are currently under cleanup and reorganization (by Kuba) JunkBuffer Ganga Collaboration Page Homepage: http://cern.ch/ganga Operations Release management...
The Idea of input files On the last Ganga developer days at CERN, the idea of using the output files as input for other jobs was discussed. A new inputfiles field...
Ganga JEM prototype What is JEM? As part of the High Energy Particle Physics Community Grid project (HEPCG) of the German D Grid Initiave, the University of Wuppertal...
Job Indexing and Slices Goals Clarify/Add selection mechanisms and list like slices (physical vs logical indexing) Assure that slices support a subset of...
Job Operations Goals of the changes in 5.0 Clarify the error handling for job operations API Make collective operations easier Basic operations on individual...
DeReTo (working title) plug in 14/09/2006 Developed by Derek Groen Attached code snippets README: README TinyJob.py.txt: Executable handler LCG.py...
Ganga Job Status Issues remaining to be solved resource leak : ganga should protect users from leaking resources: ganga should not report jobs are finished...
Ganga job states and their transitions The job.status property, which holds the state information, is a string and it is the responsability of the backend handlers...
Ganga Job Workspace Interface Job workspace can be imported as a GPI object. It will be an attribute of a Ganga job, so that j.workspace gives access to the job...
Support for lazy loading LL lazy loading main use cases: level 0: improve the startup time level 1: partially loaded objects (load metadata only...
Motivation The LCG RB (both EDG and gLite WMS) has a size limitation on job`s inputsandbox (by default is 10 MB). Jobs with oversized inputsandbox will encounter job...
Getting live stdout/stderr from the worker node Using Birger`s Octopus client/server, there is a of the intial motivation. By default monitoring is OFF. It is only...
Ganga Logging Subsystem It should be possible to set all levels globally and have the fully functional Ganga session. The exception is PARANOIA which can produce overly...
Logging Ganga logging subsystem: Ganga.Utility.logging Logging is based on standard python module logging.py: http://docs.python.org/lib/module logging.html Configuring...
Ganga Logo This is the latest version of the suggested ganga logo. See the attachments for more formats. Basically there are transparent and non transparent versions...
Ganga memory and disk footprint Conclusions 1. ganga uses ~3 times more memory than the job`s payloadwhile adding jobs in the same ganga session it takes around...
Job Merging Support in Ganga Introduction Users often partition jobs, either manually, or automatically with a splitter, so that the output files from several jobs...
Ganga Monitoring and CMS Analysis Support Twiki Old voatlas90 based twiki For posterity the information about the old voatlas90 server is kept here GangaMonvoatlas...
Ganga/DIANE Monitoring Ganga/DIANE monitoring dashboard runs on port 80 at http://gangamon.cern.ch, the underlying host is currently voatlas90. You can view its Quattor...
Most important new features for Ganga Introduction For the efficient discussion about new features it is useful first to recall the main goal of the Ganga Project...
GangaMSGPeek Based on Architecture the plugin MSGPeek provides a way to examine job output in real time on the Grid, looking into the stdout/stderr of a job. The client...
Ganga on NorduGrid Introduction The GangaNG directory contains the code for the ganga NorduGrid backend, as well as various runtime handlers. How to use GangaNG...
Octopus Monitoring GangaOctopus is currently not working Please not that at the present time (Sep. 2009) GangaOctopus is not functional. We keep the documentation...
2010 Dates Name Jan 6 Mar 9 Tim M...
Ganga Developer days in Oslo February The and registration page Ideas for sessions New developments Timestamps Unified output handling Composite...
Proposal for a unified treatment of output in Ganga Current situation In Ganga we currently in the schema for the Job class have the concept of outputfiles and outputdata...
Introduction Historically within the Ganga framework, responsibility for handling job output data has been with the scripts created by runtime handlers, rather than...
Ganga Planning in 2007 Medium and long term goals: improve usability of the currently available features improve testing and documentation introduce...
Planning for Ganga is 2010 Indico agenda: http://indico.cern.ch/conferenceTimeTable.py?confId 94195#20100927 Organisation (Monday) Outstanding items from the Oslo...
Planning for Ganga is 2012 agenda Outstanding items from the Munich meeting (Kuba) OK: prepared state Thread handling XML...
Planning for Ganga 2013 agenda Items from the Birmingham meeting new output handling mechanism postprocessors, checkers, notifier creation of directories...
JakubMoscicki 15 Jun 2006 GangaPlotter GangaPlotter : graphical summary about job statistics using matplotlib package Piecharts plotter.piechart(jobs, attr,...
Post processors for Ganga 6 Idea The idea behind the new postprocessor objects is to: Simplify the merger code (i.e. remove the `mergetool` objects) Add...
A prepare method for Ganga applications This documents the `prepared` state for Ganga Core applications, as introduced in Ganga 5.7.0. High level overview The purpose...
A prepare method for Ganga applications: Developers Guide This page documents the `prepared` state for Ganga Core applications (introduced in Ganga 5.7.0) for Ganga...
GangaPress A collection of magazines and web page articles which mention Ganga.... Science Grid This Week: http://www.interactions.org/sgtw/2006/0830/lhcb more...
Remote Workspace Related pages: GangaLCGInputSandboxCache WebDAV prototype: webdav://gangamd.cern.ch/ganga (file manipulation possible in konqueror browser, from...
Problem in 1.4.1 / Local repository ? Start two parallel ganga sessions and try to commit the same job: Session 1 for i in range(100): jobs 1 .name `bbbb` Session...
Ganga Robot Preliminary ideas document (out of date) Ganga Developer Days Presentation 10 July 2007 (support files) Main.dtuckett 20 Jul 2007
Introduction We can build RPMs for the Ganga packages. This is currently a manual operation, performed by calling ~/ganga/release/tools/rpm builder.py with the...
The issue A sandbox can be more complex than a simple set of files which are placed in the CWD on the worker node. In particular there can be files in subdirectories...
Introduction We employ a series of tests to detect non backwards compatible changes in the Ganga schema. The basic idea is that when a new version of Ganga is tested...
Running Ganga as a Service Introduction As of Ganga 5.8.7, it is possible to run Ganga not only daemonised but as a light weight socket style service. This Twiki...
Job Splitting Design Document document revised for Ganga 5.0 the original Ganga 4.1.0 content may be retrieved as revision 3 (r3) of CERN wiki site GPI interface...
Internal Junk (to be reviewed) Other job properties The subjobs get the master job name unless splitter modifies it. The application and the backend type are the...
Platforms supported by Ganga Ganga is not platform dependent but some of the external component are (for example PyQt, experiment software, Grid UI,...). Our main...
How to stay friends with SVN in the Ganga project Here is the reading: http://svnbook.red bean.com Access Command line: export SVNURL svn ssh://svn.cern.ch/reps...
Ganga Testing Framework This page documents the re engineering of the Ganga Testing Framework. The existing framework is a hack and a patchwork on top of pyunit: http...
Ganga Testing Framework Introduction This page describes Ganga testing framework: how the tests are organized how to add new tests or modify existing tests...
Decisions from the 2009 Ganga dev. days in Oslo It`s agreed that the Ganga Core framework should provide a basic class for the Thread objects which may be created...
Concurrent Job Access in Ganga 5.0 This is a summary of the discussions at CERN the 27.11.2007 and 28.11.2007. We identified that in Ganga 4.4 there are a number...
Timestamps This proposal refers to recording the ganga job state transition times (so not the timestamps recorded in the submission backends or on the worker node...
Running PrimeFactorizer application Small example In this example we create and submit a local job with PrimeFactorizer application. We use only one table in the...
Purpose In the CLI, the user cannot be sure if certain values should be integers, floats, strings, etc. E.g. j.application.max events 100 or `100`, inputdata `abc...
Ganga Usage Statistics Monitoring # ssh root@gangamon root@gangamon ~ # su monal To start/stop ml server type: ~/MonalisaGanga/Service/CMD/start webml.sh ~/MonalisaGanga...
The Windows port of Ganga An initial port to Windows has been done by Rebecca and has been checked into CVS branch ganga 5 0 branch rebecca windows . Currently the...
Modification of the job wrapper scripts 1. use subprocess module to spawn the application process which should use the sys. stdout and sys. stderr of the...
The tests are done on Ganga 5 0 xml repository branch with the GangaList support disabled in VStreamer.py : #from GangaList import makeGangaList def makeGangaList...
pre { text align: left; padding: 10px;margin left: 20px; color: black; font size: 16px } pre.command {background color: lightgrey;} pre.cfg {background color: lightblue...
Garfield on the Grid Garfield is a computer program for the detailed simulation of two and three dimensional drift chambers. See homepage. Background information...
Geant4 Release Regression Testing on the Grid Geant4 Production: Instructions Introduction This webpage describes all steps required to setup and run the Geant...
THIS IS OBSOLETE AND NEEDS A REVIEW O B S O L E T E Instructions for the handling Geant4 installation tarballs (dirInstallation). You must be at CERN User Interface...
Instructions for the handling Geant4 installation tarballs (dirInstallation). You must be at CERN User Interface and use your GEANT4 grid certificate. If you don`t...
Moved to https://github.com/ganga devs/ganga/wiki/Git Intro
All available G4 sites ce1.inrne.bas.bg:2119/jobmanager lcgpbs geant4 OK grid ce0.desy.de:2119/jobmanager lcgpbs geant4 Abort: `BrokerHelper...
Siteview GridMap: How to build the RPM packages using Koji Setup of your environment Install the Koji client (see https://twiki.cern.ch/twiki/bin/view...
Useful Dashboard pages for Site Managers Report for a site (ALICE, ATLAS, LHCb) http://dashb atlas.cern.ch/dashboard/request.py/MonthlyReportIndex (ATLAS as example...
The HammerCloud infrastructure is composed as follow: ATLAS production core server and web server: it hammercloud core 01 ATLAS production submit nodes:...
How to configure Ganga in a local environment Using other VO Example for balticgrid . Configuration .gangarc : LCG VirtualOrganisation balticgrid defaults...
These are the steps that you have to follow to create a new dashboard release. As an example, we will do a new release of dashboard siteview. Requirements on the...
How to manage CVS tags and branches How to get the source code to develop an existing ganga package? Do not rely on CVS HEAD. Always use tags: global release...
How to debug Ganga with Wing IDE graphical debugger Note: Wing IDE version 2.0.3 does not work with python2.2. You may use python 2.3 from ganga/external/Python repository...
Style guide and docstring conventions for Ganga source code The docstring should follow the pydoc convention: the first non blank line is a short description. It should...
How to use and extend Ganga Robot This document refers to the Ganga Robot code tagged GangaRobot 0 4 in CVS, which is expected to be included in Ganga 4.4.0 release...
GangaTest TestRobot documentation The robot is a autonomous testing framework which can be configured to run indefinitely on any machine to download a new pre release...
GangaTestRobot Introduction The robot is a autonomous testing framework which can be configured to run indefinitely on any machine to download a new pre release of...
How to use a grid certificate in a non standard location You may pass arbitrary options to create grid proxy (gridProxy.create()): default GridProxy init opts...
Goal This page briefly explains how to setup your own GSI OpenSSH server and use it as a out of the box service to transfer files produced by Grid jobs (e.g DIANE...
Ganga pre release install Just before an official release is to be published, developers are encouraged to test the pre release version To install locally the pre...
Instructions for developers joining the Ganga team Project homepage: http://cern.ch/ganga Administrative checklist AFS login name for CVS authorisation (send...
Adding external GUI panels with GANGA GUI Plugin System The GANGA GUI Plugin System ( GPS ) has been designed to assist GANGA developers with the task of adding...
Creating the Ganga application plugin. 1. Make a copy of Ganga/Lib/Executable and save it as myAppDir/myApp (for example). Source code for Ganga/Lib/Executable...
Creating the release Note: You may find it useful to start a gnu screen session under the gangage account. You can then create new screens and log into the gangalb...
Release process for LHCb This information is only relevant for releases after 5.4.0 . For testers Create pre release Log into the gangalb account Update...
Running Compiled Root Jobs in Ganga Introduction Ganga supports the submission of ROOT jobs to many backends, including the Grid (LCG,Dirac) via the Root application...
How to Set the Lens icon in CMS Site Status Board Use https version of the page and make sure your certificate is loaded in the browser Only people whose...
What is awstats Awstats stands for `Advanced web statistics`. In dashboard infrastructure it is used as an httpd logs parser. The official site is at http://awstats...
How to get the source code and setup your development area The instructions below refer to $prefix which is the top of the Ganga area you are setting up. For example...
HangiKim 31 Jul 2009 ui 1: /var/www/html/tutorial scenario 1 (SW:wget, DATA:wget) First section, to test NBP search 09.sh script on local machine. $wget http:/...
Howto setup a suitable Grid Proxy for running the ganga tests This page tries to address the problem where the release manager is able to generate a proxy for a certain...
Crontab lxb1420: # Prepares files for monitor (check the dat directory etc...) 34 /storage/lqcd/apps/output/mon/plot.py /storage/lqcd/apps/output/mon/plot...
ITU RRC06: International Telecommunication Union Regional Conference Operational Information ITUContactList: all persons who may be of help if there are some...
Contact List for ITU RRC06 DIANE primary contact: Jakub.Moscicki #64;cernNOSPAMPLEASE.ch secondary contact: Hurng Chun.Lee #64;cernNOSPAMPLEASE.ch IT SERVICES...
ITU RRC06 Press (German) http://www.heise.de/newsticker/meldung/74408 JakubMoscicki 19 Jun 2006
CMS When experts have to be contacted If there is a snow/GGUS then just send SMS to Eddie (00306948878807) and Julia (164588) If you get alarms for one...
Job Repository performance comparison This is a quick performance comparison of repositories in different configurations for Ganga 4 2 0 beta1 The test program is...
Junk Buffer for reorganization and cleanup of Ganga developer pages by Kuba (2010) Other operations (not part of the release management responsibility) RestartGangaJobRepositor...
Scalability with SAGA, Ganga, DIANE through WLCG, TeraGrid and FutureGrid (Cloud) resources Milestone: talk and demonstration at EGEE User Forum, beginning of April...
LCG tips tricks How to get more detailed information what happened with the job in the submission chain edg job get logging info v 1 https://gdrb01.cern.ch:...
Motivation Below you find set of guidelines for developing Dashboard applications. Treat it as useful suggestions that can help you to develop a code that is consistent...
This is the list of responsible for each of the dashboard modules (produced directly from the svn authorization file) : api job production: Frank...
Live processing (2009) Current status http://cern.ch/diane/lqcd 2009/plots/lxarda28/fileRate.png Iterations vs file...
Long term future of job repository Desired functionality Keep all relevant information for current and previous jobs Scalable to 100k jobs or more...
Logs collected by AgentFactory during LQCD 2008 linear fitness lxarda28 Gear VO /storage/lqcd/apps/output/kuba lostman gear.gangadir/agent factory/log.linear...
This description is not full. Nevertheless It could help developers to unstarstand how does the Master awstats work. MasterAWStats.py class AWStatsConfigurator...
mcfm application Private version of MCFM which uses semi numerical techniques for the calculation of the virtual one loop corrections. AFS work area: /afs/cern...
Grid Setup for MedAustron For a http://cern.ch/ganga GANGA package, GangaMedAustron has been developed. Following features have been implemented: Software...
Diane Demo Setup for MedAustron The setup is based on the G4Analysis application of DIANE from the NSS2008DemoAndTutorial. Installation Following requirements for...
Meeting with Philippe 16.04.2008 Mother snapshots: /afs/cern.ch/project/theory/gridQCD/mother snapshots 0 . Each of 16 files corresponds to one beta parameter. Execution...
Ganga Plugin Migration This page contains proposal for the plugin migration framework. It gives examples for Ganga developers what they may need to do if the old...
Problems with SL4 migration CERN IT information: http://plus.web.cern.ch/plus/SLC4.html Problems with the AFS LCG UI at CERN: 02 Feb 2007 : LCG UI version 3.0....
Motivation `When working on a web application that involves a lot of JavaScript, one of the first things you learn is to stop tying your data to the DOM. It`s all...
Preface MonAlisa is a software for monitoring many ascpects of physical machines grouped in a cluster. We use this software for monitoring all (virtual and physical...
Experiment parameters physical PC, pcitsdc04 with centos7 cern Identical, unburdened AI nodes: ikadochn es c, ikadochn es c3, nova large (4 CPU, 8GB) with slc6 Unless...
JakubMoscicki 09 May 2006 The location of this page is: ArdaGrid.
Creation of Mother Snapshot 2008 cd~laman/qcd ./create.py The program prints an awk line which can be used to submit (LSF) the jobs: ls l qcd .com awk...
Populating a database with messages via msg consume2db (in case of ATLAS Job Monitoring) #1057;ommon schema of an interaction between msg consume2oracle...
We foresee three different use cases : Requirements for MSG for ATLAS job monitoring Reports from the worker nodes We estimate tat ATLAS has up to 50 60K jobs...
Goals of the Refactoring Integrated backend for jobs, tasks and the GangaBox lazy loading / unloading this involves indexing using metadata...
MassimoLamanna 16 May 2006 Recovery procedures UI machine does not work Use another machine with outbound connectivity (action on Massimo) Submit installation...
OlgaKodolova 25 Jun 2014 Firstly, one has to ask for permission to introduce changes in the database. PLease, send e mail to Dashboard support (dashboard support at...
Nightly ganga releases Main idea As the first data analysis rush draws nearer, experience from user support shows that our software is prone to minor, easily fixable...
HEP noSQL landscape Summary ATLAS: Cassandra, MongoDB, Hadoop/HBase, SimpleDB CMS: MongoDB, CouchDB, Kyoto, HDFS PES: Cassandra/HBase? GT: ?...
nouvelle page JakubMoscicki 21 Feb 2008
Short Course NSS2008 Setup environment (AFS) source /afs/cern.ch/sw/arda/install/DIANE/Geant4/G4DemoNSS2008/env.sh Demo 1: compile and run a brachytherapy simulation...
Running Tests v4.2.0 beta5 : gangaRunTests test runner is distributed in GangaTest/sbin package version 4.2.10 : gangaRunTests updated to allow running...
Starting point login on lcgui003 tcsh cd /afs/cern.ch/sw/arda/install/ITU source env.csh grid proxy init should not be needed if you created...
Application name Availability Computation Engine (ACE) Short description of application functionality Aggregate data to compute status and availability...
Application name Aggregated Topology Provider (ATP) Short description of application functionality tool that aggregates grid topology info...
Application name DDM Accounting Short description of application functionality tool that helps ATLAS to monitor the space occupancy of their sites according...
Application name DDM Dashboard Short description of application functionality Tool for monitoring ATLAS dataset / file registrations, staging...
Application name Job Monitoring Interactive, Historical, Task monitoring Short description of application functionality tools that helps ATLAS and CMS to...
Application name Metric Record Store (MRS) Short description of application functionality This application provides metric results and status...
Application name Profile Management (POEM) Short description of application functionality This application provides configuration system to group...
Application name Site Status Board (SSB) Short description of application functionality tool that helps VOs to monitor the health of the distributed...
Application name WLCG Transfers Dashboard Short description of application functionality Tool for monitoring cross VO and cross technology...
Application name AAA and FAX Dashboard Short description of application functionality Tool for monitoring the XRootD federation for ATLAS and...
19,20,21 Julia 22,23 Cris 24,25 Eddie 26,27 Rocio 28,29,30 Pablo 31,1 Luca 2,3 Sergey
Release overview (approx 2 hours) Ganga has developed into a major piece of software, offering a wealth of functionality. Even with the weekly phone meetings, it...
Ganga Package Release and Tagging Packages are maintained in Ganga SVN, and packages maintained by independent developers have independent version numbers. The tagging...
JuliaAndreeva 03 Jun 2010 We need to get information for 4 job monitoring data categories : Below I`ve tried to find correspondence between the Dashboard DB and Panda...
Name: Paola Di Marcello Login Name: paoladm Email: Paola.Di.Marcello #64;cernNOSPAMPLEASE.ch Phone: Department: Location: CERN Meyrin
Post processor objects in Ganga 6 Postprocessors is a new concept introduced in Ganga 6. It includes the mergers that were previously available and at the same time...
MassimoLamanna 16 May 2006 Recovery procedures UI machine does not work Use another machine with outbound connectivity (action on Massimo) Submit installation...
problems and mysteries 32/64 bit confusion: The same works for Local submission. LSF jobs fails. Form the same account I can read the `missing` file!...
Production 2007 workdir: /afs/cern.ch/sw/arda/install/su3 Contest Goal: who produces the largest number of iterations (SU3 steps) wins Prize: to be specified...
How to apply corrections to a profile Introduction A profile defines how to combine several metrics using an algorithm. The result is a new metric that calculates...
Quarterly plan for February 2012 April 2012 Job monitoring area Historical view ATLAS There is a long list of feature requests, but they will have lower priority...
Quarterly plan for May July 2011 Job monitoring area Historical view ATLAS Add new sorting attribute , namely new definition of the generic activity (end of...
Quarterly plan for August October 2011 Job monitoring area 35 bugs were resolved for ATLAS CMS Historical Views, ATLAS CMS Job Summary and CMS Task Monitoring...
Quarterly plan for November 2011 January 2012 Job monitoring area Historical view ATLAS Multiple bug fixes and feature requests implemented. See report from Eddie...
Quarterly plan for May July 2012 Job monitoring area Historical view ATLAS Long list of feature requests implemented. Tracked through Savannah CMS New version...
JuliaAndreeva 20 Aug 2012 Quarterly plan for June August 2012 Job monitoring area Historical view ATLAS Long list of feature rquests from ATLAS. All implemented...
Quarterly plan for August October 2012 Job monitoring area Historical view ATLAS Implementation of feature requests and bug fixes tracked through Savannah. CMS...
Quarterly plan for November 2012 January 2013 Job monitoring area Historical view ATLAS Import T0 ATLAS jobs statistics in Historical Views Enable hourly...
Overview This page documents the policy to request re computation of SAM3 availabilities results for WLCG. How to request a re computation How to follow a...
How to restart Ganga job repository server NOTICE: The Ganga job repository server is currently migrated from gangamd (lxgate31) to lxgate41. How to restart the new...
Running G4Brachy application on the Grid Notes: The AFS directory with Geant4 installation: /afs/cern.ch/sw/arda/install/DIANE/Geant4 It contains the tarball with...
SAM3 API DOCUMENTATION GET latestresultssmry json Returns a summary of the latest test results. Resource URL http://wlcg sam experiment .cern.ch/dashboard/request...
SAM3 rota Calendar Period Rota January 2015 Pablo February 2015 Hector March 2015 Rocio April 2015 Rocio May 2015 Cristovao...
SAM Analysis Reporting Introduction The members of IT SDC MI participate in WLCG Operations by investigating SAM test failures, attending WLCG Daily Operations Meetings...
There are four production instances of SAM/Nagios: CMS (sam cms prod/samnag ai 08) ATLAS (sam atlas prod/samnag ai 07) ALICE (sam alice prod/samnag...
Main questions we which might need to address during the discussion between SAM team, SUM developers and people who are in charge of VO specific Nagios tests are...
SAM Visualization for ATLAS, CMS, ALICE, LHCb Introduction This is the new Visualization interface for all the VOs. This provides the information about the Latest...
TWiki search by CERN Search Results You may also search with the internal TWiki WebSearch . Please note that TWiki internal WebSearch may be very slow for large...
MmNowotka 26 Sep 2011
Configuring Apache server configuration file providing SSL support 1) Get a host certificate If it is your personal machine: Go to http://ca.cern.ch,...
SetupBatchBackends If you download and install ganga locally and you want to use local batch systems at your site, you may need to tune the configuration of batch...
Shell Tips How to see the full command for a given process? env COLUMNS 200 ps o pid,command How to delete a specific line from a file? # delete the line 18 from...
Help page of the Site Status Board Information for the end user Basic concepts The Site Status Board is a monitoring tool that describes the status of Sites. The...
SIXT ON THE GRID The work area: /afs/cern.ch/sw/arda/install/sixt Each configuration is a set of parameters: ENG APP HALO BEAM (the names may NOT contain underscore...
There are six active instances of SSB: CMS (dashb ssb) ATLAS (dashb atlas ssb) ALICE (dashb alice ssb) LHCb (dashb lhcb ssb) SAM3 (wlcg mon...
SSB services The SSB is running on the following machines: Web services: CMS production: dashboard02 (aka dashb ssb) ATLAS production...
stomputil: MSG client library for job wrappers The stomputil package is used in job wrappers to publish monitoring information via LCG MSG brokers. It contains the...
First day in CERN registration getting a CERN access card going to IT secretariat making a bank account people helped me to get my computer connected, got...
SU3 QCD application Second round (Diane 2.0 April 2008) What`s up today?: LogFile08 Standing issues: ProblemsToBeSolved08 Preparation: meeting with...
Documentation official site user documentation http://agenda.infn.it/materialDisplay.py?contribId 342 sessionId 39 materialId slides confId 4441 3rd SuperB...
Support WLCG Transfer Dashboard Guide This page documents the support of the WLCG Transfers Dashboard. WLCG Transfer Dashboard Overview WLCG Transfer Dashboard...
setting up master ssh lxb1420 bash # create output area mkdir p /storage/lqcd/apps/output cd /storage/lqcd/apps/output mkdir p dat tmp bak # setup diane $(/afs/cern...
Task/Job monitoring Description of Dashboard API List of requirements Development server Task monitoring dashboard development server launched on http:/...
Homepage of hBrowseFramework General Information The hBrowseFramework (aka Tasks Monitoring Web UI) is a generic monitoring tool designed to meet the needs of various...
Test before deployment to the Grid This test uses the NSS 08 demo. This is a test for 64 bit installation. cd /afs/cern.ch/sw/arda/install/DIANE/Geant4/G4DemoNSS...
Ganga testing policy Please read with care and apply : ) By default every bug has a test case in the testing framework If you as an internal developer find a bug...
ThIS on the Grid Overview User forum presentation on THIS: put the link here Phone meeting of 19.03.2008 First phase Plan we assume that all input files...
Problems creating many hundreds of threads in a single program Per thread stack size can be limited setting at the session level to 1MB like this: bash: ulimit...
Ganga Monitoring and Threading JakubMoscicki 06 Jun 2006 Multithreaded Monitoring Subsystem in Ganga Whiteboard Drawings Monitoring Client/Server Architecture...
For internal discussion 1. Development installation of FTS Main idea to increase the turnaround time of 6 month from development to first usage of experiment...
TWeeder info for ArdaGrid Total Number of topics: 353 0 Topics updated during the last 7 days Days Web Topic Date 0 Topics updated during the...
User Guide The new user guide has to be done. For the time being, you can look the version (it is still valid). ElisaLanciotti 2009 09 01
Test cases The application has been tested in these different user scenarios Common assumptions between different scenarios All the test are done with and without...
Setting up the Host Environment Currently, only dashboard13 has been setup has a VM host. SLC5 has been installed there as well as version 3.2.6 of VirtualBox...
Virtual Machines Build System Presentation (20 07 2010) (Updated with Corrections) Comments Few comments from Akshat Regarding use of virtual box I think...
Here we try to summarize an outcome of meetings/discussions pieces of existing documentation, related to this subject : Whether experiments are happy with one single...
Setting up web analytics For the time being, we recommend using google web analytics. Once piwik.cern.ch becomes operational, we will move to that one. To configure...
TWiki`s ArdaGrid web The web for users, groups and offices. TWiki is an Enterprise Collaboration Platform.
Welcome to ArdaGrid Web More information about wiki, search , preferences , tools : see MoreWikiInformation More on ARDA project and purpose of this page: ArdaGrid...
See also the faster WebTopicList
Web Web Home Changes Index Search
This is a subscription service to be automatically notified by e mail when topics change in this ArdaGrid web. This is a convenient service, so you do not have to...
Capturing web pages screenshots from command line The solution is based on using http://phantomjs.org/. Build and setup instructions are available on the project`s...
ArdaGrid Web Preferences The following settings are web preferences of the ArdaGrid web. These preferences overwrite the site level preferences in .,...
/ArdaGrid The web for users, groups and offices. TWiki is an Enterprise Collaboration Platform.
Statistics for ArdaGrid Web Month: Topic views: Topic saves: File uploads: Most popular topic views: Top viewers: Top contributors...
See also the verbose WebIndex.
When starting a shift period Make sure you are subscribed to the project ganga savannah reports #64;cernNOSPAMPLEASE.ch mailing list. Go to http://simba.cern...
Gridification of Computation Chemistry WIEN2K Workflow Application discussion during EGEE Conference October 2007, Budapest present: Alex, Hurng Chun, Kuba WIEN2K...
Ganglia Active Ganglia monitors http://agm.cern.ch/ http://lgm.cern.ch/ http://agmegi.cern.ch/ http://hn ganglia monitor.cern.ch/ When experts...
Google Earth is running on dashb ai 568. If the server is unreachable, go to openstack.cern.ch Instances and restart the machine. Everything should run automatically...
What to do The list of services is described in https://twiki.cern.ch/twiki/bin/view/ArdaGrid/CheckList. Please send an SMS to the expert in case of SNOW ticket for...
xbrowse framework This page documents the xbrowse framework. Introduction xbrowse is small framework for developing large scale JavaScript applications. It includes...
Number of topics: 356

See also the faster WebTopicList

Edit | Attach | Watch | Print version | History: r2 < r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r2 - 2001-11-24 - unknown
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    ArdaGrid All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback