100 Recent Changes in PanDA Web retrieved at 20:14 (GMT)

Statistics for PanDA Web Month: Topic views: Topic saves: File uploads: Most popular topic views: Top viewers: Top contributors...
WARNING: THIS VERSION IS OUTDATED. PLEASE VISIT THE VERSION INSTEAD Major updates : AldenStradling 30 Nov 2010 Never reviewed
Pilot 2 usages of AGIS/schedconfig queuedata fields WARNING: THIS PAGE WAS MERGED TO PAGE PaulNilsson 2018 02 16
The PanDA Production and Distributed Analysis System Introduction The PanDA Production ANd Distributed Analysis system has been developed by ATLAS since summer...
Client tools for Panda analysis jobs Current version of panda client : 1.4.36 (9/7/2020) Introduction The panda client package contains...
Central Harvester Instances Technical documentation For a technical description of Harvester components please visit the github wiki Monitoring dashboard in...
PanDA Pilot 2 Error Codes Introduction The following list is the current range of implemented error codes, their (internally used) acronyms and meanings. Note: the...
PanDA Pilot 2 Introduction This document describes the PanDA Pilot 2 which is currently in the late development stage. Developers Current Developers Paul Nilsson...
Hyperparameter Optimization with PanDA and iDDS Introduction PanDA and iDDS allow users to run large scale hyperparameter optimization (HPO) on...
How to submit ROOT/general jobs to Panda Introduction prun is a Panda client software which allows users to submit general jobs to Panda. Those jobs may...
Event Service in PanDA Pilot 2 Introduction This document describes the ATLAS Event Service implementation in the PanDA Pilot 2. Function calls until ESProcess starts...
JEDI (Job Execution and Definition Interface) Introduction JEDI is an intelligent component in the panda server to have capability for task level workload...
Bookkeeping for Panda analysis jobs Introduction pbook is the bookkeeping application for all Panda analysis jobs. Getting Started Installation and...
Information for PanDA Pilot developers This wiki will explain how to get started with pilot development. How to fork the pilot GitHub repository and work on local...
Information sent to PanDA server The list of all dictionary fields sent to the PanDA server during job updates. Job request Values are set in pilot function pilot...
Meetings and Conferences Links to meetings and conferences with Pilot related presentations. Pilot Development Meetings Pilot Development (T, Javurek, P. Nilsson...
DetailEventServiceIntroduction EventService introduction An Event Service job is similar to a normal panda job. The difference is in the panda job payload...
Pilot Testing This document describes how the PanDA Pilot is being tested before a release. Main Pilot 2 GitHub repository The main Pilot 2 GitHub repository can...
Pilot2Test Define a test ES task an ES task in Prodsys2 Run Pilot2 interactively #!/bin/bash site $1 queue $2 # setup rucio export ATLAS LOCAL ROOT...
EventServiceDeletion EventService Deletion Currently EventService deletion is handled in two workflow: 1) Rucio deletion 2) OS LifeCycle deleteion...
EventServiceOperations EventService introduction An Event Service job is similar to a normal panda job. The difference is in the panda job payload. When...
To Test The Site To test it, please send an email to atlas comp event service #64;cernSPAMNOTNOSPAMPLEASE.ch, asking for creating a test ES task to your site. Currently...
Event Service on Amazon (old) This is a powerful queue. It`s using the Amazon computing resources. The storage system it uses is Amazon S3 object store. All files...
Event Service on HPC Defining a panda queue for the Event Service is similar to defining an MCORE queue. Here we will only specify differences. catchall...
Job Report for production jobs Required job report fields The payload / transform in a production job is expected to create a job report (json dictionary) containing...
How to submit Athena jobs to Panda Introduction This page describes how to submit user Athena jobs from LCG/OSG/NG to the ATLAS production system, PanDA....
Direct access and the Pilots Introduction This document describes how direct access is handled by the different pilot versions. Preliminaries This section describes...
Activity Reports 2018 Paul Nilsson October Main activities (Pilot 1) Released minor versions 73.4 and 73.5 Import updates: Objectstore stage in verification...
PandaShiftGuide Introduction This page describes the instructions for Panda shifters. Please also refer to ADCoS wiki page. Send an e mail to Panda shift team...
RunPilot Pilot is started by APF wrapper(https://www.racf.bnl.gov/experiments/usatlas/griddev/AutoPyFactory). You can get a copy of the wrapper. Here is an example...
Milestones Introduction The milestone plan is the plan for the project progress and contains checkpoints to be achieved. Detailed Milestones Note: Milestone N will...
Panda Pilot Introduction The PanDA pilot is an execution environment used to prepare the computing element, request the actual payload (a production or user analysis...
The pilot sends detailed information about file transfers to Rucio. Here is a list of the different fields contained in the trace report. Field name Explanation...
Pilot 2.0 Task and Wish List This is a collection of special requests, wishes, suggestions, recommendations, etc. for the Pilot 2.0 Project. Task and wish list for...
Activity Reports 2017 Paul Nilsson December TODO: Create new wiki for AGIS/schedconfig usage in Pilot 2 (more detailed than before). To be merged with schedconfig...
Activity Reports 2018 This is a collection of Activity Reports for the Pilot 2.0 Developers. Developer instructions: please report your activities for the last month...
Activity Reports Personal Activity Reports The personal activity reports were collected from the pilot developers starting from end of September 2016....
EventServiceMonitor Introduction In this twiki we collect some useful monitor pages. Bigpanda view view tasks tasks grafana tasks...
MiniPilotHPC Introduction The regular pilot can not run on compute nodes of some HPC centers. Using the mini pilot code base from PanDA pilot v2 project,...
Event Service Introduction The new production system Prodsys 2 includes a PanDA extension JEDI that adds to the PanDA server the capability to intelligently and dynamically...
Introduction The miniPilot will be used primarily during the implementation and testing stage of the Pilot 2.0 Project, by the pilot developers to test new functionality...
PandaMonitor The Panda monitor provides a web browser interface to the Panda system: dashboard overviews of its operation; jobs and tasks; error summaries...
Activity Reports 2017 Daniel Drizhuk March Fixed PEP8 naming Introduced Async, signals and stuff ...
Asynchronous prefetching of input data on the Event Service worker nodes Introduction In this document we describe two ways of implementing an asynchronous...
Activity Reports 2017 Wen Guan .. February PanDA Pilot Working on pilot to combine(tar) events in a tar file. analysis rucio tracer information to build...
Activity Reports 2017 Mario Lassnig February pilot2/development/components: continued development across all controllers pilot2/development/harvester...
Activity Reports 2017 Alexey Anisenkov January Sitemovers upgrade and evolution: update direct access workflow to support all movers update...
Activity Reports 2017 Pavlo Svirin January concentrated on building a generic ALICE workflow which can be compatible with Pilot2 experimented with Pilot...
Activity Reports 2017 Danila Oleynik January Support of ATLAS production in OLCF Debug and workaround for RFC legacy proxy for authorization at BNL...
Activity Reports 2016 Paul Nilsson December PanDA Pilot Development of pilot versions 67.2 67.3, presented at Weekly, Dec 6. Development of pilot version...
Activity Reports 2017 This is a collection of Activity Reports for the Pilot 2.0 Developers. Developer instructions: please report your activities for the last month...
Activity Reports 2016 Danila Oleynik Activity in 2016 Support of stable ATLAS production in OLCF Improvements of OLCF specific components, which allow...
Activity Reports 2016 Pavlo Svirin October Identified ALICE workflow specifics and requirements to be introduced into PanDA Pilot workflow created a draft...
Activity Reports 2016 Alexey Anisenkov November Site movers evolution and updates: general clean up and stage in/stage out workflow optimization...
Activity Reports 2016 Wen Guan November PanDA Pilot Fixing and updating pilot to commission Event Service. A lot of small updates had been applied to fix...
Activity Reports 2016 Mario Lassnig TODO ... : ... pilot2: update to pilot2 code based on harvester requests (TBC) December ... November pilot...
Introduction The RunJobEvent module implements the Atlas Event Service (AES) workflow in the pilot. Description This module is responsible for: 1) Download event...
Activity Reports 2016 Daniel Drizhuk September (including all Pilot activities during 2016) Developed miniPilot Took part in testing system development...
Brokerage Services for Panda This document describes the status and progress of the brokering interface for Panda. Moved to new page. Major updates : TorreWenaus...
Pilot 2.0 Project Guidelines Introduction This document outlines the guidelines for the Pilot 2.0 project, to be followed by all contributors. Guidelines How will...
Activity Reports 2016 This is a collection of Activity Reports for the Pilot 2.0 Developers. Developer instructions: please report your activities for the last month...
Distributed Analysis on Panda Introduction This page describes how to submit user analysis jobs from LCG/OSG/NG to the ATLAS production system, PanDA....
Site Movers Introduction This document will describe the site movers used by the PanDA Pilot (Pilot 1.0 and 2.0). General concept and workflow description: 1. The...
RunJob Introduction For a standard grid job, the pilot`s Monitor module forks a subprocess and monitors it for the duration of the job. The subprocess, RunJob...
PilotMain Introduction The main PanDA pilot module is called pilot.py and is the code that is launched directly by the wrapper. The pilot module downloads...
Monitor Introduction The Monitor module is responsible for monitoring the payload, transfers, memory usage, disk space, etc. It launches the payload execution...
HpcYoda Yoda is the Event Service implemention on HPC. Overall architecture is shown below. Yoda is composed of several parts: pilotRunJobHpcEvent the frontend...
DefineObjectStore Define OS service In the atlas agis home page(https://atlas agis.cern.ch/agis/), click `Define OS service`. Follow the form to create...
PandaErrorCodes Introduction This page describes the error codes and diagnostics of the Panda jobs. transExitCode transExitCode diagnostics 1 Athena...
How to perform sequential jobs/operations in PanDA based analysis Introduction psequencer is an email driven application which executes a group of processes...
PanDA Web Preferences The following settings are web preferences of the PanDA web. These preferences overwrite the site level preferences in . and...
PandaClient The Panda client module provides a simple, lightweight python interface for submitting jobs to Panda, query job status and controlling jobs in the...
This page is obsolete.
PandaOperationalSecurity Introduction This page describes some operational security procedures for PanDA. This documentation is mainly concerned with investigating...
Installing PanDA server Keep in mind: this instruction is still work in progress. Preparation Two modules are needed to install the server: panda server and panda...
Motivation The number of attempts defined for a task is not suitable for all types of errors and ADC would like to have a way of treating some particular error codes...
This section describes the PanDA server database configuration. (See SchedconfigParameterDefinitions for additional info.) Cloudconfig and schedconfig are the most...
To be able to submit jobs to PanDA server, the following steps should be performed by user: 1. Obtain and install Grid user certificate Go to https://gridca.cern.ch...
Creating the MySQL database for PanDA server This section will focus on a MySQL DB creation. Creating the Oracle DB is out of the scope of this exercise and we would...
PanDA Packaging Corner Mandate The purpose of the Packaging working group, is to simplify the adoption of PanDA for other experiments. Our mandate defines 4 main...
This page is currently being edited. Please check for updates soon. PanDA: Production and Distributed Analysis system Pilots are one of the main PanDA features. Pilots...
PanDA monitor installation In this topic we`ll discuss the process of installing and configuring the PanDA monitor to use with MySQL database. Up to date monitor on...
PanDA Client PanDA Client is a tool which allows user to submit jobs to PanDA server. Installation PanDA Client can be obtained from github it`s a part of server...
PanDA server testing guide (see also https://twiki.cern.ch/twiki/bin/view/PanDA/TestingBigPanDAinstance, but ultimately the information should be merged) Global healthcheck...
PandaGerrit Gerrit is a web based code review system, facilitating online code reviews for projects using the Git version control system. PandaGerrit is using gerrit...
PanDA share distribution and monitoring WORK IN PROGRESS What is the idea behind? Currently PanDA job assignment is done according to priorities: higher priority...
FernandoHaraldBarreiroMegino 2015 02 25 Usage of EC2 CLI If you need a new machine for PanDA, get pre clearance from Sergey Panitkin and Torre Wenaus. They need...
Big PanDA Instance Installation Introduction This page is evolving. Please keep checking. This page contains information about BigPanDA instance installation...
Configure ES PandaQueue Here is some instructions to configure Panda queue to run EventService on HPC. setup the queue on schedconfig objectstore: used to...
SchedConfigNewController newController Basics and Use Basic Principles The newController code brings populates the schedconfig table with site configuration...
Installing pilot factory Preparation APF needs batch system to run pilots. Usually it`s HTCondor, it can be installed from condor repository: # yum config manager...
PandaTier3 Introduction This page describes the Panda configuration and setup for ATLAS Tier3 sites of the `T3g` type sites that are not full grid sites...
Currently RDBMS (Oracle or MySQL) is used as the storage backend. To provide better performance and scalability the data stored in relational storage is partitioned...
Intelligent Networking Introduction This page is evolving. Please keep checking. This page contains information about how PanDA interacts with network infrastructure...
Testing BigPanDA Instance Introduction This page is evolving. Please keep checking. This page contains information about tests one can perform to smoke...
BigPanDA Maintenance HowTos Introduction This page is evolving. Please keep checking. This page contains information related to BigPanDA instance maintenance...
Generic PanDA Pilot Introduction This document aims to guide the development of `experiment` specific plug ins for the PanDA Pilot. Examples of `experiment...
PanDA server migration from Oracle to MySQL DB backend Introduction This page is evolving. Please keep checking. This page contains information about BigPanDA...
PandaServer The Panda server is the central hub service where Panda core operations take place. Overall architecture is shown below. The Panda server is composed of...
Number of topics: 100

Show recent changes with 50, 100, 200, 500, 1000 topics, all changes

Related topics: RSS feed, rounded corners RSS feed, ATOM feed, WebNotify, site changes, site map

Edit | Attach | Watch | Print version | History: r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r1 - 2006-11-15 - TWikiContributor
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    PanDA All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback