Backlinks to PanDA in PanDA Web

Results from PanDA web retrieved at 08:01 (GMT)

AutoPyFactory Documentation is now distributed within the code. It can be found in SVN, or after checking out, underneath directory docs/. Major updates :...
This page is currently being edited. Please check for updates soon. PanDA: Production and Distributed Analysis system Pilots are one of the main PanDA features. Pilots...
Big PanDA Instance for ORNL pilots Introduction This page is evolving. Please keep checking. This page contains information about BigPanDA instance for...
BigPanDA HTCondor API Introduction This page summarizes BigPanDA HTCondor API from User`s perspective. It describes monitoring interface, and the cli API....
Big PanDA Instance Installation Introduction This page is evolving. Please keep checking. This page contains information about BigPanDA instance installation...
BigPanDA Maintenance HowTos Introduction This page is evolving. Please keep checking. This page contains information related to BigPanDA instance maintenance...
Big PanDA devprodsys2 update Introduction This page describes how to update http://bigpanda.cern.ch/devprodsys2/ Feel free to contact JaroslavaSchovancova...
Big PanDA Monitoring Introduction This page is evolving. Please keep checking. Showroom: http://pandawms.org/bigpandamon/ BigPanDA Monitoring Requirements...
BigPanDA Monitoring Developers Introduction This page is evolving. Please keep checking. This page describes monitoring package for developers. Feel...
BigPanDA Monitoring Environment (Production) Introduction This page describes production environment for the BigPanDA monitoring http://pandawms.org/bigpandamon...
BigPanDAmonitoring Example Django project Overview BigPanDAmonitoring Example Django project is the base for creating of the VO/project specific monitoring,...
Big PanDA RPM Auto Smoke Test Introduction This page is evolving. Please keep checking. This page contains information about automatic smoke tests for...
Manual build of RPMs for Big PanDA Introduction This page is evolving. Please keep checking. This page contains information about manual build of RPMs...
Big PanDA RPM Build System Introduction This page is evolving. Please keep checking. This page contains information about BigPanDA RPM Build System. We...
FernandoHaraldBarreiroMegino 2015 02 25 Usage of EC2 CLI If you need a new machine for PanDA, get pre clearance from Sergey Panitkin and Torre Wenaus. They need...
Central Harvester Instances Technical documentation For a technical description of Harvester components please visit the github wiki Monitoring dashboard in...
To be able to submit jobs to PanDA server, the following steps should be performed by user: 1. Obtain and install Grid user certificate Go to https://gridca.cern.ch...
Configure ES PandaQueue Here is some instructions to configure Panda queue to run EventService on HPC. setup the queue on schedconfig objectstore: used to...
Distributed Analysis on Panda Introduction This page describes how to submit user analysis jobs from LCG/OSG/NG to the ATLAS production system, PanDA....
DetailEventServiceIntroduction EventService introduction An Event Service job is similar to a normal panda job. The difference is in the panda job payload...
Information for PanDA Pilot developers This wiki will explain how to get started with pilot development. How to fork the pilot GitHub repository and work on local...
Direct access and the Pilots Introduction This document describes how direct access is handled by the different pilot versions. Preliminaries This section describes...
Event Service Introduction The new production system Prodsys 2 includes a PanDA extension JEDI that adds to the PanDA server the capability to intelligently and dynamically...
!!PanDA Pilot 2 Introduction This document describes the ATLAS Event Service implementation in the PanDA Pilot 2. Event ranges When the pilot is ready to process...
Asynchronous prefetching of input data on the Event Service worker nodes Introduction In this document we describe two ways of implementing an asynchronous...
EventServiceMonitor Introduction In this twiki we collect some useful monitor pages. Bigpanda view view tasks tasks grafana tasks...
Event Service on HPC Defining a panda queue for the Event Service is similar to defining an MCORE queue. Here we will only specify differences. catchall...
EventServiceOperations EventService introduction An Event Service job is similar to a normal panda job. The difference is in the panda job payload. When...
Generic PanDA Pilot Introduction This document aims to guide the development of `experiment` specific plug ins for the PanDA Pilot. Examples of `experiment...
Glexec Motivation Worker nodes on the grid exhibit great diversity, making it difficult to offer uniform processing resources. A pilot job architecture, which...
GlideInWMS Introduction VO Frontend Installed on voatlas195. Random commands(to explain more later) $ voms proxy init cert /etc/grid security/hostcert...
HBaseForPanda General information Hadoop/Hbase namenode lxfssm4401 Our development node voatlas132 . Accessible from lxvoadm, has outbound connectivity...
HpcYoda Yoda is the Event Service implemention on HPC. Overall architecture is shown below. Yoda is composed of several parts: pilotRunJobHpcEvent the frontend...
Intelligent Networking Introduction This page is evolving. Please keep checking. This page contains information about how PanDA interacts with network infrastructure...
Information sent to PanDA server The list of all dictionary fields sent to the PanDA server during job updates. Job request Values are set in pilot function pilot...
MiniPilotHPC Introduction The regular pilot can not run on compute nodes of some HPC centers. Using the mini pilot code base from PanDA pilot v2 project,...
Monitor Introduction The Monitor module is responsible for monitoring the payload, transfers, memory usage, disk space, etc. It launches the payload execution...
Currently RDBMS (Oracle or MySQL) is used as the storage backend. To provide better performance and scalability the data stored in relational storage is partitioned...
Installing pilot factory Preparation APF needs batch system to run pilots. Usually it`s HTCondor, it can be installed from condor repository: # yum config manager...
How to submit Athena jobs to Panda Introduction This page describes how to submit user Athena jobs from LCG/OSG/NG to the ATLAS production system, PanDA....
Auxiliary Resource Monitoring and Data Aggregation Services Introduction Panda services running at BNL (or any other location if desired) are using...
Bookkeeping for Panda analysis jobs Introduction pbook is the bookkeeping application for all Panda analysis jobs. Getting Started Installation and...
Brokerage Services for Panda This document describes the status and progress of the brokering interface for Panda. Moved to new page. Major updates : TorreWenaus...
PanDA child topics from Atlas
PandaClient The Panda client module provides a simple, lightweight python interface for submitting jobs to Panda, query job status and controlling jobs in the...
PanDA Client PanDA Client is a tool which allows user to submit jobs to PanDA server. Installation PanDA Client can be obtained from github it`s a part of server...
PandaCVS Introduction This is the CVS info page for the Panda project. Note: The Panda CVS Repository has been moved from BNL to CERN, so please DO NOT use...
Data Service for PanDA Functions of the central Panda data service (part of the PandaServer) Request/select group of jobs from the PandaTaskBuffer. Request...
PandaDB This section describes the organization and schema of ORACLE database of Panda. Contact Gancho Dimitrov at CERN for access information. PandaDB (ORACLE...
PandaDBMySQL This section describes the schema of the local MySQL database of Panda. Contact Yuri Smirnov at BNL for access information. Schema version 4 (created...
PandaDevService Introduction This section describes the panda server, database and jobscheduler instances used for the PanDA development service. Panda server...
PanDA share distribution and monitoring WORK IN PROGRESS What is the idea behind? Currently PanDA job assignment is done according to priorities: higher priority...
PandaDynamicDataPlacement Introduction This page describes PanDA Dynamic Data Placement (PD2P). General Policies The following general policies apply to PD2P...
PandaErrorCodes Introduction This page describes the error codes and diagnostics of the Panda jobs. transExitCode transExitCode diagnostics 1 Athena...
Executor Interface for Panda This document describes the status and progress of the executor supervisor interface for Panda. Functions Receive jobs from ATLAS...
PandaFacilitiesAtCern Introduction This twiki page describes the PanDA infrastructure at CERN. Machines Please see DistributedComputingMachines#Panda....
How to Find Panda Job`s Log Files Introduction This page describes how to find Panda job`s log files. Note: this is all much simpler now. You can browse to the...
PandaGerrit Gerrit is a web based code review system, facilitating online code reviews for projects using the Git version control system. PandaGerrit is using gerrit...
Panda Installation Guide Introduction Panda is available in 4 different independent formats (packages): PandaSrv the panda server including PandaTaskBuffer...
JEDI (Job Execution and Definition Interface) Introduction JEDI is an intelligent component in the panda server to have capability for task level workload...
JEDI based Analysis Introduction JEDI is an intelligent component in the PanDA system to have capability for task level workload management. This page...
Job Dispatcher for Panda This document describes the status and progress of the job dispatcher for Panda. Functions Respond to PandaPilotJobs Ask PandaTaskBuffer...
Job Scheduler for Panda Introduction The PandaJobScheduler is a component of PanDA, the OSG executor that is being developed to replace CaponE in the ATLAS production...
PandaJobSchedulerV000101 Introduction The PandaJobScheduler is a component of PanDA, the OSG executor that is being developed to replace CaponE in the ATLAS...
PandaJobSchedulerV000202 Introduction The PandaJobScheduler is a component of PanDA, the OSG executor that is being developed to replace CaponE in the ATLAS...
PandaJobSchedulerV000301 Introduction The PandaJobScheduler is a component of PanDA, the OSG executor that is being developed to replace CaponE in the ATLAS...
PandaLogger The Panda logger provides client and server components for a logging system by which Panda services can register incidents for central logging, users...
PandaMonitor The Panda monitor provides a web browser interface to the Panda system: dashboard overviews of its operation; jobs and tasks; error summaries...
PanDA monitor installation In this topic we`ll discuss the process of installing and configuring the PanDA monitor to use with MySQL database. Up to date monitor on...
Panda Production and Distributed Analysis More Details Introduction We anticipate building a generic infrastructure for execution of many types of jobs and workflows...
Panda Integration Testing Introduction This document describes how to run Eowyn with Panda to transfer CERN DB jobs to PandaDB and how to run jobscheduler to execute...
Panda Integration Testing Introduction This document describes tests on how to run Eowyn with Panda to transfer CERN DB jobs to PandaDB and how to run jobscheduler...
PandaOnTier3 Introduction This page outlines the steps necessary to make a Computing Element (CE, a cluster, e.g. a Tier3 site) available for PanDA production...
PandaOperationalSecurity Introduction This page describes some operational security procedures for PanDA. This documentation is mainly concerned with investigating...
PanDA Packaging Corner Mandate The purpose of the Packaging working group, is to simplify the adoption of PanDA for other experiments. Our mandate defines 4 main...
Panda Pilot Introduction The PanDA pilot is an execution environment used to prepare the computing element, request the actual payload (a production or user analysis...
PandaPilotFAX Introduction The PanDA Pilot is equipped with several retry mechanisms. In the case stage in fails due to a temporary SE related problem, the...
Job Recovery Introduction The task of the Panda pilot job recovery is to scan the disk for old `lost` job directories and log files. When it finds a lost job...
Job State Introduction The purpose of the job state algorithm is to provide a job recovery mechanism for the Panda pilot. Whenever the pilot updates the Panda...
Panda Pilot Multitasking Introduction Pilot multitasking refers to the pilot ability to run a production job at the same time as consecutive user analysis jobs...
The PanDA Monitor Web Platform Introduction The Panda Web Platform was developed to back the Panda Monitor Web server that is more maintainable, supports...
Quick Start Up Guide for PanDA Web Platform Application Developer Introduction The new Panda Web Platform was developed to back the Panda Monitor Web server...
PandaProductionService Introduction This section describes the panda server, database and jobscheduler instances used for the PanDA production service. Panda...
Changing Site Parameters in the PanDA Central Database (for OSG) THIS PAGE IS NO LONGER CURRENT! Please don`t use this procedure. Changes are requested from Alden...
This section describes the PanDA server database configuration. (See SchedconfigParameterDefinitions for additional info.) Cloudconfig and schedconfig are the most...
PandaRel000001 Introduction This is the first CVS tagged release of Panda Release information Panda release 0.0.1, Release date November 17, 2005 The CVS tag...
Motivation The number of attempts defined for a task is not suitable for all types of errors and ADC would like to have a way of treating some particular error codes...
PandaReviewMar06 Panda Review March 8 9, 2006 US ATLAS internal review of Panda and Panda based distributed analysis. Charge: Evaluate the progress of the...
How to submit ROOT/general jobs to Panda Introduction prun is a Panda client software which allows users to submit general jobs to Panda. Those jobs may...
PandaSchedConfig Introduction The schedconfig table is filled with information from a variety of sources. It is filled by autopilot/pilotController.py which...
!PanDA Security Overview Panda services that interact with other Panda components and with external clients use the standard GSI grid security model of authentication...
Panda Integration Testing Introduction This document describes testing and QA activities in support of Panda development. Installation Download and untar/ungzip...
How to perform sequential jobs/operations in PanDA based analysis Introduction psequencer is an email driven application which executes a group of processes...
PandaServer The Panda server is the central hub service where Panda core operations take place. Overall architecture is shown below. The Panda server is composed of...
Creating the MySQL database for PanDA server This section will focus on a MySQL DB creation. Creating the Oracle DB is out of the scope of this exercise and we would...
Installing PanDA server Keep in mind: this instruction is still work in progress. Preparation Two modules are needed to install the server: panda server and panda...
PanDA server migration from Oracle to MySQL DB backend Introduction This page is evolving. Please keep checking. This page contains information about BigPanDA...
PanDA server testing guide (see also https://twiki.cern.ch/twiki/bin/view/PanDA/TestingBigPanDAinstance, but ultimately the information should be merged) Global healthcheck...
PandaShiftGuide Introduction This page describes the instructions for Panda shifters. Please also refer to ADCoS wiki page. Send an e mail to Panda shift team...
Task Buffer for PANDA This document describes the status and progress of the Task Buffer for Panda. Functions Store jobs supplied by the PandaClient interface...
Panda Testing This document describes testing and QA activities in support of Panda development. Panda development server A development instance of the Panda server...
PandaTestJob Introduction This page describes how to test Panda jobs. Production managers or ADCoS shifters should if possible use the test interface available...
PandaTier3 Introduction This page describes the Panda configuration and setup for ATLAS Tier3 sites of the `T3g` type sites that are not full grid sites...
Client tools for Panda analysis jobs Current version of panda client : 1.4.17 (3/12/2020) Introduction The panda client package contains...
PanDA Virtual Organization (VO) Scope Small users like university groups can use a catch all instance of PanDA, if they want to evaluate the PanDA system...
PanDjango About Pandjango is an evolved version of PandaMonitor, built with the Django Web Framework and other tools to create an interactive and AJAX capable...
PanDA Pilot 2 Introduction This document describes the PanDA Pilot 2 which is currently in the late development stage. Developers Current Developers Paul Nilsson...
Activity Reports 2016 Alexey Anisenkov November Site movers evolution and updates: general clean up and stage in/stage out workflow optimization...
Activity Reports 2016 Danila Oleynik Activity in 2016 Support of stable ATLAS production in OLCF Improvements of OLCF specific components, which allow...
Activity Reports 2016 Paul Nilsson December PanDA Pilot Development of pilot versions 67.2 67.3, presented at Weekly, Dec 6. Development of pilot version...
Activity Reports 2016 Pavlo Svirin October Identified ALICE workflow specifics and requirements to be introduced into PanDA Pilot workflow created a draft...
Activity Reports 2016 Wen Guan November PanDA Pilot Fixing and updating pilot to commission Event Service. A lot of small updates had been applied to fix...
Activity Reports 2017 Danila Oleynik January Support of ATLAS production in OLCF Debug and workaround for RFC legacy proxy for authorization at BNL...
Activity Reports 2017 Mario Lassnig February pilot2/development/components: continued development across all controllers pilot2/development/harvester...
Activity Reports 2017 Paul Nilsson December TODO: Create new wiki for AGIS/schedconfig usage in Pilot 2 (more detailed than before). To be merged with schedconfig...
Activity Reports 2017 Wen Guan .. February PanDA Pilot Working on pilot to combine(tar) events in a tar file. analysis rucio tracer information to build...
Activity Reports 2018 Paul Nilsson October Main activities (Pilot 1) Released minor versions 73.4 and 73.5 Import updates: Objectstore stage in verification...
PanDA Pilot 2 Error Codes Introduction The following list is the current range of implemented error codes, their (internally used) acronyms and meanings. Note: the...
Pilot 2.0 Project Guidelines Introduction This document outlines the guidelines for the Pilot 2.0 project, to be followed by all contributors. Guidelines How will...
Meetings and Conferences Links to meetings and conferences with Pilot related presentations. Pilot Development Meetings Pilot Development (T, Javurek, P. Nilsson...
Pilot2Test Define a test ES task an ES task in Prodsys2 Run Pilot2 interactively #!/bin/bash site $1 queue $2 # setup rucio export ATLAS LOCAL ROOT...
Pilot 2.0 Task and Wish List This is a collection of special requests, wishes, suggestions, recommendations, etc. for the Pilot 2.0 Project. Task and wish list for...
PilotMain Introduction The main PanDA pilot module is called pilot.py and is the code that is launched directly by the wrapper. The pilot module downloads...
The pilot sends detailed information about file transfers to Rucio. Here is a list of the different fields contained in the trace report. Field name Explanation...
Pilot Testing This document describes how the PanDA Pilot is being tested before a release. Main Pilot 2 GitHub repository The main Pilot 2 GitHub repository can...
RunJob Introduction For a standard grid job, the pilot`s Monitor module forks a subprocess and monitors it for the duration of the job. The subprocess, RunJob...
Introduction The RunJobEvent module implements the Atlas Event Service (AES) workflow in the pilot. Description This module is responsible for: 1) Download event...
RunPilot Pilot is started by APF wrapper(https://www.racf.bnl.gov/experiments/usatlas/griddev/AutoPyFactory). You can get a copy of the wrapper. Here is an example...
SchedConfigNewController newController Basics and Use Basic Principles The newController code brings populates the schedconfig table with site configuration...
SchedconfigParameterDefinitions Introduction WARNING: THIS VERSION IS OUTDATED. PLEASE VISIT THE VERSION INSTEAD General information: A circumflex (^) signifies...
Pilot 2 usages of AGIS/schedconfig queuedata fields Documentation This is the documentation of all schedconfig fields used by Pilot 2. Developers are required to...
Site Movers Introduction This document will describe the site movers used by the PanDA Pilot (Pilot 1.0 and 2.0). General concept and workflow description: 1. The...
Testing BigPanDA Instance Introduction This page is evolving. Please keep checking. This page contains information about tests one can perform to smoke...
To Test The Site To test it, please send an email to atlas comp event service #64;cernSPAMNOTNOSPAMPLEASE.ch, asking for creating a test ES task to your site. Currently...
TWeeder info for PanDA Total Number of topics: 154 1 Topics updated during the last 7 days Days Web Topic Date S7 PanDA Pilot2ActivityReports2017PaulNils...
This page is obsolete.
Welcome to the 1 web Available Information PanDA Edit works now... PanDA Web Utilities advanced search WebTopicList all topics in...
PanDA Web Preferences The following settings are web preferences of the PanDA web. These preferences overwrite the site level preferences in . and...
Statistics for PanDA Web Month: Topic views: Topic saves: File uploads: Most popular topic views: Top viewers: Top contributors...
Number of topics: 139

 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    PanDA All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback