200 Recent Changes in PanDA Web retrieved at 00:32 (GMT)

Statistics for PanDA Web Month: Topic views: Topic saves: File uploads: Most popular topic views: Top viewers: Top contributors...
WARNING: THIS VERSION IS OUTDATED. PLEASE VISIT THE VERSION INSTEAD Major updates : AldenStradling 30 Nov 2010 Never reviewed
Pilot 2 usages of AGIS/schedconfig queuedata fields WARNING: THIS PAGE WAS MERGED TO PAGE PaulNilsson 2018 02 16
The PanDA Production and Distributed Analysis System Introduction The PanDA Production ANd Distributed Analysis system has been developed by ATLAS since summer...
Client tools for Panda analysis jobs Current version of panda client : 1.4.36 (9/7/2020) Introduction The panda client package contains...
Central Harvester Instances Technical documentation For a technical description of Harvester components please visit the github wiki Monitoring dashboard in...
PanDA Pilot 2 Error Codes Introduction The following list is the current range of implemented error codes, their (internally used) acronyms and meanings. Note: the...
PanDA Pilot 2 Introduction This document describes the PanDA Pilot 2 which is currently in the late development stage. Developers Current Developers Paul Nilsson...
Hyperparameter Optimization with PanDA and iDDS Introduction PanDA and iDDS allow users to run large scale hyperparameter optimization (HPO) on...
How to submit ROOT/general jobs to Panda Introduction prun is a Panda client software which allows users to submit general jobs to Panda. Those jobs may...
Event Service in PanDA Pilot 2 Introduction This document describes the ATLAS Event Service implementation in the PanDA Pilot 2. Function calls until ESProcess starts...
JEDI (Job Execution and Definition Interface) Introduction JEDI is an intelligent component in the panda server to have capability for task level workload...
Bookkeeping for Panda analysis jobs Introduction pbook is the bookkeeping application for all Panda analysis jobs. Getting Started Installation and...
Information for PanDA Pilot developers This wiki will explain how to get started with pilot development. How to fork the pilot GitHub repository and work on local...
Information sent to PanDA server The list of all dictionary fields sent to the PanDA server during job updates. Job request Values are set in pilot function pilot...
Meetings and Conferences Links to meetings and conferences with Pilot related presentations. Pilot Development Meetings Pilot Development (T, Javurek, P. Nilsson...
DetailEventServiceIntroduction EventService introduction An Event Service job is similar to a normal panda job. The difference is in the panda job payload...
Pilot Testing This document describes how the PanDA Pilot is being tested before a release. Main Pilot 2 GitHub repository The main Pilot 2 GitHub repository can...
Pilot2Test Define a test ES task an ES task in Prodsys2 Run Pilot2 interactively #!/bin/bash site $1 queue $2 # setup rucio export ATLAS LOCAL ROOT...
EventServiceDeletion EventService Deletion Currently EventService deletion is handled in two workflow: 1) Rucio deletion 2) OS LifeCycle deleteion...
EventServiceOperations EventService introduction An Event Service job is similar to a normal panda job. The difference is in the panda job payload. When...
To Test The Site To test it, please send an email to atlas comp event service #64;cernSPAMNOTNOSPAMPLEASE.ch, asking for creating a test ES task to your site. Currently...
Event Service on Amazon (old) This is a powerful queue. It`s using the Amazon computing resources. The storage system it uses is Amazon S3 object store. All files...
Event Service on HPC Defining a panda queue for the Event Service is similar to defining an MCORE queue. Here we will only specify differences. catchall...
Job Report for production jobs Required job report fields The payload / transform in a production job is expected to create a job report (json dictionary) containing...
How to submit Athena jobs to Panda Introduction This page describes how to submit user Athena jobs from LCG/OSG/NG to the ATLAS production system, PanDA....
Direct access and the Pilots Introduction This document describes how direct access is handled by the different pilot versions. Preliminaries This section describes...
Activity Reports 2018 Paul Nilsson October Main activities (Pilot 1) Released minor versions 73.4 and 73.5 Import updates: Objectstore stage in verification...
PandaShiftGuide Introduction This page describes the instructions for Panda shifters. Please also refer to ADCoS wiki page. Send an e mail to Panda shift team...
RunPilot Pilot is started by APF wrapper(https://www.racf.bnl.gov/experiments/usatlas/griddev/AutoPyFactory). You can get a copy of the wrapper. Here is an example...
Milestones Introduction The milestone plan is the plan for the project progress and contains checkpoints to be achieved. Detailed Milestones Note: Milestone N will...
Panda Pilot Introduction The PanDA pilot is an execution environment used to prepare the computing element, request the actual payload (a production or user analysis...
The pilot sends detailed information about file transfers to Rucio. Here is a list of the different fields contained in the trace report. Field name Explanation...
Pilot 2.0 Task and Wish List This is a collection of special requests, wishes, suggestions, recommendations, etc. for the Pilot 2.0 Project. Task and wish list for...
Activity Reports 2017 Paul Nilsson December TODO: Create new wiki for AGIS/schedconfig usage in Pilot 2 (more detailed than before). To be merged with schedconfig...
Activity Reports 2018 This is a collection of Activity Reports for the Pilot 2.0 Developers. Developer instructions: please report your activities for the last month...
Activity Reports Personal Activity Reports The personal activity reports were collected from the pilot developers starting from end of September 2016....
EventServiceMonitor Introduction In this twiki we collect some useful monitor pages. Bigpanda view view tasks tasks grafana tasks...
MiniPilotHPC Introduction The regular pilot can not run on compute nodes of some HPC centers. Using the mini pilot code base from PanDA pilot v2 project,...
Event Service Introduction The new production system Prodsys 2 includes a PanDA extension JEDI that adds to the PanDA server the capability to intelligently and dynamically...
Introduction The miniPilot will be used primarily during the implementation and testing stage of the Pilot 2.0 Project, by the pilot developers to test new functionality...
PandaMonitor The Panda monitor provides a web browser interface to the Panda system: dashboard overviews of its operation; jobs and tasks; error summaries...
Activity Reports 2017 Daniel Drizhuk March Fixed PEP8 naming Introduced Async, signals and stuff ...
Asynchronous prefetching of input data on the Event Service worker nodes Introduction In this document we describe two ways of implementing an asynchronous...
Activity Reports 2017 Wen Guan .. February PanDA Pilot Working on pilot to combine(tar) events in a tar file. analysis rucio tracer information to build...
Activity Reports 2017 Mario Lassnig February pilot2/development/components: continued development across all controllers pilot2/development/harvester...
Activity Reports 2017 Alexey Anisenkov January Sitemovers upgrade and evolution: update direct access workflow to support all movers update...
Activity Reports 2017 Pavlo Svirin January concentrated on building a generic ALICE workflow which can be compatible with Pilot2 experimented with Pilot...
Activity Reports 2017 Danila Oleynik January Support of ATLAS production in OLCF Debug and workaround for RFC legacy proxy for authorization at BNL...
Activity Reports 2016 Paul Nilsson December PanDA Pilot Development of pilot versions 67.2 67.3, presented at Weekly, Dec 6. Development of pilot version...
Activity Reports 2017 This is a collection of Activity Reports for the Pilot 2.0 Developers. Developer instructions: please report your activities for the last month...
Activity Reports 2016 Danila Oleynik Activity in 2016 Support of stable ATLAS production in OLCF Improvements of OLCF specific components, which allow...
Activity Reports 2016 Pavlo Svirin October Identified ALICE workflow specifics and requirements to be introduced into PanDA Pilot workflow created a draft...
Activity Reports 2016 Alexey Anisenkov November Site movers evolution and updates: general clean up and stage in/stage out workflow optimization...
Activity Reports 2016 Wen Guan November PanDA Pilot Fixing and updating pilot to commission Event Service. A lot of small updates had been applied to fix...
Activity Reports 2016 Mario Lassnig TODO ... : ... pilot2: update to pilot2 code based on harvester requests (TBC) December ... November pilot...
Introduction The RunJobEvent module implements the Atlas Event Service (AES) workflow in the pilot. Description This module is responsible for: 1) Download event...
Activity Reports 2016 Daniel Drizhuk September (including all Pilot activities during 2016) Developed miniPilot Took part in testing system development...
Brokerage Services for Panda This document describes the status and progress of the brokering interface for Panda. Moved to new page. Major updates : TorreWenaus...
Pilot 2.0 Project Guidelines Introduction This document outlines the guidelines for the Pilot 2.0 project, to be followed by all contributors. Guidelines How will...
Activity Reports 2016 This is a collection of Activity Reports for the Pilot 2.0 Developers. Developer instructions: please report your activities for the last month...
Distributed Analysis on Panda Introduction This page describes how to submit user analysis jobs from LCG/OSG/NG to the ATLAS production system, PanDA....
Site Movers Introduction This document will describe the site movers used by the PanDA Pilot (Pilot 1.0 and 2.0). General concept and workflow description: 1. The...
RunJob Introduction For a standard grid job, the pilot`s Monitor module forks a subprocess and monitors it for the duration of the job. The subprocess, RunJob...
PilotMain Introduction The main PanDA pilot module is called pilot.py and is the code that is launched directly by the wrapper. The pilot module downloads...
Monitor Introduction The Monitor module is responsible for monitoring the payload, transfers, memory usage, disk space, etc. It launches the payload execution...
HpcYoda Yoda is the Event Service implemention on HPC. Overall architecture is shown below. Yoda is composed of several parts: pilotRunJobHpcEvent the frontend...
DefineObjectStore Define OS service In the atlas agis home page(https://atlas agis.cern.ch/agis/), click `Define OS service`. Follow the form to create...
PandaErrorCodes Introduction This page describes the error codes and diagnostics of the Panda jobs. transExitCode transExitCode diagnostics 1 Athena...
How to perform sequential jobs/operations in PanDA based analysis Introduction psequencer is an email driven application which executes a group of processes...
PanDA Web Preferences The following settings are web preferences of the PanDA web. These preferences overwrite the site level preferences in . and...
PandaClient The Panda client module provides a simple, lightweight python interface for submitting jobs to Panda, query job status and controlling jobs in the...
This page is obsolete.
PandaOperationalSecurity Introduction This page describes some operational security procedures for PanDA. This documentation is mainly concerned with investigating...
Installing PanDA server Keep in mind: this instruction is still work in progress. Preparation Two modules are needed to install the server: panda server and panda...
Motivation The number of attempts defined for a task is not suitable for all types of errors and ADC would like to have a way of treating some particular error codes...
This section describes the PanDA server database configuration. (See SchedconfigParameterDefinitions for additional info.) Cloudconfig and schedconfig are the most...
To be able to submit jobs to PanDA server, the following steps should be performed by user: 1. Obtain and install Grid user certificate Go to https://gridca.cern.ch...
Creating the MySQL database for PanDA server This section will focus on a MySQL DB creation. Creating the Oracle DB is out of the scope of this exercise and we would...
PanDA Packaging Corner Mandate The purpose of the Packaging working group, is to simplify the adoption of PanDA for other experiments. Our mandate defines 4 main...
This page is currently being edited. Please check for updates soon. PanDA: Production and Distributed Analysis system Pilots are one of the main PanDA features. Pilots...
PanDA monitor installation In this topic we`ll discuss the process of installing and configuring the PanDA monitor to use with MySQL database. Up to date monitor on...
PanDA Client PanDA Client is a tool which allows user to submit jobs to PanDA server. Installation PanDA Client can be obtained from github it`s a part of server...
PanDA server testing guide (see also https://twiki.cern.ch/twiki/bin/view/PanDA/TestingBigPanDAinstance, but ultimately the information should be merged) Global healthcheck...
PandaGerrit Gerrit is a web based code review system, facilitating online code reviews for projects using the Git version control system. PandaGerrit is using gerrit...
PanDA share distribution and monitoring WORK IN PROGRESS What is the idea behind? Currently PanDA job assignment is done according to priorities: higher priority...
FernandoHaraldBarreiroMegino 2015 02 25 Usage of EC2 CLI If you need a new machine for PanDA, get pre clearance from Sergey Panitkin and Torre Wenaus. They need...
Big PanDA Instance Installation Introduction This page is evolving. Please keep checking. This page contains information about BigPanDA instance installation...
Configure ES PandaQueue Here is some instructions to configure Panda queue to run EventService on HPC. setup the queue on schedconfig objectstore: used to...
SchedConfigNewController newController Basics and Use Basic Principles The newController code brings populates the schedconfig table with site configuration...
Installing pilot factory Preparation APF needs batch system to run pilots. Usually it`s HTCondor, it can be installed from condor repository: # yum config manager...
PandaTier3 Introduction This page describes the Panda configuration and setup for ATLAS Tier3 sites of the `T3g` type sites that are not full grid sites...
Currently RDBMS (Oracle or MySQL) is used as the storage backend. To provide better performance and scalability the data stored in relational storage is partitioned...
Intelligent Networking Introduction This page is evolving. Please keep checking. This page contains information about how PanDA interacts with network infrastructure...
Testing BigPanDA Instance Introduction This page is evolving. Please keep checking. This page contains information about tests one can perform to smoke...
BigPanDA Maintenance HowTos Introduction This page is evolving. Please keep checking. This page contains information related to BigPanDA instance maintenance...
Generic PanDA Pilot Introduction This document aims to guide the development of `experiment` specific plug ins for the PanDA Pilot. Examples of `experiment...
PanDA server migration from Oracle to MySQL DB backend Introduction This page is evolving. Please keep checking. This page contains information about BigPanDA...
PandaServer The Panda server is the central hub service where Panda core operations take place. Overall architecture is shown below. The Panda server is composed of...
BigPanDA Monitoring Developers Introduction This page is evolving. Please keep checking. This page describes monitoring package for developers. Feel...
Big PanDA RPM Auto Smoke Test Introduction This page is evolving. Please keep checking. This page contains information about automatic smoke tests for...
JEDI based Analysis Introduction JEDI is an intelligent component in the PanDA system to have capability for task level workload management. This page...
BigPanDAmonitoring Example Django project Overview BigPanDAmonitoring Example Django project is the base for creating of the VO/project specific monitoring,...
PanDA Virtual Organization (VO) Scope Small users like university groups can use a catch all instance of PanDA, if they want to evaluate the PanDA system...
BigPanDA Monitoring Environment (Production) Introduction This page describes production environment for the BigPanDA monitoring http://pandawms.org/bigpandamon...
Big PanDA RPM Build System Introduction This page is evolving. Please keep checking. This page contains information about BigPanDA RPM Build System. We...
PandaLogger The Panda logger provides client and server components for a logging system by which Panda services can register incidents for central logging, users...
Manual build of RPMs for Big PanDA Introduction This page is evolving. Please keep checking. This page contains information about manual build of RPMs...
Big PanDA Monitoring Introduction This page is evolving. Please keep checking. Showroom: http://pandawms.org/bigpandamon/ BigPanDA Monitoring Requirements...
Big PanDA Instance for ORNL pilots Introduction This page is evolving. Please keep checking. This page contains information about BigPanDA instance for...
Big PanDA devprodsys2 update Introduction This page describes how to update http://bigpanda.cern.ch/devprodsys2/ Feel free to contact JaroslavaSchovancova...
Quick Start Up Guide for PanDA Web Platform Application Developer Introduction The new Panda Web Platform was developed to back the Panda Monitor Web server...
BigPanDA HTCondor API Introduction This page summarizes BigPanDA HTCondor API from User`s perspective. It describes monitoring interface, and the cli API....
The PanDA Monitor Web Platform Introduction The Panda Web Platform was developed to back the Panda Monitor Web server that is more maintainable, supports...
Welcome to the 1 web Available Information PanDA Edit works now... PanDA Web Utilities advanced search WebTopicList all topics in...
PanDA child topics from Atlas
PandaPilotFAX Introduction The PanDA Pilot is equipped with several retry mechanisms. In the case stage in fails due to a temporary SE related problem, the...
PandaTestJob Introduction This page describes how to test Panda jobs. Production managers or ADCoS shifters should if possible use the test interface available...
Data Service for PanDA Functions of the central Panda data service (part of the PandaServer) Request/select group of jobs from the PandaTaskBuffer. Request...
PandaDynamicDataPlacement Introduction This page describes PanDA Dynamic Data Placement (PD2P). General Policies The following general policies apply to PD2P...
PandaPlatformDevelopeDbAccess Please ensure this page is compatible with the ATLAS Twiki Rules. Thank You Patrick Jussel, Maria Smizanska. In particular...
PandaDB This section describes the organization and schema of ORACLE database of Panda. Contact Gancho Dimitrov at CERN for access information. PandaDB (ORACLE...
Pilot Please ensure this page is compatible with the ATLAS Twiki Rules. Thank You Patrick Jussel, Maria Smizanska. In particular: 1 Page is linked...
HBaseForPanda General information Hadoop/Hbase namenode lxfssm4401 Our development node voatlas132 . Accessible from lxvoadm, has outbound connectivity...
AutoPyFactory Documentation is now distributed within the code. It can be found in SVN, or after checking out, underneath directory docs/. Major updates :...
GlideInWMS Introduction VO Frontend Installed on voatlas195. Random commands(to explain more later) $ voms proxy init cert /etc/grid security/hostcert...
PandaFacilitiesAtCern Introduction This twiki page describes the PanDA infrastructure at CERN. Machines Please see DistributedComputingMachines#Panda....
PandaDBMySQL This section describes the schema of the local MySQL database of Panda. Contact Yuri Smirnov at BNL for access information. Schema version 4 (created...
Glexec Motivation Worker nodes on the grid exhibit great diversity, making it difficult to offer uniform processing resources. A pilot job architecture, which...
PandaPilotDev General Introduction This wiki is to put here all comments about how pilot works. At the end this will be a full pilot documentation. TO DOs...
PanDjango About Pandjango is an evolved version of PandaMonitor, built with the Django Web Framework and other tools to create an interactive and AJAX capable...
Changing Site Parameters in the PanDA Central Database (for OSG) THIS PAGE IS NO LONGER CURRENT! Please don`t use this procedure. Changes are requested from Alden...
SchedConfigUpdates Schedconfig Requests and Their Status Req Date Mod Date Queue Name Requestor Status Notes 14 Oct 09 05 Jan 10 Nebraska...
!PanDA Security Overview Panda services that interact with other Panda components and with external clients use the standard GSI grid security model of authentication...
Auxiliary Resource Monitoring and Data Aggregation Services Introduction Panda services running at BNL (or any other location if desired) are using...
PandaSchedConfig Introduction The schedconfig table is filled with information from a variety of sources. It is filled by autopilot/pilotController.py which...
TWiki search by CERN Search Results You may also search with the internal TWiki WebSearch . Please note that TWiki internal WebSearch may be very slow for large...
Panda Production and Distributed Analysis More Details Introduction We anticipate building a generic infrastructure for execution of many types of jobs and workflows...
PandaOnTier3 Introduction This page outlines the steps necessary to make a Computing Element (CE, a cluster, e.g. a Tier3 site) available for PanDA production...
Job Scheduler for Panda Introduction The PandaJobScheduler is a component of PanDA, the OSG executor that is being developed to replace CaponE in the ATLAS production...
Panda Integration Testing Introduction This document describes tests on how to run Eowyn with Panda to transfer CERN DB jobs to PandaDB and how to run jobscheduler...
Panda Integration Testing Introduction This document describes how to run Eowyn with Panda to transfer CERN DB jobs to PandaDB and how to run jobscheduler to execute...
Panda Installation Guide Introduction Panda is available in 4 different independent formats (packages): PandaSrv the panda server including PandaTaskBuffer...
Executor Interface for Panda This document describes the status and progress of the executor supervisor interface for Panda. Functions Receive jobs from ATLAS...
PandaJobSchedulerV000301 Introduction The PandaJobScheduler is a component of PanDA, the OSG executor that is being developed to replace CaponE in the ATLAS...
PandaJobSchedulerV000202 Introduction The PandaJobScheduler is a component of PanDA, the OSG executor that is being developed to replace CaponE in the ATLAS...
PandaJobSchedulerV000101 Introduction The PandaJobScheduler is a component of PanDA, the OSG executor that is being developed to replace CaponE in the ATLAS...
1 Web Create New Topic Index Search Changes Notifications Statistics Preferences
PandaReviewMar06 Panda Review March 8 9, 2006 US ATLAS internal review of Panda and Panda based distributed analysis. Charge: Evaluate the progress of the...
PandaRel000001 Introduction This is the first CVS tagged release of Panda Release information Panda release 0.0.1, Release date November 17, 2005 The CVS tag...
PandaDataServiceTest Introduction This page is meant to provide information on installing the test versions of DQ2 components to support DQ2 v0.2.12 for...
Panda Testing This document describes testing and QA activities in support of Panda development. Panda development server A development instance of the Panda server...
Task Buffer for PANDA This document describes the status and progress of the Task Buffer for Panda. Functions Store jobs supplied by the PandaClient interface...
Panda Integration Testing Introduction This document describes testing and QA activities in support of Panda development. Installation Download and untar/ungzip...
PandaCVS Introduction This is the CVS info page for the Panda project. Note: The Panda CVS Repository has been moved from BNL to CERN, so please DO NOT use...
Job State Introduction The purpose of the job state algorithm is to provide a job recovery mechanism for the Panda pilot. Whenever the pilot updates the Panda...
Job Recovery Introduction The task of the Panda pilot job recovery is to scan the disk for old `lost` job directories and log files. When it finds a lost job...
Panda Pilot Multitasking Introduction Pilot multitasking refers to the pilot ability to run a production job at the same time as consecutive user analysis jobs...
PandaProductionService Introduction This section describes the panda server, database and jobscheduler instances used for the PanDA production service. Panda...
Job Dispatcher for Panda This document describes the status and progress of the job dispatcher for Panda. Functions Respond to PandaPilotJobs Ask PandaTaskBuffer...
PandaDevService Introduction This section describes the panda server, database and jobscheduler instances used for the PanDA development service. Panda server...
How to Find Panda Job`s Log Files Introduction This page describes how to find Panda job`s log files. Note: this is all much simpler now. You can browse to the...
TWiki`s PanDA web The 1 web of TWiki. TWiki is a Web Based Collaboration Platform for the Enterprise.
/PanDA The 1 web of TWiki. TWiki is a Web Based Collaboration Platform for the Enterprise.
This is a subscription service to be automatically notified by e mail when topics change in this 1 web. This is a convenient service, so you do not have to come...
TWeeder info for PanDA Total Number of topics: 154 1 Topics updated during the last 7 days Days Web Topic Date S7 PanDA Pilot2ActivityReports2017PaulNils...
Number of topics: 175

Show recent changes with 50, 100, 200, 500, 1000 topics, all changes

Related topics: RSS feed, rounded corners RSS feed, ATOM feed, WebNotify, site changes, site map

Edit | Attach | Watch | Print version | History: r1 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r1 - 2006-11-15 - TWikiContributor
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    PanDA All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback