(r40) FTS < EGEE

EGEE Web>EGEEgLite>DataManagement>FTS (revision 40) (raw view)~~EditAttachPDF~~

<!--
   * Set ALLOWTOPICCHANGE = Main.DepITGMDMGroup
-->
%INCLUDE{"LCG.FtsMenu"}%

---+!! File Transfer Service

<img src="%ATTACHURLPATH%/shadow_logo_huge.png" alt="shadow_logo_huge.png" width='227' height='120'/>

%TOC%

---++ Follow up
   *  FTS 2.2.3: rolling out
   *  FTS 2.2.2: rolling out
   * FTS 2.2.1: rolling out 

---++ Current version

The current version of the !FTS software, including all documentation: LCG.FtsRelease21.

For updates please refer to DMFtsPatchStatus

The next release is FtsRelease22 with the documentation:
   * [[FtsInstallation][Install Guide]]
   * [[FtsConfiguration][Configuration Guide]]
   * [[FtsAdministration][Administration Guide]]
   * [[FIOgroup.FtsServiceProcedures][Administration Procedures]]
   * [[Fts223KnownIssues][Known issues]]

---++ Bug and problem reporting

   * All operational problems with the !FTS service should be submitted via the [[http://www.ggus.org][GGUS portal]].

   * All software problems should be submitted and are tracked in [[http://savannah.cern.ch][savannah.cern.ch]].

   * If you don't know whether the problem is an operational or a software issue, submit it via the [[http://www.ggus.org][GGUS portal]].

---++ Software requirements tracking

The current prioritized list of software improvements requested by the EGEE VOs and tracked by the [[https://twiki.cern.ch/twiki/bin/view/EGEE/TCGHome][Technical Coordination Group]] on the JRA1 workplan:

   * EGEE gLite <A href="https://savannah.cern.ch/task/index.php?go_report=Apply&group=jra1workplan&func=browse&set=custom&msort=0&report_id=101&advsrch=1&resolution_id[]=0&bug_id=&category_id[]=0&priority[]=0&assigned_to[]=0&status_id[]=1&date=&date_end=&summary=FTS&history_search=0&history_field=0&history_event=modified&history_date_dayfd=10&history_date_monthfd=10&history_date_yearfd=2008&chunksz=50&spamscore=5&boxoptionwanted=0">work plans</A>
   * List of <A href="https://savannah.cern.ch/bugs/?group=jra1mdw&func=browse&set=custom&msort=0&assigned_to[]=0&severity[]=0&submitted_by[]=0&resolution_id[]=100&resolution_id[]=114&resolution_id[]=120&resolution_id[]=122&category_id[]=154&status_id[]=1&priority[]=0&summary[]=&bug_id[]=&advsrch=1&msort=0&chunksz=200&spamscore=5&report_id=144&sumORdet=&morder=bug_id%3C&order=resolution_id#results">bugs</A> in Savannah



---++ !FTS Overview
There are four components to any of the FTS Service. Any one node can run any number of components (although this has not been tested in full production). 

---+++ !FTS Web service ("FTS")

This component allows users to submit FTS jobs and query their status. It is the only component that users interact with. It runs as a Tomcat web-application (Java based). The node also has a local BDII with a GIP publishing the necessary information about this FTS server (the site BDII should configured to pull this information). 

Referred to throughout a node type =FTS=.

<img src="%ATTACHURLPATH%/fts-webservice-deployment.png" alt="fts-webservice-deployment.png" width='200' />

---+++ !FTS agents ("FTA")

These are the back-end agents that do the work of the service. Each agent runs as a distinct daemon, and you may have as many agents daemons running on a node as it can support. There are two main type (channel and VO agent) which may be mixed across nodes as necessary.

Referred to throughout a node type =FTA=.

---++++ !FTS agents: channel agent

Each network channel, (e.g. "transfers from CERN to RAL") has a distinct daemon running transfers for it. The daemon is responsible for starting and controlling transfers on the associated network link. When a transfer is started, a controlling process for that transfer is (double) forked from the controlling agent.

There should be one agent daemon for every channel that the FTS has defined, each managing a different channel.

Since they produce a large number of forked processes, the channel agent daemons are generally spread over a number of agent nodes ~equally.

<img src="%ATTACHURLPATH%/fts-agent-deployment.png" alt="fts-agent-deployment.png" width='350' />

---++++ !FTS agents: VO agents

Each VO served by the FTS service has a distinct VO agent daemon running for it. This performs house-keeping tasks for that VO. There should be one VO agent daemon for every VO that will use the FTS service.

The VO agents consume very little resources and can be put freely on any agent node in the cluster.

---+++ !FTS Monitor ("FTM")

This provides an Apache httpd server which serves monitoring data to a variety of clients. Most of the served data is statically produced by (frequently running) cron-script or daemons (rather than CGI-based).

It currently provides a GridView monitoring feed into the WLCG monitoring system and a couple of modules for basic service monitoring. It is intended that new monitoring modules can be dropped in as needed.

Referred to throughout a node type =FTM=.


---++ Other links
   * Internal documentation for !FTS version 2.0 and 2.1 and 2.2: FtsInternalDocumentation.
   * Current !FTS presentations and diagrams are on the FTSPresentationsPage.
   * The validation !FTS pilot service is described in LCG.TransferOperationsPilotService.

---++ Operational notes

The current status of the CERN-PROD service is described in LCG.TransferOperations.

   * Operations procedures for the computer centre operators are documented in 
      [[http://service-cc-opm.web.cern.ch/service-cc-opm/cgi-bin/opm_overview.cgi][OPM]] for the =gridfts= cluster
   * Deployment layout is documented in LCG.FtsTier0Deployment
   * Installation / upgrade / FAQ / etc is described at FtsInstallation
   * CERN-PROD intervention plans are described in LCG.FtsTier0ServerInterventions
   * Standard service manager procedures are described in LCG.FtsProcedures20

---++ FTS testing

   * Collection of FTS test topics LCG.FtsTest

-----
Last edit: %SEARCH{".*" nosearch="on" regex="on" scope="title" nototal="no" topic="FTS" format="$wikiusername on $date"}%
Maintainer: Main.RosaGarciaRioja

Attachments

Topic attachments
I	Attachment	History	Action	Size	Date	Who	Comment
png	fts-agent-deployment.png	r1	manage	145.3 K	2009-05-07 - 16:49	AkosFrohner
png	fts-webservice-deployment.png	r1	manage	99.0 K	2009-05-07 - 16:49	AkosFrohner
png	shadow_logo_huge.png	r1	manage	31.5 K	2006-10-10 - 14:04	PaoloBadino	fts logo

Topic revision: r40 - 2010-03-16 - unknown

EGEE

Main.WebList

Welcome Guest

- Cern Search
- TWiki Search
- Google Search
EGEE All webs

Copyright &© by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Ask a support question or Send feedback