Deletion Campaigns

Introduction

Deletion Campaigns are one-off activities, aimed at cleaning-up old datasets, which are no longer needed by the Physics community. The primary goal is to free up storage space at the CMS Tiers.

Organization

Each campaign has it's own Twiki page, where the list of datasets to be deleted are published, and a time-line for the actions is defined. Usually, after the publication of the initial list, physics coordinators request some datasets to be excluded from the campaign. These are listed in a separate table. When the list of deletions is finally agreed upon, the datasets are first DEPRECATED in DBS, so that no more physics analyses would attempt to use them. The datasets are still physically present at the Tier site at this stage. After a grace-period of about a week, in which people might realize they actually need some datasets, and want them restored, the datasets are actually deleted (except the ones which were requested to be restored, of course). The deletion is done by creating a list of datasets per Tier center, and issuing a single, large PhEDEX DeletionRequest per site. After the requests get approved by the site admins, and the deletions complete, we normally do a cross-check to verify that everything that was requested to be deleted is actually deleted. At that point the campaign is usually pronounced over, and finished.

List of current campaigns

List of aborted/incomplete campaigns

List of old, completed campaigns

Campaign start end
CompOpsDeleteT1INVALID Oct,2013 Nov,2013
CompOpsDeleteASGCstatistic August, 2013 Oct,2013
CompOpsDeleteT2CERNDataOps Sep, 2013 Oct, 2013
CompOpsSummer11GENSIMDeletionCampaign Aug, 2013 Oct, 2013
CompOpsDeleteOldMCCampaignFNALLPC Nov 30th,2012 Dec,2012
CompOpsDeleteASGCevacuation Feb 15th, 2013 March 2013
CompOpsDeleteT1CERNcleanup March, 2013 April, 2013
CompOpsDeleteT0CERNPrompt May, 2013 May, 2013
CompOpsDeleteNov2012campaign Nov.2012 Feb.2013
CompOpsDeleteNCcampaignFNAL Sep 11th,2012 Oct 16th,2012
CompOpsDeleteNCRecocampaignFNAL Oct 23rd,2012 Nov 9th,2012
CompOpsDeleteOldDataJul2012campaign Jul.2012 Sep.2012
CompOpsDeleteSummer09toSpring11MCcampaign Jul.2012 Sep.2012
CompOpsDeleteSummerFall11MCRecoCampaign Apr.2012 May.2012
CompOpsDeleteSummer09toWinter10MCcampaign Oct.2011 Nov.2011
CompOpsDeleteCommissioning08campaign Feb.2010 Jun.2010
CompOpsDeleteSummer08campaign Feb.2010 Jun.2010
CompOpsDeleteCSA08campaign Sep.2009 Nov.2009
CompOpsDeleteCSA07campaign Aug.2009 Nov.2009
CompOpsDeleteCMSSW1XXcampaign Aug.2009 Oct.2009
Edit | Attach | Watch | Print version | History: r44 < r43 < r42 < r41 < r40 | Backlinks | Raw View | WYSIWYG | More topic actions
Topic revision: r44 - 2014-06-17 - MericTaze
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    CMSPublic All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2023 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback