Rucio in Hadoop

Introduction

What's the initial reason this data has been imported? Who are the people taking care of it? Where from the data come? How much of data is it?

daily dump data

/user/rucio01/

5815889866181 (5.2 TB) /user/rucio01/dq2 2200309054264 /user/rucio01/logs 1089137029904 /user/rucio01/replica_dumps 473604121023 /user/rucio01/dumps 102658659843 /user/rucio01/tmp 14603958207 /user/rucio01/reports 15858378994 /user/rucio01/sqoop.dump 238690736 /user/rucio01/traces

The Data

Where is it? Table with column descriptions.
Column name type Description
A1 B2 C2
A3 B3 C3

Analysis Code

Where is it?

Table with all the scripts and short descriptions on what they do.

name type Description
FilePopularity.pig pig Calculates how many times a file has been accessed during...
A3 B3 C3

Table with all the UDFs and their descriptions.

UDF return type input parameters Description
A1 B2 C2
A3 B3 C3


Major updates:
-- IlijaVukotic - 2014-11-19

Responsible: IlijaVukotic
Last reviewed by: Never reviewed

Edit | Attach | Watch | Print version | History: r8 | r5 < r4 < r3 < r2 | Backlinks | Raw View | Raw edit | More topic actions...
Topic revision: r3 - 2014-12-03 - IlijaVukotic
 
    • Cern Search Icon Cern Search
    • TWiki Search Icon TWiki Search
    • Google Search Icon Google Search

    Atlas All webs login

This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2020 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use Discourse or Send feedback