Pre configured Analysis Environment Updated: 2 September 2014 Author: Luca Menichetti Contributors: Krystof Borkovec, Borja Garrido, SWAN team We will provide a simplified...
Prepared environment for jobs submission through Docker How to obtain a VM with Docker and Hadoop/Spark configurations pre installed in order to submit jobs using...
Analytics Working Group TWiki Goals of the working group Coordinate analysis and trending of application/service usage data typically based on days or...
Active Analysts Corner Shared Goals and Activities Understanding the experiment workflows Collecting and defining usefull metrics to measure the IT infrastructure...
Understanding the processing workflows of the experiments Sources Lecture on the Experiment Workflows for Summer Students: https://cds.cern.ch/record/...
Christian Nieke Research Goals Measure relative performance of infrastructure components (Estimate CPU factors) Compare performance for different configurations...
Data Access This pages describes how to get access to the collected data. How to get access To open a ticket through Service Now at the Core FE, specifying your group...
Analysis Patterns and Examples This is not more than a basic topic structure for which we should collect concrete code snipplets in a few implementation technologies...
Export Script (awgrepo tool) Developer: Luca Menichetti (luca.menichetti #64;cernNOSPAMPLEASE.ch) This extraction script (called awgrepo script) can be use to...
Organisation and Links Meetings and e mail lists category with presentations / meetings / minutes group mailinglist: it analytics wg@cern.ch and archive...
Perfsonar data: Meyrin/Geneva link (work in progress) Contact For AWG: luca.menichetti #64;cernNOSPAMPLEASE.ch Links Requests for Parameters ... Processed...
EOS File Transfer Logs The logs for EOS transactions. Every entry corresponds to one file interaction, from open to close. Contact For AWG: Nieke Developer: Peters...
Projection and selection examples Projection using PIG: given a csv set of file, we want to extract just few metrics using Pig. For example: over a month of csv...
Experiment Dashboard Data Transfer XRootD access/transfer logs (Experiment Federations and EOS) This data represents XRootd federations and EOS access/transfer logs...
page not complete, work in progress Requirements To run this example you can download the code here, build it with the maven command `mvn package` and execute the...
Examples index page In this page are listed (grouped by languages) every twiki pages related to examples/projects/guides scattered around the ITAnalyticsWorkingGroup...
Author Vag Motesnitsalis: vag.motesnitsalis@cern.ch Requirements Before you proceed to the example, at this link you can find step by step instructions of how to...
Step by Step Instructions to create a Hadoop MapReduce Project with Eclipse and compile it with Maven Make sure you have JDK installed (at least version 1.7. as...
Experiment Job monitoring Dashboards Index: Data available in the analytix cluster Dashboard API Data available in the analytix cluster New job monitoring...
From SQL to PIG, query translation with JSON format source data From some data in JSON format with this format (for example for CMS Experiment Dashboard Job Monitoring...
Requirements This is a Spark example written in Scala. The idea is to write a simple project in Scala, build a jar and run it inside the cluster. If you don`t have...
How to create a Spark Scala project and build a Jar This is a step by step guide in which I will try not to overlook something, but if you are having some problem...
LanDB Contact: For AWG: Raul Garcia Links Requests for Parameters is.physical/is.virtual should be an attribute (the information is available, just needs to...
ITAnalyticsWorkingGroup Web Preferences The following settings are web preferences of the ITAnalyticsWorkingGroup web. These preferences overwrite the site...
TWiki search by CERN Search Results You may also search with the internal TWiki WebSearch . Please note that TWiki internal WebSearch may be very slow for large...
This is a subscription service to be automatically notified by e mail when topics change in this 1 web. This is a convenient service, so you do not have to come...