Difference: FileMerger (1 vs. 4)

Revision 42014-03-24 - RobLambert

Line: 1 to 1
 
META TOPICPARENT name="Noether"

File Merger: a very simple configurable application of LHCb in Noether

Line: 6 to 6
 
Changed:
<
<
... perhaps I should have called it concateneate ...
>
>
... perhaps I should have called it concatenate ...
 

Revision 32014-03-24 - RobLambert

Line: 1 to 1
 
META TOPICPARENT name="Noether"

File Merger: a very simple configurable application of LHCb in Noether

Line: 67 to 67
  slots = { "EvtMax": -1 # Maximum number of events to process , "SkipEvents": 0
Changed:
<
<
, "Simulation": True # True implies use SimCond , "DataType": '2012' # Data type, can be [ 'DC06','2008' ]
>
>
, "Simulation": False # True implies use SimCond , "DataType": '2012' # Data type, can be [ '2012','2011','2010'... ]
  , "DDDBtag" : 'default' # default as set in DDDBConf for DataType , "CondDBtag" : 'default' # default as set in DDDBConf for DataType , "OutputFile" : 'merged.dst' # output filename

Revision 22014-03-22 - MarcoCattaneo

Line: 1 to 1
 
META TOPICPARENT name="Noether"

File Merger: a very simple configurable application of LHCb in Noether

Line: 36 to 36
 
  • Set up your input
    • any gaudi-card dataset will work, in Ganga, from the book-keeping, or from the TestFileDB... here is an example with a file stored in the TestFileDB
Changed:
<
<
%SYNTAX{ syntax='python' }%
>
>
%SYNTAX{ syntax="python" }%
 #imagine this is in a file called mydata.py from GaudiConf import IOExtension IOExtension().inputFiles(["root://eoslhcb.cern.ch//eos/lhcb/grid/prod/lhcb/swtest/lhcb/swtest/2011_smallfiles_EW/00010197_00000049_1.radiative.dst"]) %ENDSYNTAX%

  • Use the merger
Changed:
<
<
%SYNTAX{ syntax='python' }%
>
>
%SYNTAX{ syntax="python" }%
 #the default will create a file called merged.dst from Configurables import FileMerger FileMerger()
Line: 59 to 59
 

Options and settings

  • FileMerger is about the simplest possible configurable application it's possible to write in LHCb software.
  • FileMerger has very few options, and all of them are very obvious...
Changed:
<
<
%SYNTAX{ syntax='python' }%
>
>
%SYNTAX{ syntax="python" }%
 class FileMerger(LHCbConfigurableUser): ## Possible used Configurables used_configurables = [ LHCbApp ]

Revision 12014-03-21 - RobLambert

Line: 1 to 1
Added:
>
>
META TOPICPARENT name="Noether"

File Merger: a very simple configurable application of LHCb in Noether

... perhaps I should have called it concateneate ...

(the result of task #32774 )

....... Concatenate

What is it?

  • FileMerger() is a very simple configurable which has only one use, to concatenate files together and output a merged file.
  • It is able to merge many MDF files, RAW files, or DSTs, and employs a combination of:
    • InputCopyStream
    • MergeFSRs
    • MDFWriter

How to use it?

  • Setup the project SetupProject Noether

  • Set up your input
    • any gaudi-card dataset will work, in Ganga, from the book-keeping, or from the TestFileDB... here is an example with a file stored in the TestFileDB
SyntaxHighlightingPlugin: Language syntaxpython is either undefined or unsupported. Check SyntaxHighlightingPlugin for more information.
<!-- SyntaxHighlightingPlugin -->
#imagine this is in a file called mydata.py
from GaudiConf import IOExtension
IOExtension().inputFiles(["root://eoslhcb.cern.ch//eos/lhcb/grid/prod/lhcb/swtest/lhcb/swtest/2011_smallfiles_EW/00010197_00000049_1.radiative.dst"])
<!-- end SyntaxHighlightingPlugin -->

  • Use the merger
SyntaxHighlightingPlugin: Language syntaxpython is either undefined or unsupported. Check SyntaxHighlightingPlugin for more information.
<!-- SyntaxHighlightingPlugin -->
#the default will create a file called merged.dst
from Configurables import FileMerger
FileMerger()
<!-- end SyntaxHighlightingPlugin -->

  • e.g.: =gaudirun.py mydata.py $FILEMERGEROPTS/Default.py =

Resources

Options and settings

  • FileMerger is about the simplest possible configurable application it's possible to write in LHCb software.
  • FileMerger has very few options, and all of them are very obvious...
SyntaxHighlightingPlugin: Language syntaxpython is either undefined or unsupported. Check SyntaxHighlightingPlugin for more information.
<!-- SyntaxHighlightingPlugin -->
class FileMerger(LHCbConfigurableUser):
    ## Possible used Configurables
    __used_configurables__ = [ LHCbApp ]

    __slots__ = {
          "EvtMax":            -1    # Maximum number of events to process
        , "SkipEvents":        0
        , "Simulation":        True # True implies use SimCond
        , "DataType":          '2012' # Data type, can be [ 'DC06','2008' ]
        , "DDDBtag" :          'default' # default as set in DDDBConf for DataType
        , "CondDBtag" :        'default' # default as set in DDDBConf for DataType
        , "OutputFile" :       'merged.dst' # output filename
        , "MergeFSR"   :       True #whether to merge FSRs on the output if MDF
        , 'WriteFSR'    :      True #copy FSRs as required if not MDF

        }
<!-- end SyntaxHighlightingPlugin -->

-- RobLambert - 21 Mar 2014

META FILEATTACHMENT attachment="concatenate.jpg" attr="" comment="concatenate" date="1395428510" name="concatenate.jpg" path="concatenate.jpg" size="74146" user="rlambert" version="1"
 
This site is powered by the TWiki collaboration platform Powered by PerlCopyright & 2008-2019 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback