Difference between revisions of "Using GANGA with AMAAthena"

From Atlas Wiki
Jump to navigation Jump to search
Line 21: Line 21:
 
Inside GANGA, one could deal with the complex CMT setup with two magic functions. The following example assumes an use case of loading ATLAS release 14.2.0 in 32 bit mode:
 
Inside GANGA, one could deal with the complex CMT setup with two magic functions. The following example assumes an use case of loading ATLAS release 14.2.0 in 32 bit mode:
  
<tt>
+
<pre>
 
In [1]: config.Athena.CMTHOME = '/your/cmthome'
 
In [1]: config.Athena.CMTHOME = '/your/cmthome'
 
In [2]: cmtsetup 14.2.0,32
 
In [2]: cmtsetup 14.2.0,32
 
In [3]: setup
 
In [3]: setup
</tt>
+
</pre>
  
 
== Running AMAAthena on Stoomboot cluster ==
 
== Running AMAAthena on Stoomboot cluster ==
  
 
=== Using StagerDataset ===
 
=== Using StagerDataset ===
Create a new job:
+
 
<tt>
+
<ol>
 +
<li/>Create a new job'''
 +
<pre>
 
In [1]: j = Job()
 
In [1]: j = Job()
</tt>
+
</pre>
  
Setup the application:
+
<li/>Setup the application:
<tt>
+
<pre>
 
In [2]: j.application = AMAAthena()
 
In [2]: j.application = AMAAthena()
 
In [3]: j.application.option_files += [ File('../run/AMAAthena_jobOptions.py'), File('../run/Trigger_jobOptions.py') ]
 
In [3]: j.application.option_files += [ File('../run/AMAAthena_jobOptions.py'), File('../run/Trigger_jobOptions.py') ]
Line 43: Line 45:
 
In [6]: j.application.max_events = '1000'
 
In [6]: j.application.max_events = '1000'
 
In [7]: j.application.prepare()
 
In [7]: j.application.prepare()
</tt>
+
</pre>
  
Setup the inputdata:
+
<li/>Setup the inputdata:
<tt>
+
<pre>
 
In [8]: j.inputdata = StagerDataset()
 
In [8]: j.inputdata = StagerDataset()
 
In [9]: j.inputdata.dataset += [ 'fdr08_run2*physics_Muon*AOD*o3*' ]
 
In [9]: j.inputdata.dataset += [ 'fdr08_run2*physics_Muon*AOD*o3*' ]
</tt>
+
</pre>
  
Setup a job splitter (optional):
+
<li/>Setup a job splitter (optional):
<tt>
+
<pre>
 
In [10]: j.splitter = StagerJobSplitter()
 
In [10]: j.splitter = StagerJobSplitter()
 
In [11]: j.splitter.numfiles = 2
 
In [11]: j.splitter.numfiles = 2
</tt>
+
</pre>
  
Setup the backend:
+
<li/>Setup the backend:
<tt>
+
<pre>
 
In [12]: j.backend = PBS()
 
In [12]: j.backend = PBS()
</tt>
+
</pre>
  
Submit the job:
+
<li/>Submit the job:
<tt>
+
<pre>
 
In [13]: j.submit()
 
In [13]: j.submit()
</tt>
+
</pre>
 +
 
 +
</ol>
  
 
=== Using DQ2Dataset ===
 
=== Using DQ2Dataset ===

Revision as of 13:45, 13 August 2008

Introduction

This document gives an step-by-step instruction for running AMAAthena within GANGA. AMAAthena is a Athena package providing ... mainly developed at NIKHEF. GANGA is an official ATLAS grid utility for distributed data analysis.

Before starting Ganga

  1. follow the CMT instructions to setup your CMTHOME directory
  2. checkout the AMAAthena package from CVS
  3. make sure your environment is clean (i.e. no Athena/CMT environment variables)

Starting GANGA

Typing the following commands within the directory: PhysicsAnalysis/AnalysisCommon/AMA/AMAAthena/cmt

% source /project/atlas/nikhef/dq2/dq2_setup.sh.NIKHEF
% export DPNS_HOST=tbn18.nikhef.nl
% export LFC_HOST=lfc-atlas.grid.sara.nl
% source /project/atlas/nikhef/ganga/etc/setup.[c]sh

Magic functions for cmtsetup

Inside GANGA, one could deal with the complex CMT setup with two magic functions. The following example assumes an use case of loading ATLAS release 14.2.0 in 32 bit mode:

In [1]: config.Athena.CMTHOME = '/your/cmthome'
In [2]: cmtsetup 14.2.0,32
In [3]: setup

Running AMAAthena on Stoomboot cluster

Using StagerDataset

  1. Create a new job
    In [1]: j = Job()
    
  2. Setup the application:
    In [2]: j.application = AMAAthena()
    In [3]: j.application.option_files += [ File('../run/AMAAthena_jobOptions.py'), File('../run/Trigger_jobOptions.py') ]
    In [4]: j.application.driver_config.config_file = File('../run/exampleaod.conf')
    In [5]: j.application.driver_config.include_file += [ File('../run/reader.conf') ]
    In [6]: j.application.max_events = '1000'
    In [7]: j.application.prepare()
    
  3. Setup the inputdata:
    In [8]: j.inputdata = StagerDataset()
    In [9]: j.inputdata.dataset += [ 'fdr08_run2*physics_Muon*AOD*o3*' ]
    
  4. Setup a job splitter (optional):
    In [10]: j.splitter = StagerJobSplitter()
    In [11]: j.splitter.numfiles = 2
    
  5. Setup the backend:
    In [12]: j.backend = PBS()
    
  6. Submit the job:
    In [13]: j.submit()
    

Using DQ2Dataset

Running AMAAthena on LCG

Using StagerDataset

Using DQ2Dataset

When the job is completed

Working in progress

  1. supporting StagerDataset for jobs on the grid (LCG/NG)

More information