Difference between revisions of "NIKHEF PAT workshop Oct2006"
Jump to navigation
Jump to search
(→GANGA) |
|||
Line 240: | Line 240: | ||
==GANGA== | ==GANGA== | ||
*For further details vistit [https://twiki.cern.ch/twiki/bin/view/Atlas/DistributedAnalysisUsingGanga ganga wiki] | *For further details vistit [https://twiki.cern.ch/twiki/bin/view/Atlas/DistributedAnalysisUsingGanga ganga wiki] | ||
− | *A very simple example of how to use | + | *A very simple example of how to use GANGA move to your ${HOME} directory and do: |
<pre> | <pre> | ||
− | + | source /afs/cern.ch/project/gd/LCG-share/sl3/etc/profile.d/grid_env.csh | |
− | + | alias dq2 = /afs/cern.ch/atlas/offline/external/GRID/ddm/pro02/dq2 | |
− | + | setenv LFC_HOST 'lfc-atlas-test.cern.ch' | |
− | + | setenv LCG_CATALOG_TYPE lfc | |
− | setenv PATH /afs/cern.ch/sw/ganga/install/slc3_gcc323/4.2.0- | + | source /afs/usatlas.bnl.gov/Grid/Don-Quijote/dq2_user_client/setup.csh.CERN |
+ | setenv PATH /afs/cern.ch/sw/ganga/install/slc3_gcc323/4.2.0-beta10/bin/:$PATH | ||
+ | setenv GANGA_CONFIG_PATH GangaAtlas/Atlas.ini | ||
</pre> | </pre> | ||
Line 265: | Line 267: | ||
</pre> | </pre> | ||
− | *Now move to the run directory again | + | *Now move to the run directory again. Note that you can run Ganga in a very similar way as you run pathena: |
<pre> | <pre> | ||
− | ganga | + | ganga athena --inDS csc11.005300.PythiaH130zz4l.recon.AOD.v11004103 \ |
+ | --outputdata AnalysisSkeleton.aan.root \ | ||
+ | --lsf --maxevt 100 \ | ||
+ | AnalysisSkeleton_jobOptions.py | ||
</pre> | </pre> | ||
Revision as of 08:56, 16 October 2006
Pre-Tutorial
- This pre-Tutorial is copy of the one given by Ketevi A. Assamagan, adapted to work in 12.0.2
- here is a link to other Tutorials by Ketevi, and other usful PAT links:
- Please follow the following pre-Tutorial before the date of the Workshop. It is a very straight forward, tutorial and will help to set up the athena enviroment for the workshop, so we can focus our time in more interested things
Event Selection
First we're going to generate a new AAN that we'll use later for selection.
cd ~scratch0/Workshop/ source setup.sh -tag=12.0.2,opt cd 12.0.2/PhysicsAnalysis/AnalysisCommon/UserAnalysis cp ~ordonez/public/Workshop_files/src/AnalysisSkeleton.cxx src/. cp ~ordonez/public/Workshop_files/UserAnalysis/AnalysisSkeleton.h UserAnalysis/. cd cmt gamke cd .. mkdir run2 cd run2 cp ~ordonez/public/Workshop_files/run2/AnalysisSkeleton_jobOptions.py . cp ~ordonez/public/Workshop_files/data2/PoolFileCatalog.xml . cp ~ordonez/public/Workshop_files/data2/mc11.004202.ZmumuJimmy.recon.AOD.v11000401.py . athena AnalysisSkeleton_jobOptions.py | tee athenaOut_AnalysisSkeleton.log
This will generate the file AnalysisSkeleton.aan.root.
Event Selection using TAG
- First we generate our own TAG.
- Still in the new Run directory:
cp ~ordonez/public/Workshop_files/run2/Main_topOptions.py .
- Edit Main_topOptions.py and uncomment the line
### Create TAG file doWriteTAG=True
athena Main_topOptions.py | tee athenaOut.log
- This will generate the file called ZmumuOnAOD_TAG.root
- Now we are ready to run our algorithms with a TAG selection on the fly. Edit Main_topOptions.py again comment out:
#doWriteTAG=True
- and uncomment
doRunAODwithSelection=True and useTag=True
- Copy:
cp ~ordonez/public/Workshop_files/run2/ZmumuOnAOD_new_jobOptions.py .
- And run again. Note that only will run the events that satisfy the query:
EventSelector.Query = "NLooseMuon>0 && NLooseMuon<3 && abs(LooseMuonEta1)<2.5 && abs(LooseMuonEta2)<2.5 && LooseMuonPt2>10000 && LooseMuonPt2>10000"
athena Main_topOptions.py | tee athenaOut.log
- As an output you have ZmumuOnAOD_withTAGSelection.aan.root. You can have a look at it in root to make sure that the query has been satisfied
- Now we'll rewrite our own AOD containeing only the events selected. We'll do it for only 50 events to gain some time
- Edit again Main_topOptions.py and change:
TheApp.EvtMax = 500 to TheApp.EvtMax = 50
- Comment out
#doRunAODwithSelection=True
- uncomment:
doRewriteAOD=True
and run once more
athena Main_topOptions.py | tee athenaOut.log
You'll see a new Zmumu_new_AOD.root file has been created
Event Selection using AAN
- Follow as in the previous section but useANN=True instead of useTAG=True. In the end you should have the following two files:
Interactive Analysis in ATHENA
- In this exercise, we will see how to do interactive analysis in ATHENA, how to browse the Raw Data in the AOD. Proceed as follows:
get_files Interactive_topO.py
- Edit Interactive_topO.py and replace this line
EventSelector.InputCollections = [ "AOD.pool.root" ]
- with this line:
include ( "mc11.004202.ZmumuJimmy.recon.AOD.v11000401.py" )
- run
athena -i Interactive_topO.py
- Initialize application manager
athena>theApp.initialize()
- Run 1 event
athena>theApp.nextEvent()
- Retrieve Muons from AOD
athena>mcon = PyParticleTools.getMuons("MuidMuonCollection")
- Other methods are defined in PyParticleTools
- Get the first muon
athena>m = mcon[0]
- Get a list of methods
athena>dir(m)
- See pT
athena>m.pt()
- Get TrackParticle via ElementLink
athena>tp = m.track() athena>dir(tp) athena>tp.pt()
- Retrieve the MC Truth
athena>mcc = PyTruthTools.getMcEvents("TruthEvent") athena>mc = mcc[0] athena>mc.alphaQCD()
- Dump Data Store
athena>dumpSG()
- Run next event
athena>theApp.nextEvent()
Rewind event counter
athena>theApp.seek(0)
- See pT distribution of muons
athena> plot("MuonContainer#MuidMuonCollection","$x.pt()",nEvent=5)
TriggerAware Analyis
Analysis with the EventView
- Due to the time I won't cover this section during the Workshop. But now you should have the basic knowledge requiered to understand it. You can learn about the Event View here
Analysis on the GRID
- In the following examples we'll run on Zmumu datasets.
- This will be a brief introduction to GRID tools for those of you who already went through the trouble of getting a GRID certificate.
- First we should set up DQ2 tools:
source /afs/usatlas.bnl.gov/Grid/Don-Quijote/dq2_user_client/setup.csh.CERN
PANDA/PATHENA
- For further details visit panda wiki
- Setup PATHENA :
cd ~/scratch0/Workshop/12.0.2/PhysicsAnalysis/AnalysisCommon/UserAnalysis cvs update -r UserAnalysis-00-08-13 -A python cvs update -r UserAnalysis-00-08-13 -A share/pathena cvs update -r UserAnalysis-00-08-13 -A share/pathena_util cvs update -r UserAnalysis-00-08-13 -A share/ConfigExtractor.py cd cmt source setup.sh gmake cd ../run
- run pathena
Note: change user.GustavoOrdonezSanz.00008.AAN.root with an appropiate name!!
pathena ZmumuOnAOD_jobOptions.py --inDS 'csc11.005145.PythiaZmumu.recon.AOD.v11004103' --outDS \ 'user.GustavoOrdonezSanz.00008.AAN.root'
- For job status monitoring visit: Monitoring
GANGA
- For further details vistit ganga wiki
- A very simple example of how to use GANGA move to your ${HOME} directory and do:
source /afs/cern.ch/project/gd/LCG-share/sl3/etc/profile.d/grid_env.csh alias dq2 = /afs/cern.ch/atlas/offline/external/GRID/ddm/pro02/dq2 setenv LFC_HOST 'lfc-atlas-test.cern.ch' setenv LCG_CATALOG_TYPE lfc source /afs/usatlas.bnl.gov/Grid/Don-Quijote/dq2_user_client/setup.csh.CERN setenv PATH /afs/cern.ch/sw/ganga/install/slc3_gcc323/4.2.0-beta10/bin/:$PATH setenv GANGA_CONFIG_PATH GangaAtlas/Atlas.ini
- Generate a ${HOME}/.gangarc with
ganga -g
- Edit $HOME/.gangarc as follows:
1. In the section labelled [Configuration] add the line:
RUNTIME_PATH = GangaAtlas
2. In the section labelled [LCG] add the line:
VirtualOrganisation = atlas
- Now move to the run directory again. Note that you can run Ganga in a very similar way as you run pathena:
ganga athena --inDS csc11.005300.PythiaH130zz4l.recon.AOD.v11004103 \ --outputdata AnalysisSkeleton.aan.root \ --lsf --maxevt 100 \ AnalysisSkeleton_jobOptions.py
- Inside the Python interpreter:
j = Job() j.application=Athena() j.application.prepare() j.application.option_file='$HOME/scratch0/Workshop/12.0.2/PhysicsAnalysis/AnalysisCommon/UserAnalysis/run/ZmumuOnAOD_jobOptions.py' j.inputdata=DQ2Dataset() j.inputdata.type='DQ2_LOCAL' j.inputdata.dataset='csc11.005145.PythiaZmumu.recon.AOD.v11004103' j.outputdata=DQ2OutputDataset() j.outputdata.outputdata=['ZmumuOnAOD.aan.root'] j.backend=LCG() j.submit()
DQ2 Tools
- For furhter details visit DQ2 wiki
- This tools make your life easier when working on the GRID
dq2_ls *Zmumu*AOD*
- Have a look at the files contained in one of the sets
dq2_ls -f <datasetname>
- change user.GustavoOrdonezSanz.00008.AAN.root for your own
dq2_get -rv -d . user.GustavoOrdonezSanz.00008.AAN.root