AMA on Stoomboot 14 2 22

From Atlas Wiki
Revision as of 16:06, 9 October 2008 by Eggevdp (talk | contribs)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Running at Nikhef on SARA ESDs

Below is a (personal) recipe to run on ESDs at Nikhef. For now, it runs when logged on interactively to Stoomboot. Submitting a job to the Stoomboot batch is still being validated.

From your local desktop log in to Stoomboot:

qsub -X -I -q qlong


Go to your working area and make a working directory bash cd /project/atlas/users/egge/testarea/ mkdir twiki cd twiki mkdir 14.2.22

Create a requirements file, for example set CMTSITE STANDALONE set SITEROOT /data/atlas/offline/14.2.22 macro ATLAS_TEST_AREA /project/atlas/users/egge/testarea/twiki macro ATLAS_DIST_AREA ${SITEROOT} macro SITE_PROJECT_AREA ${SITEROOT} macro EXTERNAL_PROJECT_AREA ${SITEROOT} apply_tag opt apply_tag setup apply_tag simpleTest apply_tag 14.2.22 apply_tag 32 apply_tag runtime use AtlasLogin AtlasLogin-* $(ATLAS_DIST_AREA) set CMTCONFIG i686-slc4-gcc34-opt

Then source /data/atlas/offline/14.2.22/CMT/v1r20p20080222/mgr/setup.sh cmt config


The following two lines should be done every next time to set up 14.2.22 cd /project/atlas/users/egge/testarea/twiki/14.2.22/ source setup.sh


To be able to checkout AMA from CERN /usr/kerberos/bin/kinit -5 egge@CERN.CH

Then actually checkout AMA cmt co -r AMACore-00-00-02-01 PhysicsAnalysis/AnalysisCommon/AMA/AMACore cmt co -r AMAAthena-00-00-07 PhysicsAnalysis/AnalysisCommon/AMA/AMAAthena

and compile cd PhysicsAnalysis/AnalysisCommon/AMA/AMAAthena/cmt cmt br gmake


In ANOTHER shell: set up dq2 source /project/atlas/nikhef/dq2/dq2_setup.sh.NIKHEF voms-proxy-init -voms atlas

Check if all is ok with voms-proxy-info -all

To see what SARA destinations exist dq2-destinations | grep "SARA"

To my knowledge SARA-MATRIX_DATADISK is the one to use (experts, please comment). To see the available (complete) datasets on SARA-MATRIX_DATADISK dq2-list-dataset-site -c SARA-MATRIX_DATADISK

Let's take "data08_cosmag.00090721.physics_MBTS_BCM_LUCID.recon.ESD.o4_f70" as an example cd /project/atlas/users/egge/testarea/twiki/14.2.22/PhysicsAnalysis/AnalysisCommon/AMA/AMAAthena/ define_dq2_sample -n cosmag90721 data08_cosmag.00090721.physics_MBTS_BCM_LUCID.recon.ESD.o4_f70 SARA-MATRIX_DATADISK

Back in Stoomboot shell. Also setup Grid here cd /project/atlas/users/egge/testarea/twiki/14.2.22/PhysicsAnalysis/AnalysisCommon/AMA/AMAAthena/ source /project/atlas/nikhef/dq2/dq2_setup.sh.NIKHEF voms-proxy-init -voms atlas

The warning "bash: /afs/cern.ch/atlas/offline/external/GRID/ddm/DQ2Clients/latest/setup.sh: No such file or directory" seems to be harmless.

AFTER setting up Grid on Stoomboot ALWAYS do unset PYTHONPATH source /project/atlas/users/egge/testarea/twiki/setup.sh export TMPDIR=/tmpdir

Modify the following in "share/AMAAthena_jobOptionsESD.py" EvtMax = 1000 sampleFile = "samples/cosmag90721.def" # File with input collections

Then copy "share/input_FileStagerRFCP" to "share/input_FileStager.py" and implement the following in "share/input_FileStager.py" #stagetool.CpCommand = "rfcp"

  1. stagetool.CpArguments = []
  2. stagetool.OutfilePrefix = ""

stagetool.checkGridProxy = False

...

svcMgr.EventSelector.SkipBadFiles = True

Then all should be ready to run the job cd /project/atlas/users/egge/testarea/twiki/14.2.22/PhysicsAnalysis/AnalysisCommon/AMA/AMAAthena athena -s share/AMAAthena_jobOptionsESD.py

Retrieved from "https://wiki.nikhef.nl/atlas/index.php?title=AMA_on_Stoomboot_14_2_22&oldid=2535"