Difference between revisions of "CommonNtuple"

From Atlas Wiki
Jump to navigation Jump to search
Line 6: Line 6:
 
   at nikhef: /data/atlas2/users/egge/MuonESDAnalysis/MuonswBeam/
 
   at nikhef: /data/atlas2/users/egge/MuonESDAnalysis/MuonswBeam/
  
'''24/06/2010: processing new datasets (not complete set yet... I know...):'''
+
'''24/06/2010: processing new datasets (from GRL info for Z studies):'''
   search for dq2-ls "user.eggevanderpoel*.10.merged"
+
   search for dq2-ls "user.eggevanderpoel.00*.10.merged"
 +
  user.eggevanderpoel.00155280MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00154822MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155669MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00152994MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00152933MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155116MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00152845MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00156682MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155160MuonswBeam.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.00155569MuonswBeam.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.00155569MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00153565MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00154815MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155697MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155678MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155634MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00153159MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155228MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00153136MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00153599MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00152878MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00153030MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00152844MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00154813MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155073MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00153200MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00154817MuonswBeam.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.00155112MuonswBeam.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.00155112MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00154810MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00153134MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  and after some problems:
 +
  user.eggevanderpoel.00152933MuonswBeam.outputMuonESDAnalysis.10.merged.2
 +
  user.eggevanderpoel.00155073MuonswBeam.outputMuonESDAnalysis.10.merged.2
 +
  AND mc samples:
 
   user.eggevanderpoel.mc09_7TeV.106052.PythiaZtautau.recon.ESD.e524_s774_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.106052.PythiaZtautau.recon.ESD.e524_s774_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.108500.PythiaB_bbmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.108500.PythiaB_bbmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00155678MuonswBeam.outputMuonESDAnalysis.10.merged
+
   user.eggevanderpoel.mc09_7TeV.106047.PythiaZmumu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.106044.PythiaWmunu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.106044.PythiaWmunu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.108501.PythiaB_ccmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.108501.PythiaB_ccmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.106047.PythiaZmumu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
+
 
'''to be stored later at Nikhef:'''
+
'''stored at Nikhef:'''
 
   /data/atlas3/users/egge/CommonNtuple
 
   /data/atlas3/users/egge/CommonNtuple
  

Revision as of 13:45, 25 June 2010

code:

  https://svnweb.cern.ch/trac/atlasusr/browser/sandstro/CommonNtuple
  contains MuonESDAnalysis and MCPAnalysis

ntuples (output of MuonESDAnalysis):

  at nikhef: /data/atlas2/users/egge/MuonESDAnalysis/MuonswBeam/

24/06/2010: processing new datasets (from GRL info for Z studies):

  search for dq2-ls "user.eggevanderpoel.00*.10.merged"
  user.eggevanderpoel.00155280MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154822MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155669MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152994MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152933MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155116MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152845MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00156682MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155160MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155569MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153565MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154815MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155697MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155678MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155634MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153159MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155228MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153136MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153599MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152878MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153030MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152844MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154813MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155073MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153200MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154817MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155112MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154810MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153134MuonswBeam.outputMuonESDAnalysis.10.merged
  and after some problems:
  user.eggevanderpoel.00152933MuonswBeam.outputMuonESDAnalysis.10.merged.2
  user.eggevanderpoel.00155073MuonswBeam.outputMuonESDAnalysis.10.merged.2
  AND mc samples:
  user.eggevanderpoel.mc09_7TeV.106052.PythiaZtautau.recon.ESD.e524_s774_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.108500.PythiaB_bbmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.106047.PythiaZmumu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.106044.PythiaWmunu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.108501.PythiaB_ccmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged

stored at Nikhef:

  /data/atlas3/users/egge/CommonNtuple

Pathena commands and pythons used:

  /afs/cern.ch/user/e/egge/public/pathena/
  contains readesdPathena.py
  to submit job, do for example:
  pathena readesdPathena.py --inDS=data10_7TeV.00154822.physics_MuonswBeam.recon.ESD.r1299/ --outDS=user.eggevanderpoel.0154822MuonswBeam.outputMuonESDAnalysis.1 --extOutFile=ntuple.root --nFilesPerJob=10 --dbRelease=LATEST

processed datasets (status 9 June 2010):

  data10_7TeV.00153565.physics_MuonswBeam.recon.ESD.r1297/
  data10_7TeV.00153599.physics_MuonswBeam.recon.ESD.r1297/
  data10_7TeV.00154810.physics_MuonswBeam.recon.ESD.r1297/
  data10_7TeV.00154813.physics_MuonswBeam.recon.ESD.r1297/
  data10_7TeV.00154815.physics_MuonswBeam.recon.ESD.r1297/
  data10_7TeV.00154817.physics_MuonswBeam.recon.ESD.r1297/
  data10_7TeV.00154822.physics_MuonswBeam.recon.ESD.r1299/
  data10_7TeV.00155073.physics_MuonswBeam.recon.ESD.r1299/
  data10_7TeV.00155112.physics_MuonswBeam.recon.ESD.r1299/
  data10_7TeV.00155116.physics_MuonswBeam.recon.ESD.r1299/
  data10_7TeV.00155160.physics_MuonswBeam.recon.ESD.r1299/
  data10_7TeV.00155228.physics_MuonswBeam.recon.ESD.f259
  data10_7TeV.00155280.physics_MuonswBeam.recon.ESD.f259
  data10_7TeV.00155569.physics_MuonswBeam.recon.ESD.f260
  data10_7TeV.00155634.physics_MuonswBeam.recon.ESD.f260
  data10_7TeV.00155669.physics_MuonswBeam.recon.ESD.f260
  data10_7TeV.00155678.physics_MuonswBeam.recon.ESD.f261
  data10_7TeV.00155697.physics_MuonswBeam.recon.ESD.f261

additionally requested to complete MCP GRL:

  data10_7TeV.00153200.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00153159.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00153136.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00153030.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152994.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152878.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152845.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152844.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152777.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152508.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152441.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152409.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152345.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152221.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152214.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152166.physics_MuonswBeam.merge.ESD.r1297_p161/

processing datasets:

  data10_7TeV.00153134.physics_MuonswBeam.merge.ESD.r1297_p161/
  data10_7TeV.00152933.physics_MuonswBeam.merge.ESD.r1297_p161/
  mc09_7TeV.105802.JF17_pythia_jet_filter.recon.ESD.e505_s765_s767_r1302

monte carlo at nikpc10:

  /data/sandstro/NTUP/MC/

short (PERSONAL) recipe how I got thing to work at lxplus:

  /afs/cern.ch/user/e/egge/public/instructionsMuonESDAnalysis.txt

Production is done on lxplus batch, using FileStager to retrieve ESD's from Grid. An example of a batch job I run for production:

  #!/bin/zsh
  source /afs/cern.ch/atlas/project/muon/software/egge/15.6.9.13/setup.sh -tag=15.6.9.13,AtlasProduction
  source /afs/cern.ch/user/e/egge/grid.sh
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/readesdGrid.py .
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/an.py .
  cp -r /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/samples/ .
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/input_FileStager.py .
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/configureServices.py .
  ln -s samples/0155116_0.def sample.def
  athena -s readesdGrid.py >! log.l &

Notice that in an.py you have to change this line:

 include("/afs/cern.ch/atlas/project/muon/software/egge//15.6.9.13/InstallArea/python/MuonCombinedSelectorTools/LowPtMuonSelectorToolConfig.py")

with the following, before running:

 include("$TestArea/InstallArea/python/MuonCombinedSelectorTools/LowPtMuonSelectorToolConfig.py") 

Action Items:

  Just as a summary, here are the action items from our meeting. I tried to put the names of the responsible person next to it:
  1) Check that all the variables are in Egge's Ntuples:
     a) truth info (Michele->Egge)
     b) Alan's variables (Giuseppe->Egge)
  2) Check that all the needed MC/data is produced (all)
     If you're missing something, send an email to Egge stating the dq2 sample name and he will start if for you.
  3) For may-reprocessing data check that all the right LB's are used as given by MCP   (Alex)
  4) Ks->pi pi to validate the templates for decays-in-flight (Alex)
  5) MEETING FRIDAY 11 june at 10:00 (ALL)
     see Giuseppe's email for details
  ps. I understand that there were many more requests and action-items, but agreeing with Michele I do no think that it is feasible to finish all of that before friday/monday-tuesday MCP meetings, but feel free to add items to my list.