Difference between revisions of "CommonNtuple"

From Atlas Wiki
Jump to navigation Jump to search
 
(12 intermediate revisions by 2 users not shown)
Line 6: Line 6:
 
   at nikhef: /data/atlas2/users/egge/MuonESDAnalysis/MuonswBeam/
 
   at nikhef: /data/atlas2/users/egge/MuonESDAnalysis/MuonswBeam/
  
−
processed datasets (status 9 June 2010):
+
correct BCID per run:
−
   data10_7TeV.00153565.physics_MuonswBeam.recon.ESD.r1297/
+
   /afs/cern.ch/user/s/salaman/correctBCID.txt
−
  data10_7TeV.00153599.physics_MuonswBeam.recon.ESD.r1297/
 
−
  data10_7TeV.00154810.physics_MuonswBeam.recon.ESD.r1297/
 
−
  data10_7TeV.00154813.physics_MuonswBeam.recon.ESD.r1297/
 
−
  data10_7TeV.00154815.physics_MuonswBeam.recon.ESD.r1297/
 
−
  data10_7TeV.00154817.physics_MuonswBeam.recon.ESD.r1297/
 
−
  data10_7TeV.00154822.physics_MuonswBeam.recon.ESD.r1299/
 
−
  data10_7TeV.00155073.physics_MuonswBeam.recon.ESD.r1299/
 
−
  data10_7TeV.00155112.physics_MuonswBeam.recon.ESD.r1299/
 
−
  data10_7TeV.00155116.physics_MuonswBeam.recon.ESD.r1299/
 
−
  data10_7TeV.00155160.physics_MuonswBeam.recon.ESD.r1299/
 
−
  data10_7TeV.00155228.physics_MuonswBeam.recon.ESD.f259
 
−
  data10_7TeV.00155280.physics_MuonswBeam.recon.ESD.f259
 
−
  data10_7TeV.00155569.physics_MuonswBeam.recon.ESD.f260
 
−
  data10_7TeV.00155634.physics_MuonswBeam.recon.ESD.f260
 
−
  data10_7TeV.00155669.physics_MuonswBeam.recon.ESD.f260
 
−
  data10_7TeV.00155678.physics_MuonswBeam.recon.ESD.f261
 
−
  data10_7TeV.00155697.physics_MuonswBeam.recon.ESD.f261
 
  
−
processing datasets:
+
'''30/06/2010: processed datasets:'''
−
   data10_7TeV.00153200.physics_MuonswBeam.merge.ESD.r1297_p161/
+
from GRL's for Z studies:
−
   data10_7TeV.00153159.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00152844MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00153136.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00152845MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00153134.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00152878MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00153030.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00152933MuonswBeam.outputMuonESDAnalysis.10.merged.2
−
   data10_7TeV.00152994.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00152994MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152933.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00153030MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152878.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00153134MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152845.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00153136MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152844.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00153159MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152777.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00153200MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152508.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00153565MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152441.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00153599MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152409.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00154810MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152345.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00154813MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152221.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00154815MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152214.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00154817MuonswBeam.outputMuonESDAnalysis.10.merged
−
   data10_7TeV.00152166.physics_MuonswBeam.merge.ESD.r1297_p161/
+
  user.eggevanderpoel.00154822MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155073MuonswBeam.outputMuonESDAnalysis.10.merged.2
 +
  user.eggevanderpoel.00155112MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155116MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155160MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155228MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00155280MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155569MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155634MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155669MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155678MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00155697MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00156682MuonswBeam.outputMuonESDAnalysis.10.merged
 +
 
 +
added for inclusive studies:
 +
   user.eggevanderpoel.00152166MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152214MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152221MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152345MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152409MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152441MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152508MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152777MuonswBeam.outputMuonESDAnalysis.10.merged
 +
 
 +
AND mc samples:
 +
   user.eggevanderpoel.mc09_7TeV.106052.PythiaZtautau.recon.ESD.e524_s774_s767_r1302.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.mc09_7TeV.108500.PythiaB_bbmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.mc09_7TeV.106047.PythiaZmumu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.mc09_7TeV.106044.PythiaWmunu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.mc09_7TeV.108501.PythiaB_ccmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 +
 
 +
'''01/07/2010: update with 158116'''
 +
new monster run (doubling our 7 TeV lumi) processed with 905/906 subjobs successful
 +
   user.eggevanderpoel.00158116MuonswBeam.outputMuonESDAnalysis.11.merged
 +
 
 +
'''stored at Nikhef:'''
 +
  /data/atlas3/users/egge/CommonNtuple
 +
 
 +
Pathena commands and pythons used:
 +
  /afs/cern.ch/user/e/egge/public/pathena/
 +
  contains readesdPathena.py
 +
   to submit job, do for example:
 +
  pathena readesdPathena.py --inDS=data10_7TeV.00154822.physics_MuonswBeam.recon.ESD.r1299/ --outDS=user.eggevanderpoel.0154822MuonswBeam.outputMuonESDAnalysis.1 --extOutFile=ntuple.root --nFilesPerJob=10 --dbRelease=LATEST
  
 
monte carlo at nikpc10:
 
monte carlo at nikpc10:
Line 51: Line 76:
 
short (PERSONAL) recipe how I got thing to work at lxplus:
 
short (PERSONAL) recipe how I got thing to work at lxplus:
 
   /afs/cern.ch/user/e/egge/public/instructionsMuonESDAnalysis.txt
 
   /afs/cern.ch/user/e/egge/public/instructionsMuonESDAnalysis.txt
−
 
−
Production is done on lxplus batch, using FileStager to retrieve ESD's from Grid.
 
−
An example of a batch job I run for production:
 
−
  #!/bin/zsh
 
−
  source /afs/cern.ch/atlas/project/muon/software/egge/15.6.9.13/setup.sh -tag=15.6.9.13,AtlasProduction
 
−
  source /afs/cern.ch/user/e/egge/grid.sh
 
−
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/readesdGrid.py .
 
−
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/an.py .
 
−
  cp -r /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/samples/ .
 
−
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/input_FileStager.py .
 
−
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/configureServices.py .
 
−
  ln -s samples/0155116_0.def sample.def
 
−
  athena -s readesdGrid.py >! log.l &
 
  
 
Action Items:
 
Action Items:
−
   Just as a summary, here are the action items from our meeting. I tried to put the names of the responsible person next to it:
+
   please add any issue
−
  1) Check that all the variables are in Egge's Ntuples:
 
−
      a) truth info (Michele->Egge)
 
−
      b) Alan's variables (Giuseppe->Egge)
 
−
  2) Check that all the needed MC/data is produced (all)
 
−
      If you're missing something, send an email to Egge stating the dq2 sample name and he will start if for you.
 
−
  3) For may-reprocessing data check that all the right LB's are used as given by MCP  (Alex)
 
−
  4) Ks->pi pi to validate the templates for decays-in-flight (Alex)
 
−
  5) MEETING FRIDAY 11 june at 10:00 (ALL)
 
−
      see Giuseppe's email for details
 
−
 
 
−
  ps. I understand that there were many more requests and action-items, but agreeing with Michele I do no think that it is feasible to finish all of that before friday/monday-tuesday MCP meetings, but feel free to add items to my list.
 

Latest revision as of 08:59, 21 July 2010

code: 

  https://svnweb.cern.ch/trac/atlasusr/browser/sandstro/CommonNtuple
  contains MuonESDAnalysis and MCPAnalysis

ntuples (output of MuonESDAnalysis): 

  at nikhef: /data/atlas2/users/egge/MuonESDAnalysis/MuonswBeam/

correct BCID per run: 

  /afs/cern.ch/user/s/salaman/correctBCID.txt

30/06/2010: processed datasets: from GRL's for Z studies: 

  user.eggevanderpoel.00152844MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152845MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152878MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152933MuonswBeam.outputMuonESDAnalysis.10.merged.2
  user.eggevanderpoel.00152994MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153030MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153134MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153136MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153159MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153200MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153565MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153599MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154810MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154813MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154815MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154817MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154822MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155073MuonswBeam.outputMuonESDAnalysis.10.merged.2
  user.eggevanderpoel.00155112MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155116MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155160MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155228MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155280MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155569MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155634MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155669MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155678MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155697MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00156682MuonswBeam.outputMuonESDAnalysis.10.merged

added for inclusive studies: 

  user.eggevanderpoel.00152166MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152214MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152221MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152345MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152409MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152441MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152508MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152777MuonswBeam.outputMuonESDAnalysis.10.merged

AND mc samples: 

  user.eggevanderpoel.mc09_7TeV.106052.PythiaZtautau.recon.ESD.e524_s774_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.108500.PythiaB_bbmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.106047.PythiaZmumu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.106044.PythiaWmunu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.108501.PythiaB_ccmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged

01/07/2010: update with 158116 new monster run (doubling our 7 TeV lumi) processed with 905/906 subjobs successful 

  user.eggevanderpoel.00158116MuonswBeam.outputMuonESDAnalysis.11.merged

stored at Nikhef: 

  /data/atlas3/users/egge/CommonNtuple

Pathena commands and pythons used: 

  /afs/cern.ch/user/e/egge/public/pathena/
  contains readesdPathena.py
  to submit job, do for example:
  pathena readesdPathena.py --inDS=data10_7TeV.00154822.physics_MuonswBeam.recon.ESD.r1299/ --outDS=user.eggevanderpoel.0154822MuonswBeam.outputMuonESDAnalysis.1 --extOutFile=ntuple.root --nFilesPerJob=10 --dbRelease=LATEST

monte carlo at nikpc10: 

  /data/sandstro/NTUP/MC/

short (PERSONAL) recipe how I got thing to work at lxplus: 

  /afs/cern.ch/user/e/egge/public/instructionsMuonESDAnalysis.txt

Action Items: 

  please add any issue
Retrieved from "https://wiki.nikhef.nl/atlas/index.php?title=CommonNtuple&oldid=4846"