Difference between revisions of "CommonNtuple"

From Atlas Wiki
Jump to navigation Jump to search
 
(5 intermediate revisions by one other user not shown)
Line 6: Line 6:
 
   at nikhef: /data/atlas2/users/egge/MuonESDAnalysis/MuonswBeam/
 
   at nikhef: /data/atlas2/users/egge/MuonESDAnalysis/MuonswBeam/
  
'''24/06/2010: processing new datasets (from GRL info for Z studies):'''
+
correct BCID per run:
   search for dq2-ls "user.eggevanderpoel.00*.10.merged"
+
  /afs/cern.ch/user/s/salaman/correctBCID.txt
   user.eggevanderpoel.00155280MuonswBeam.outputMuonESDAnalysis.10.merged
+
 
   user.eggevanderpoel.00154822MuonswBeam.outputMuonESDAnalysis.10.merged
+
'''30/06/2010: processed datasets:'''
   user.eggevanderpoel.00155669MuonswBeam.outputMuonESDAnalysis.10.merged
+
from GRL's for Z studies:
 +
   user.eggevanderpoel.00152844MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152845MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152878MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152933MuonswBeam.outputMuonESDAnalysis.10.merged.2
 
   user.eggevanderpoel.00152994MuonswBeam.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.00152994MuonswBeam.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00152933MuonswBeam.outputMuonESDAnalysis.10.merged
+
   user.eggevanderpoel.00153030MuonswBeam.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00155116MuonswBeam.outputMuonESDAnalysis.10.merged
+
   user.eggevanderpoel.00153134MuonswBeam.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00152845MuonswBeam.outputMuonESDAnalysis.10.merged
+
   user.eggevanderpoel.00153136MuonswBeam.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00156682MuonswBeam.outputMuonESDAnalysis.10.merged
+
   user.eggevanderpoel.00153159MuonswBeam.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00155160MuonswBeam.outputMuonESDAnalysis.10.merged
+
   user.eggevanderpoel.00153200MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155569MuonswBeam.outputMuonESDAnalysis.10.merged
 
 
   user.eggevanderpoel.00153565MuonswBeam.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.00153565MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154815MuonswBeam.outputMuonESDAnalysis.10.merged
 
  user.eggevanderpoel.00155697MuonswBeam.outputMuonESDAnalysis.10.merged
 
  user.eggevanderpoel.00155678MuonswBeam.outputMuonESDAnalysis.10.merged
 
  user.eggevanderpoel.00155634MuonswBeam.outputMuonESDAnalysis.10.merged
 
  user.eggevanderpoel.00153159MuonswBeam.outputMuonESDAnalysis.10.merged
 
  user.eggevanderpoel.00155228MuonswBeam.outputMuonESDAnalysis.10.merged
 
  user.eggevanderpoel.00153136MuonswBeam.outputMuonESDAnalysis.10.merged
 
 
   user.eggevanderpoel.00153599MuonswBeam.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.00153599MuonswBeam.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00152878MuonswBeam.outputMuonESDAnalysis.10.merged
+
   user.eggevanderpoel.00154810MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153030MuonswBeam.outputMuonESDAnalysis.10.merged
 
  user.eggevanderpoel.00152844MuonswBeam.outputMuonESDAnalysis.10.merged
 
 
   user.eggevanderpoel.00154813MuonswBeam.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.00154813MuonswBeam.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00155073MuonswBeam.outputMuonESDAnalysis.10.merged
+
   user.eggevanderpoel.00154815MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153200MuonswBeam.outputMuonESDAnalysis.10.merged
 
 
   user.eggevanderpoel.00154817MuonswBeam.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.00154817MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00154822MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155073MuonswBeam.outputMuonESDAnalysis.10.merged.2
 
   user.eggevanderpoel.00155112MuonswBeam.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.00155112MuonswBeam.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00154810MuonswBeam.outputMuonESDAnalysis.10.merged
+
   user.eggevanderpoel.00155116MuonswBeam.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00153134MuonswBeam.outputMuonESDAnalysis.10.merged
+
   user.eggevanderpoel.00155160MuonswBeam.outputMuonESDAnalysis.10.merged
   and after some problems:
+
   user.eggevanderpoel.00155228MuonswBeam.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00152933MuonswBeam.outputMuonESDAnalysis.10.merged.2
+
  user.eggevanderpoel.00155280MuonswBeam.outputMuonESDAnalysis.10.merged
   user.eggevanderpoel.00155073MuonswBeam.outputMuonESDAnalysis.10.merged.2
+
  user.eggevanderpoel.00155569MuonswBeam.outputMuonESDAnalysis.10.merged
   AND mc samples:
+
  user.eggevanderpoel.00155634MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155669MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155678MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00155697MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00156682MuonswBeam.outputMuonESDAnalysis.10.merged
 +
 
 +
added for inclusive studies:
 +
   user.eggevanderpoel.00152166MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00152214MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152221MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00152345MuonswBeam.outputMuonESDAnalysis.10.merged
 +
   user.eggevanderpoel.00152409MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00152441MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00152508MuonswBeam.outputMuonESDAnalysis.10.merged
 +
  user.eggevanderpoel.00152777MuonswBeam.outputMuonESDAnalysis.10.merged
 +
 
 +
AND mc samples:
 
   user.eggevanderpoel.mc09_7TeV.106052.PythiaZtautau.recon.ESD.e524_s774_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.106052.PythiaZtautau.recon.ESD.e524_s774_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.108500.PythiaB_bbmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.108500.PythiaB_bbmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
Line 46: Line 57:
 
   user.eggevanderpoel.mc09_7TeV.106044.PythiaWmunu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.106044.PythiaWmunu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.108501.PythiaB_ccmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 
   user.eggevanderpoel.mc09_7TeV.108501.PythiaB_ccmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
 +
 +
'''01/07/2010: update with 158116'''
 +
new monster run (doubling our 7 TeV lumi) processed with 905/906 subjobs successful
 +
  user.eggevanderpoel.00158116MuonswBeam.outputMuonESDAnalysis.11.merged
  
 
'''stored at Nikhef:'''
 
'''stored at Nikhef:'''
Line 55: Line 70:
 
   to submit job, do for example:
 
   to submit job, do for example:
 
   pathena readesdPathena.py --inDS=data10_7TeV.00154822.physics_MuonswBeam.recon.ESD.r1299/ --outDS=user.eggevanderpoel.0154822MuonswBeam.outputMuonESDAnalysis.1 --extOutFile=ntuple.root --nFilesPerJob=10 --dbRelease=LATEST
 
   pathena readesdPathena.py --inDS=data10_7TeV.00154822.physics_MuonswBeam.recon.ESD.r1299/ --outDS=user.eggevanderpoel.0154822MuonswBeam.outputMuonESDAnalysis.1 --extOutFile=ntuple.root --nFilesPerJob=10 --dbRelease=LATEST
 
processed datasets (status 9 June 2010):
 
  data10_7TeV.00153565.physics_MuonswBeam.recon.ESD.r1297/
 
  data10_7TeV.00153599.physics_MuonswBeam.recon.ESD.r1297/
 
  data10_7TeV.00154810.physics_MuonswBeam.recon.ESD.r1297/
 
  data10_7TeV.00154813.physics_MuonswBeam.recon.ESD.r1297/
 
  data10_7TeV.00154815.physics_MuonswBeam.recon.ESD.r1297/
 
  data10_7TeV.00154817.physics_MuonswBeam.recon.ESD.r1297/
 
  data10_7TeV.00154822.physics_MuonswBeam.recon.ESD.r1299/
 
  data10_7TeV.00155073.physics_MuonswBeam.recon.ESD.r1299/
 
  data10_7TeV.00155112.physics_MuonswBeam.recon.ESD.r1299/
 
  data10_7TeV.00155116.physics_MuonswBeam.recon.ESD.r1299/
 
  data10_7TeV.00155160.physics_MuonswBeam.recon.ESD.r1299/
 
  data10_7TeV.00155228.physics_MuonswBeam.recon.ESD.f259
 
  data10_7TeV.00155280.physics_MuonswBeam.recon.ESD.f259
 
  data10_7TeV.00155569.physics_MuonswBeam.recon.ESD.f260
 
  data10_7TeV.00155634.physics_MuonswBeam.recon.ESD.f260
 
  data10_7TeV.00155669.physics_MuonswBeam.recon.ESD.f260
 
  data10_7TeV.00155678.physics_MuonswBeam.recon.ESD.f261
 
  data10_7TeV.00155697.physics_MuonswBeam.recon.ESD.f261
 
 
additionally requested to complete MCP GRL:
 
  data10_7TeV.00153200.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00153159.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00153136.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00153030.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152994.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152878.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152845.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152844.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152777.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152508.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152441.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152409.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152345.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152221.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152214.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152166.physics_MuonswBeam.merge.ESD.r1297_p161/
 
 
processing datasets:
 
  data10_7TeV.00153134.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  data10_7TeV.00152933.physics_MuonswBeam.merge.ESD.r1297_p161/
 
  mc09_7TeV.105802.JF17_pythia_jet_filter.recon.ESD.e505_s765_s767_r1302
 
  
 
monte carlo at nikpc10:
 
monte carlo at nikpc10:
Line 104: Line 76:
 
short (PERSONAL) recipe how I got thing to work at lxplus:
 
short (PERSONAL) recipe how I got thing to work at lxplus:
 
   /afs/cern.ch/user/e/egge/public/instructionsMuonESDAnalysis.txt
 
   /afs/cern.ch/user/e/egge/public/instructionsMuonESDAnalysis.txt
 
Production is done on lxplus batch, using FileStager to retrieve ESD's from Grid.
 
An example of a batch job I run for production:
 
  #!/bin/zsh
 
  source /afs/cern.ch/atlas/project/muon/software/egge/15.6.9.13/setup.sh -tag=15.6.9.13,AtlasProduction
 
  source /afs/cern.ch/user/e/egge/grid.sh
 
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/readesdGrid.py .
 
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/an.py .
 
  cp -r /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/samples/ .
 
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/input_FileStager.py .
 
  cp /afs/cern.ch/user/e/egge/public/MuonESDAnalysis/configureServices.py .
 
  ln -s samples/0155116_0.def sample.def
 
  athena -s readesdGrid.py >! log.l &
 
 
Notice that in an.py you have to change this line:
 
 
  include("/afs/cern.ch/atlas/project/muon/software/egge//15.6.9.13/InstallArea/python/MuonCombinedSelectorTools/LowPtMuonSelectorToolConfig.py")
 
 
with the following, before running:
 
 
  include("$TestArea/InstallArea/python/MuonCombinedSelectorTools/LowPtMuonSelectorToolConfig.py")
 
  
 
Action Items:
 
Action Items:
   Just as a summary, here are the action items from our meeting. I tried to put the names of the responsible person next to it:
+
   please add any issue
  1) Check that all the variables are in Egge's Ntuples:
 
      a) truth info (Michele->Egge)
 
      b) Alan's variables (Giuseppe->Egge)
 
  2) Check that all the needed MC/data is produced (all)
 
      If you're missing something, send an email to Egge stating the dq2 sample name and he will start if for you.
 
  3) For may-reprocessing data check that all the right LB's are used as given by MCP  (Alex)
 
  4) Ks->pi pi to validate the templates for decays-in-flight (Alex)
 
  5) MEETING FRIDAY 11 june at 10:00 (ALL)
 
      see Giuseppe's email for details
 
 
 
  ps. I understand that there were many more requests and action-items, but agreeing with Michele I do no think that it is feasible to finish all of that before friday/monday-tuesday MCP meetings, but feel free to add items to my list.
 

Latest revision as of 09:59, 21 July 2010

code:

  https://svnweb.cern.ch/trac/atlasusr/browser/sandstro/CommonNtuple
  contains MuonESDAnalysis and MCPAnalysis

ntuples (output of MuonESDAnalysis):

  at nikhef: /data/atlas2/users/egge/MuonESDAnalysis/MuonswBeam/

correct BCID per run:

  /afs/cern.ch/user/s/salaman/correctBCID.txt

30/06/2010: processed datasets: from GRL's for Z studies:

  user.eggevanderpoel.00152844MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152845MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152878MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152933MuonswBeam.outputMuonESDAnalysis.10.merged.2
  user.eggevanderpoel.00152994MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153030MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153134MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153136MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153159MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153200MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153565MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00153599MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154810MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154813MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154815MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154817MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00154822MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155073MuonswBeam.outputMuonESDAnalysis.10.merged.2
  user.eggevanderpoel.00155112MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155116MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155160MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155228MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155280MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155569MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155634MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155669MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155678MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00155697MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00156682MuonswBeam.outputMuonESDAnalysis.10.merged

added for inclusive studies:

  user.eggevanderpoel.00152166MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152214MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152221MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152345MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152409MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152441MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152508MuonswBeam.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.00152777MuonswBeam.outputMuonESDAnalysis.10.merged

AND mc samples:

  user.eggevanderpoel.mc09_7TeV.106052.PythiaZtautau.recon.ESD.e524_s774_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.108500.PythiaB_bbmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.106047.PythiaZmumu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.106044.PythiaWmunu_no_filter.recon.ESD.e468_s765_s767_r1302.outputMuonESDAnalysis.10.merged
  user.eggevanderpoel.mc09_7TeV.108501.PythiaB_ccmu0mu0X.recon.ESD.e554_s765_s767_r1302.outputMuonESDAnalysis.10.merged

01/07/2010: update with 158116 new monster run (doubling our 7 TeV lumi) processed with 905/906 subjobs successful

  user.eggevanderpoel.00158116MuonswBeam.outputMuonESDAnalysis.11.merged

stored at Nikhef:

  /data/atlas3/users/egge/CommonNtuple

Pathena commands and pythons used:

  /afs/cern.ch/user/e/egge/public/pathena/
  contains readesdPathena.py
  to submit job, do for example:
  pathena readesdPathena.py --inDS=data10_7TeV.00154822.physics_MuonswBeam.recon.ESD.r1299/ --outDS=user.eggevanderpoel.0154822MuonswBeam.outputMuonESDAnalysis.1 --extOutFile=ntuple.root --nFilesPerJob=10 --dbRelease=LATEST

monte carlo at nikpc10:

  /data/sandstro/NTUP/MC/

short (PERSONAL) recipe how I got thing to work at lxplus:

  /afs/cern.ch/user/e/egge/public/instructionsMuonESDAnalysis.txt

Action Items:

  please add any issue