Difference between revisions of "Access to data at NIKHEF tier"

From Atlas Wiki
Jump to navigation Jump to search
 
(2 intermediate revisions by the same user not shown)
Line 17: Line 17:
 
The next two variables are mandatory to set:
 
The next two variables are mandatory to set:
 
<pre>
 
<pre>
setenv LFC_HOST mu11.matrix.sara.nl
+
setenv LFC_HOST lfc03.nikhef.nl
 
setenv VO_DEFAULT_SE tbn18.nikhef.nl
 
setenv VO_DEFAULT_SE tbn18.nikhef.nl
 
</pre>
 
</pre>
The CERN Atlas LFC host <tt>lfc-atlas-test.cern.ch</tt> could be used instead <i><font color=red>need to check what's best</font></i>.
+
The CERN Atlas LFC host <tt>prod-lfc-atlas-central.cern.ch</tt> or SARA <tt>mu11.matrix.sara.nl</tt> could be used instead. <tt>lfc-atlas-test.cern.ch</tt> seems to be discouraged by the Grid people. <i><font color=red>need to check what's best</font></i>.
  
 
Details on the available commands can be found in [http://egee.itep.ru/User_Guide.html here].
 
Details on the available commands can be found in [http://egee.itep.ru/User_Guide.html here].

Latest revision as of 15:45, 3 May 2007

NOTE: For all this a Grid certificate [1] is required.

Introduction

There are maybe multiple ways to access data on the LCG. Though the two methods explained here are via LFC (LCG File Catalog) and SRM (Storage Resource Management). I'm just documenting what I didn't know. So please, correct things if they are wrong!

  • The LFC is the file catalog at a Grid site that stores the information on which site a file can be found. This means, for example, that a file registered in the NIKHEF LFC, might be stored for at a CERN SE (Storage Element).
  • SRM is a procotol that enables file access only at a specific SE. At NIKHEF, DPM (Disk Pool Manager) is used for the SRM interface. (dCache being the other solution, used at eg. Fermilab).

LFC

Everytime you start a new session, you need to setup the environment for Grid access:

source /global/ices/lcg/current/etc/profile.d/grid_env.csh
grid-proxy-init

The next two variables are mandatory to set:

setenv LFC_HOST lfc03.nikhef.nl
setenv VO_DEFAULT_SE tbn18.nikhef.nl

The CERN Atlas LFC host prod-lfc-atlas-central.cern.ch or SARA mu11.matrix.sara.nl could be used instead. lfc-atlas-test.cern.ch seems to be discouraged by the Grid people. need to check what's best.

Details on the available commands can be found in here.

  • show the contents of a directory:
    lfc-ls /grid/atlas
  • copy file from Grid to local file:
    lcg-cp -v --vo atlas lfn:/grid/atlas/MYFILE file:/tmp/MYFILE

SRM/DPM/DPNS

To access files on the NIKHEF SE directly, the following two variables should be set:

setenv DPM_HOST tbn18.nikhef.nl
setenv DPNS_HOST tbn18.nikhef.nl

The next two commands are handy:

  • To have a directory listing:
    dpns-ls -l /dpm/nikhef.nl/home/atlas/MYFILE
  • To copy a file:
    srmcp srm://tbn18.nikhef.nl:8443/dpm/nikhef.nl/home/atlas/MYFILE file:////tmp/MYFILE
    Note the four slashes!