Access to data at NIKHEF tier
Jump to navigation
Jump to search
NOTE: For all this a Grid certificate [1] is required.
Introduction
There are maybe multiple ways to access data on the LCG. Though the two methods explained here are via LFC (LCG File Catalog) and SRM (Storage Resource Management). I'm just documenting what I didn't know. So please, correct things if they are wrong!
- The LFC is the file catalog at a Grid site that stores the information on which site a file can be found. This means, for example, that a file registered in the NIKHEF LFC, might be stored for at a CERN SE (Storage Element).
- SRM is a procotol that enables file access only at a specific SE. At NIKHEF, DPM (Disk Pool Manager) is used for the SRM interface. (dCache being the other solution, used at eg. Fermilab).
LFC
Everytime you start a new session, you need to setup the environment for Grid access:
source /global/ices/lcg/current/etc/profile.d/grid_env.csh grid-proxy-init
The next two variables are mandatory to set:
setenv LFC_HOST mu11.matrix.sara.nl setenv VO_DEFAULT_SE tbn18.nikhef.nl
The CERN LFC host lcf-atlas-test.cern.ch could be used instead need to check what's best.
Details on the available commands can be found in here.
- show the contents of a directory:
lfc-ls /grid/atlas - copy file from Grid to local file:
lcg-cp -v --vo atlas lfn:/grid/atlas/MYFILE file:/tmp/MYFILE
SRM/DPM/DPNS
To access files on the NIKHEF SE directly, the following two variables should be set:
setenv DPM_HOST tbn18.nikhef.nl setenv DPNS_HOST tbn18.nikhef.nl
The next two commands are handy:
- To have a directory listing:
dpns-ls -l /dpm/nikhef.nl/home/atlas/MYFILE - To copy a file:
srmcp srm://tbn18.nikhef.nl:8443/dpm/nikhef.nl/home/atlas/MYFILE file:////tmp/MYFILE
Note the four slashes!