Difference between revisions of "Grid@Nikhef"

From PDP/Grid Wiki
Jump to navigationJump to search
Line 1: Line 1:
The EGI / WLCG grid infrastructure can be accessed from any Nikhef-managed machine running a variant of Red Hat Enterprise Linux 6 (e.g. Scientific Linux 6, CentOS 6). In order to use the grid middleware tools, type
+
The EGI / WLCG grid infrastructure can be accessed from any Nikhef-managed machine running a variant of Red Hat Enterprise Linux 6 or higher (e.g. CentOS 6 or 7). In order to use the grid middleware tools, type
 
   source /cvmfs/grid.cern.ch/etc/profile.d/setup-cvmfs-ui.sh        ## bash/ksh/zsh
 
   source /cvmfs/grid.cern.ch/etc/profile.d/setup-cvmfs-ui.sh        ## bash/ksh/zsh
 
first. Csh users will have to first run
 
first. Csh users will have to first run
Line 21: Line 21:
  
 
Congratulations! You are now ready to use grid middleware tools.
 
Congratulations! You are now ready to use grid middleware tools.
 +
 +
 +
== Submitting your job ==
 +
 +
General queues and walltimes available:
 +
 +
{| class="wikitable"
 +
|-
 +
! Queue Name ||  Max. Walltime (hh:mm:ss) || Allowed VOs
 +
|-
 +
| short ||  04:00:00 || alice atlas dans projects.nl pvier virgo dune lsgrid lofar tutor enmr.eu bbmri.nl xenon.biggrid.nl chem.biggrid.nl drihm.eu
 +
|-
 +
| medium || 36:00:00 || alice atlas dans projects.nl pvier virgo dune lsgrid lofar tutor enmr.eu bbmri.nl xenon.biggrid.nl chem.biggrid.nl drihm.eu
 +
|-
 +
| long || 96:00:00  || alice atlas dans projects.nl pvier virgo dune lsgrid lofar tutor bbmri.nl xenon.biggrid.nl chem.biggrid.nl drihm.eu
 +
|-
 +
|}
 +
 +
 +
For more information or find other queues, use lcg-info or lcg-infosites which will give you more information about what is available to your VO. For example,
 +
 +
lcg-infosites --vo pvier -f NIKHEF-ELPROD all
 +
 +
Commands to start running your job can look something like:
 +
 +
# Delegate your proxy to an endpoint (-e) with a string to identify your proxy delegation
 +
glite-ce-delegate-proxy -e [CREAM-CE_SERVER]l:8443 [STRING]
 +
 +
# Submit your job to a resource (-r) queue with the output (-o) going to a directory (jids)
 +
# using the delegation ID string in the previous command and finally adding the job descritpion file (JDL) for your job.
 +
glite-ce-job-submit -r [CREAM-CE_SERVER]:8443/cream-pbs-[QUEUE] -o jids -D [STRING] [JDL-FILE.JDL]
 +
 +
# Check the status of your job...
 +
glite-ce-job-status https://[CREAM-CE_SERVER]:8443/[JOBID]

Revision as of 14:24, 12 September 2019

The EGI / WLCG grid infrastructure can be accessed from any Nikhef-managed machine running a variant of Red Hat Enterprise Linux 6 or higher (e.g. CentOS 6 or 7). In order to use the grid middleware tools, type

 source /cvmfs/grid.cern.ch/etc/profile.d/setup-cvmfs-ui.sh        ## bash/ksh/zsh

first. Csh users will have to first run

 /bin/bash

or perhaps even better, change their login shell to bash or zsh.

Sourcing the setup script will set up all required environment variables for running the middleware commands.

Type

 voms-proxy-init --voms <YOUR-VO>

to create a voms proxy. Sample output:

 $ voms-proxy-init -voms pvier
 Enter GRID pass phrase:
 Your identity: /O=dutchgrid/O=users/O=nikhef/CN=Some User
 Creating temporary proxy .......................................... Done
 Contacting  voms.grid.sara.nl:30000
 [/O=dutchgrid/O=hosts/OU=sara.nl/CN=voms.grid.sara.nl] "pvier" Done
 Creating proxy
 ................................................................... Done
 Your proxy is valid until Fri Dec  7 00:08:49 2007

Congratulations! You are now ready to use grid middleware tools.


Submitting your job

General queues and walltimes available:

Queue Name Max. Walltime (hh:mm:ss) Allowed VOs
short 04:00:00 alice atlas dans projects.nl pvier virgo dune lsgrid lofar tutor enmr.eu bbmri.nl xenon.biggrid.nl chem.biggrid.nl drihm.eu
medium 36:00:00 alice atlas dans projects.nl pvier virgo dune lsgrid lofar tutor enmr.eu bbmri.nl xenon.biggrid.nl chem.biggrid.nl drihm.eu
long 96:00:00 alice atlas dans projects.nl pvier virgo dune lsgrid lofar tutor bbmri.nl xenon.biggrid.nl chem.biggrid.nl drihm.eu


For more information or find other queues, use lcg-info or lcg-infosites which will give you more information about what is available to your VO. For example,

lcg-infosites --vo pvier -f NIKHEF-ELPROD all

Commands to start running your job can look something like:

# Delegate your proxy to an endpoint (-e) with a string to identify your proxy delegation
glite-ce-delegate-proxy -e [CREAM-CE_SERVER]l:8443 [STRING]

# Submit your job to a resource (-r) queue with the output (-o) going to a directory (jids) 
# using the delegation ID string in the previous command and finally adding the job descritpion file (JDL) for your job.
glite-ce-job-submit -r [CREAM-CE_SERVER]:8443/cream-pbs-[QUEUE] -o jids -D [STRING] [JDL-FILE.JDL]

# Check the status of your job... 
glite-ce-job-status https://[CREAM-CE_SERVER]:8443/[JOBID]