Using the Grid/Grid information

From BiGGrid Wiki
Revision as of 11:00, 28 June 2011 by Machiel.Jansen (talk | contribs) (Created page with "In order to do your work on the grid you may need to have some information about which services your VO is allowed to use. For this purpose the EGEE infrastructure has an...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

In order to do your work on the grid you may need to have some information about which services your VO is allowed to use. For this purpose the EGEE infrastructure has an information system in place. There are a number of machines that are called BDIIs which hold information about the various services offered and which VOs are allowed to use them. The information system is LDAP-based. In this chapter we will discuss the commandline tools to query the information system.

In addition there are also several monitoring pages that monitor the operation of the grid. These pages will also be discussed.

Non commandline tools

To obtain a quick overview of available systems you can browse the GSTAT 2.0 directory: http://gstat-prod.cern.ch/gstat/vo/lsgrid/

Commandline Tools

The commandline tools that are described below are available on the UI and on the WN's. In order to use these commands the environment variable LCG_GFAL_INFOSYS should be set. On the UI at SARA this variable is set to bdii.grid.sara.nl:2170.

lcg-infosites

Lcg-infosites

lcg-info

The lcg-info command can also be use to retrieve information for the information system but this tools allows for more detailed information retrieval. The usage is:

lcg-info ???

A man page on this tool is available on your UI but we will provide a few examples below.

List the platform architecture of compute elements

lcg-info --vo lsgrid --list-ce --attrs PlatformArch

10:45, 29 April 2010 (CEST) all compute elements are 64bits.

$ lcg-info --vo lsgrid --list-ce --query 'PlatformArch=x86_64'
- CE: ce.gina.sara.nl:2119/jobmanager-lcgpbs-medium
- CE: ce.gina.sara.nl:2119/jobmanager-lcgpbs-short
- CE: ce.grid.rug.nl:2119/jobmanager-pbs-medium
- CE: ce.grid.rug.nl:2119/jobmanager-pbs-short
- CE: deimos.htc.biggrid.nl:2119/jobmanager-pbs-medium
- CE: deimos.htc.biggrid.nl:2119/jobmanager-pbs-short
- CE: gazon.nikhef.nl:2119/jobmanager-pbs-medium
- CE: gazon.nikhef.nl:2119/jobmanager-pbs-short
- CE: gb-ce-amc.amc.nl:8443/cream-pbs-medium
- CE: gb-ce-emc.erasmusmc.nl:8443/cream-pbs-medium
- CE: gb-ce-kg.keygene.com:8443/cream-pbs-medium
- CE: gb-ce-kun.els.sara.nl:8443/cream-pbs-medium
- CE: gb-ce-lumc.lumc.nl:8443/cream-pbs-medium
- CE: gb-ce-nki.els.sara.nl:8443/cream-pbs-medium
- CE: gb-ce-rug.sara.usor.nl:8443/cream-pbs-medium
- CE: gb-ce-tud.ewi.tudelft.nl:8443/cream-pbs-medium
- CE: gb-ce-uu.science.uu.nl:8443/cream-pbs-medium
- CE: gb-ce-wur.els.sara.nl:8443/cream-pbs-medium
- CE: trekker.nikhef.nl:2119/jobmanager-pbs-medium
- CE: trekker.nikhef.nl:2119/jobmanager-pbs-short

List sites that have an SE that supports your VO

$ lcg-info --vo pvier --list-se --query 'SEVOs=pvier' --attrs SESite
- SE: gb-se-amc.amc.nl
  - SESite              LSG-AMC

- SE: gb-se-ams.els.sara.nl
  - SESite              LSG-AMS

- SE: gb-se-kun.els.sara.nl
  - SESite              LSG-KUN

List SEs that support your VO, including the paths where you have write permissions

$ lcg-info --vo lsgrid --list-se --attrs Path
- SE: gb-se-amc.amc.nl
  - Path                /dpm/amc.nl/home/lsgrid

- SE: gb-se-ams.els.sara.nl
  - Path                /dpm/els.sara.nl/home/lsgrid

- SE: gb-se-kun.els.sara.nl
  - Path                /dpm/els.sara.nl/home/lsgrid

Determine whether MPICH is available for your VO

lcg-info --vo lsgrid --list-ce --query 'Tag=*MPICH*' --attrs 'CE'

Discover wallclock of the queues

lcg-info --vo lsgrid --list-ce --attrs MaxWCTime
- CE: ce.gina.sara.nl:2119/jobmanager-lcgpbs-medium
  - MaxWCTime           2160

- CE: ce.gina.sara.nl:2119/jobmanager-lcgpbs-short
  - MaxWCTime           240

- CE: ce.grid.rug.nl:2119/jobmanager-pbs-medium
  - MaxWCTime           2160

- CE: ce.grid.rug.nl:2119/jobmanager-pbs-short
  - MaxWCTime           240

- CE: creamce.gina.sara.nl:8443/cream-pbs-medium
  - MaxWCTime           2160

- CE: creamce.gina.sara.nl:8443/cream-pbs-short
  - MaxWCTime           240

- CE: creamce.grid.rug.nl:8443/cream-pbs-medium
  - MaxWCTime           2160

- CE: creamce.grid.rug.nl:8443/cream-pbs-short
  - MaxWCTime           240

- CE: creamce2.gina.sara.nl:8443/cream-pbs-medium
  - MaxWCTime           2160

- CE: creamce2.gina.sara.nl:8443/cream-pbs-short
  - MaxWCTime           240

- CE: deimos.htc.biggrid.nl:2119/jobmanager-pbs-long
  - MaxWCTime           4320

- CE: deimos.htc.biggrid.nl:2119/jobmanager-pbs-medium
  - MaxWCTime           2162

- CE: deimos.htc.biggrid.nl:2119/jobmanager-pbs-medium32
  - MaxWCTime           2161

- CE: deimos.htc.biggrid.nl:2119/jobmanager-pbs-medium64
  - MaxWCTime           2160

- CE: deimos.htc.biggrid.nl:2119/jobmanager-pbs-short
  - MaxWCTime           240

- CE: gazon.nikhef.nl:2119/jobmanager-pbs-express
  - MaxWCTime           30

- CE: gazon.nikhef.nl:2119/jobmanager-pbs-medium
  - MaxWCTime           2160

- CE: gazon.nikhef.nl:2119/jobmanager-pbs-short
  - MaxWCTime           240

- CE: gb-ce-amc.amc.nl:8443/cream-pbs-medium
  - MaxWCTime           4320

- CE: gb-ce-ams.els.sara.nl:8443/cream-pbs-medium
  - MaxWCTime           2160

- CE: gb-ce-emc.erasmusmc.nl:8443/cream-pbs-medium
  - MaxWCTime           4320

- CE: gb-ce-kg.keygene.com:8443/cream-pbs-medium
  - MaxWCTime           4320

- CE: gb-ce-kun.els.sara.nl:8443/cream-pbs-medium
  - MaxWCTime           4320

- CE: gb-ce-lumc.lumc.nl:8443/cream-pbs-medium
  - MaxWCTime           4320

- CE: gb-ce-nki.els.sara.nl:8443/cream-pbs-medium
  - MaxWCTime           4320

- CE: gb-ce-rug.sara.usor.nl:8443/cream-pbs-medium
  - MaxWCTime           4320

- CE: gb-ce-tud.ewi.tudelft.nl:8443/cream-pbs-medium
  - MaxWCTime           4320

- CE: gb-ce-uu.science.uu.nl:8443/cream-pbs-medium
  - MaxWCTime           4320

- CE: gb-ce-wur.els.sara.nl:8443/cream-pbs-medium
  - MaxWCTime           4320

- CE: juk.nikhef.nl:8443/cream-pbs-express
  - MaxWCTime           30

- CE: juk.nikhef.nl:8443/cream-pbs-medium
  - MaxWCTime           2160

- CE: juk.nikhef.nl:8443/cream-pbs-short
  - MaxWCTime           240

- CE: phoebe.htc.biggrid.nl:8443/cream-pbs-long
  - MaxWCTime           4320

- CE: phoebe.htc.biggrid.nl:8443/cream-pbs-medium
  - MaxWCTime           2162

- CE: phoebe.htc.biggrid.nl:8443/cream-pbs-medium32
  - MaxWCTime           2161

- CE: phoebe.htc.biggrid.nl:8443/cream-pbs-medium64
  - MaxWCTime           2160

- CE: phoebe.htc.biggrid.nl:8443/cream-pbs-short
  - MaxWCTime           240

- CE: trekker.nikhef.nl:2119/jobmanager-pbs-express
  - MaxWCTime           30

- CE: trekker.nikhef.nl:2119/jobmanager-pbs-medium
  - MaxWCTime           2160

- CE: trekker.nikhef.nl:2119/jobmanager-pbs-short
  - MaxWCTime           240

More information

More detailed information on this command may be found in the gLite user guide

Information System Browser

Monitoring Pages

Real Time Grid Monitor

Real Time Monitor

This monitor provides a 2D and 3D java client to display the EGEE infrastructure which contains the Dutch grid infrastructure at work.

Google Maps

System status

These links point to various status tools to monitor the grid systems status.