Difference between revisions of "Accounting"

From PDP/Grid Wiki
Jump to navigationJump to search
m
 
(One intermediate revision by one other user not shown)
Line 1: Line 1:
 +
'''THIS FORMATION IS NOW OBSLETE'''
 
Torque keeps records of job wall and CPU times on the torque server, directory
 
Torque keeps records of job wall and CPU times on the torque server, directory
 
  /var/spool/pbs/server_priv/accounting
 
  /var/spool/pbs/server_priv/accounting
Line 11: Line 12:
 
assuming your CWD is the torque accounting directory.
 
assuming your CWD is the torque accounting directory.
 
''Need information on the rest of the chain here, for example where these data are stored, and how the APEL part of the chain works.  Also a human-readable explanation of the dreaded normalization is needed.''
 
''Need information on the rest of the chain here, for example where these data are stored, and how the APEL part of the chain works.  Also a human-readable explanation of the dreaded normalization is needed.''
 +
One can get various aggregate accounting numbers via the local accounting portal which is currently located at
 +
http://www.nikhef.nl/grid/accuse/
 +
''Need information on what this really does ... if one runs the accuse portal page, where is the associated cgi script?''

Latest revision as of 15:15, 24 December 2008

THIS FORMATION IS NOW OBSLETE Torque keeps records of job wall and CPU times on the torque server, directory

/var/spool/pbs/server_priv/accounting

What is important to our users is not the time used, but the total work performed, which for each job consists of the actual times (cpu and wall) multiplied by the power rating of the machine running the job. The relevant conversion factors are contained in the file

/etc/pbsaccdb.conf

on the torque server. This file is controlled by Quattor, so to make changes (for example if a new worker-node class is added), make the changes in the quattor profile and not on the torque server. Once per day, a cron job runs on the torque server:

/etc/cron.d/accounting.ncm-cron.cron

This processes the torque accounting file for the previous day. If one needs to re-run the processing for any reason, one can do it by hand via

/share/acct/bin/pbsaccdb.pl <pbs_accounting_file> [<pbs_accounting_file> ...] 

assuming your CWD is the torque accounting directory. Need information on the rest of the chain here, for example where these data are stored, and how the APEL part of the chain works. Also a human-readable explanation of the dreaded normalization is needed. One can get various aggregate accounting numbers via the local accounting portal which is currently located at

http://www.nikhef.nl/grid/accuse/

Need information on what this really does ... if one runs the accuse portal page, where is the associated cgi script?