Difference between revisions of "DANS Data Management"

From BiGGrid Wiki
Jump to navigation Jump to search
m (Created page with "==DANS Data Management== One of the main goals of DANS ([http://www.dans.knaw.nl]) is to to longer-term management of a variety of data. The goal of the DANS Data Management pro...")
 
Line 1: Line 1:
 
==DANS Data Management==
 
==DANS Data Management==
  
One of the main goals of DANS ([http://www.dans.knaw.nl]) is to to longer-term management of a variety of data. The goal of the DANS Data Management project is to allow DANS to reliably back up their data onto BiG Grid storage resources.  
+
One of the main goals of [http://www.dans.knaw.nl DANS] is to to longer-term management of a variety of data. The goal of the DANS Data Management project is to allow DANS to reliably back up their data onto BiG Grid storage resources.  
  
 
'Reliably' means that the consistency of the data can be verified by DANS engineers at any given time. For this, a set of tools and procedures has been developed to allow DANS engineers to
 
'Reliably' means that the consistency of the data can be verified by DANS engineers at any given time. For this, a set of tools and procedures has been developed to allow DANS engineers to
* upload data from DANS to the grid (in 'tarball' format)
+
 
* compress the data stored on the grid
+
* upload data from DANS to the grid (in 'tarball' format)
* verify the MD5 checksums of all data stored inside the tarballs on the grid
+
* compress the data stored on the grid
 +
* verify the MD5 checksums of all data stored inside the tarballs on the grid

Revision as of 09:08, 10 May 2012

DANS Data Management

One of the main goals of DANS is to to longer-term management of a variety of data. The goal of the DANS Data Management project is to allow DANS to reliably back up their data onto BiG Grid storage resources.

'Reliably' means that the consistency of the data can be verified by DANS engineers at any given time. For this, a set of tools and procedures has been developed to allow DANS engineers to

  • upload data from DANS to the grid (in 'tarball' format)
  • compress the data stored on the grid
  • verify the MD5 checksums of all data stored inside the tarballs on the grid