DANS Data Management

From BiGGrid Wiki
Jump to navigation Jump to search

DANS Data Management

One of the main goals of DANS is to to longer-term management of a variety of data. The goal of the DANS Data Management project is to allow DANS to reliably back up their data onto BiG Grid storage resources.

'Reliably' means that the consistency of the data can be verified by DANS engineers at any given time. For this, a set of tools and procedures has been developed to allow DANS engineers to

  • upload data from DANS to the grid (in 'tarball' format)
  • compress the data stored on the grid
  • verify the MD5 checksums of all data stored inside the tarballs on the grid