Difference between revisions of "Dans Data Upload"

From BiGGrid Wiki
Jump to navigation Jump to search
(Created page with "==How to upload a DANS archive to the grid== * create a new directory with the name of the archive. As an example we use the 'Crome' archive: mkdir -p ~/dans/Crome/ * In this ...")
 
Line 1: Line 1:
 
==How to upload a DANS archive to the grid==
 
==How to upload a DANS archive to the grid==
  
* create a new directory with the name of the archive. As an example we use the 'Crome' archive:
+
* create a new directory with the name of the archive. As an example we use the 'Crome' archive. We refer to the name of the archive using the environment variable '$ARCHIVE' :  
   mkdir -p ~/dans/Crome/
+
  export ARCHIVE=Crome
 +
   mkdir -p ~/dans/$ARCHIVE/
 
* In this directory create another directory with the same name; this directory will contain the list of files and directories that need to be uploaded
 
* In this directory create another directory with the same name; this directory will contain the list of files and directories that need to be uploaded
   cd ~/dans/Crome
+
   cd ~/dans/$ARCHIVE
   mkdir Crome
+
   mkdir $ARCHIVE
 
* copy over the scripts from the repository
 
* copy over the scripts from the repository
 
   cp -a ~/dans/scripts/* .
 
   cp -a ~/dans/scripts/* .
 +
* generate a '''sorted''' list of files
 +
  find -L $ARCHIVE -type f | sort > ${ARCHIVE}-files.txt

Revision as of 10:04, 10 May 2012

How to upload a DANS archive to the grid

  • create a new directory with the name of the archive. As an example we use the 'Crome' archive. We refer to the name of the archive using the environment variable '$ARCHIVE' :
 export ARCHIVE=Crome
 mkdir -p ~/dans/$ARCHIVE/
  • In this directory create another directory with the same name; this directory will contain the list of files and directories that need to be uploaded
 cd ~/dans/$ARCHIVE
 mkdir $ARCHIVE
  • copy over the scripts from the repository
 cp -a ~/dans/scripts/* .
  • generate a sorted list of files
 find -L $ARCHIVE -type f | sort > ${ARCHIVE}-files.txt