Tape Archival System at DKRZ: Time Schedule and Further Information

DKRZ (Deutsches Klimarechenzentrum GmbH)  provide some detailed information regarding the upcoming change (April 2021) in the way users archive and retrieve data from the DKRZ ‘s tape archive.

This change affects all DKRZ users actively using their archiving infrastructure.

As announced in November 2020, a HSM system will be put in operation in April 2021.

The HSM system called StrongLink forms a new technical solution for the DKRZ tape archive system and replaces the current storage management system HPSS. This is done in preparation for the installation of the HLRE-4-cluster Levante and goes along with a replacement of the pftp command line tool used so far.

Details and preliminary time schedule:

• January 28: release of a FAQ page regarding the HSM system

• February 15 (approximately): release of first version of the user documentation

• March/April, tba: DKRZ Tech Talk on the HSM system; will take place 1 or 2 weeks before the HPSS is taken offline (see next item)

• March/April, tba: HPSS will be taken offline and data from HPSS will be migrated to the new system. See below for more information on which data will be migrated. This will probably take 1 week in March/April 2021 but not before March 22. Access to the HSM and archived data is not possible during the migration.

The exact date for the migration and the DKRZ Tech Talk will be announced at least one month in advance of the migration. Before the company fixes these dates, it has to make sure that the migration will run flawlessly.

All data, except those in the directory/dxul and subdirectories thereof, will be migrated to the new system. Data in/dxul are no longer accessible after the migration to the new system (see separate email on this topic).

A new command line tool ‘slk’ (short for StrongLinK) for data archival, retrieval and search will replace the current tool pftp. pftp cannot be used anymore with the new system. The new tool will have very similar features to pftp and is suited for use in non-interactive workflow setups. It will be presented in the DKRZ Tech Talk. Be aware that, depending on the complexity of your workflows, you will need to invest time in adapting your scripts to the new environment.

The StrongLink product offers a number of new features. As one of these, it will allow to automatically harvest and store extended file metadata of some file types. Files can be searched for by these metadata.

Have a look into the FAQ first to see whether your questions are already covered there. The FAQ is versioned so that you can find out whether there are updates or not. The current version is 1.01.