Today there is no science without digital data. Data from scientific experiments, from measurements, analysis and simulations, have to be stored at KIT long-term. The storage of this data isn't only important because of legal reasons, it also commits because of its historical value. At KIT's Steinbuch Centre for Computing (SCC) the quantity of these data will increase as KIT will become the central archive location of the state of Baden-Wuerttemberg. Within the states project 'bwDataArchiv' supported by the Baden-Württemberg Ministry of Science, Research, and the Arts (MWK) the SCC will further expand its technical infrastructure for the long-time scientific data storage from research institutions and libraries, and also from the high performance computing of the University of Stuttgart (HLRS).
Within the 'bwDataArchiv' project, technologies for a structured, reliable and secure long-term storage of more than an Exabyte have to be developed and deployed to be used until 2020.
The 'bwDataArchiv' addresses among others, these interesting questions:
- How to simplify the data storage process for a non IT confident scientific community?
- Which safety-related aspects are important for the long-term storage?
- How to efficiently ensure the data integrity of hundreds of Petabytes of data?
In the project established and reliable techniques for long-term digital data storage have to be selected and deployed. The objective is the development of a technical infrastructure for long-term storage and the establishment of a service as the basis for a safe storage of scientific and cultural relevant data.
The service is online since January 2017initially for KIT staff. Based on the first experiences the project services will be established for more organisation and will be improved with regard to integrity, usability and availability. More information is available on the bwDataArchive service web site.
Promotion and Cooperation
The 'bwDataArchive' project is supported by the Ministry of Science, Research and the Arts Baden Wuerttemberg and it works together with DFG project RADAR, the state project BWDataDiss within the framework of the Helmholtz project LSDMA, with different scientific communities, and also with the international projects EUDAT, Human Brain Project (HBP) and the LHC Computing Grid (WLGC).