DataStaMP – Data Storage and Management Project
One of the hallmarks of the new generation of synchrotrons better performance leading higher resolution datasets. Users at MAX IV are now able to see their samples in unprecedented detail in both length and time. This puts enormous strain on data management systems which must adapt to ever increasing quantities of data that have to be transferred and accessed faster than ever before. If data management is not equally cutting edge, it risks choking the productivity of users, and blunting the state-of-the-art scientific instruments. MAX IV has been funded to bring cutting edge data management to the users in the DataStaMP project. At the start of the project, we will develop a data storage system that will be able to maintain all of the data generated at MAX IV, both now and in the future. We will also work with users and beamline staff to collect important metadata that will make the data more useful, especially when combined in a big data set. By storing the data in a single, secure location and by assigning metadata tags at the point of collection, we will ensure that data generated at MAX IV will be useful and accessible for decades to come. This project will also ensure that data generated at MAX IV is not randomly distributed on researcher hard drives in their home lab but made accessible to the research community in the spirit of the European Open Science Cloud.