Deutsches Elektronen-Synchrotron (DESY) operates the PETRA III synchrotron used to examine the internal structure of materials.
"A typical detector generates a data stream of about 5 Gigabit per second, which is about the data volume of one complete CD-ROM per second," said DESY IT head Volker Gülzow.
"And at PETRA III we do not have just one detector, but 14 beamlines equipped with many detectors, and they are currently being extended to 24. All this big data must be stored and handled reliably," said Dr Gülzow.
The system will also be used for the European XFEL X-ray laser that will generate around 100PB per year, which is comparable to the data generated by CERN's Large Hadron Collider.
"IBM's software defined storage technologies can provide DESY the scalability, speed and agility it requires to morph into a real-time analytics service provider," said IBM's general manager of storage and software defined systems Jamie Thomas.
"IBM can take the experience gained at DESY and transfer it to other fields of data intensive science such as astronomy, climate research and geophysics and design storage architectures for the analysis of data generated by distributed detectors and sensors."