Argonne Makes Biggest File Transfer

Impressive, as suggested, useful for very large combinatorial problems with related data.

Argonne Team Makes Largest Single File Transfer in History
By Oliver Peckham in DataNami

A team of scientists at Argonne National Laboratory has broken a data transfer record by moving a staggering 2.9 petabytes of data for a research project.

The data – from three large cosmological simulations – was generated and stored on the Summit supercomputer at the Oak Ridge Leadership Computing Facility (OLCF), which is currently rated as the world’s fastest supercomputer on the Top500 list at nearly 149 Linpack petaflops.

“We carried out three different simulations on Summit (each simulation resulted in a file transfer of 2-3PB) to model three different scenarios of the makeup of the Universe,” said Dr. Katrin Heitmann, a physicist at Argonne and lead researcher on the project. “We are trying to understand the subtle differences in the distribution of matter in the Universe when we change the underlying model slightly.”  ... '