/* ---- Google Analytics Code Below */

Saturday, November 30, 2013

Sharing Massive Data

In BBC Technology:  How do game companies readily share very large 50GB plus files?  This interested me because I recently had to do this for an analytics project.   I did not have quite the problem they had,  my files were smaller, and did not have to be moved often, still an intriguing problem.  I remember once dealing with this in a large government installation, during a time when networks were far slower.  Working with the output of a simulation.  Estimated it would take days to transfer. We wrote the file onto a big mag tape, you know the ones you see spinning in sixties movies, and then took it to another site escorted on a taxi.    Still, as we get more real time data, the problem will occur more often even today.  Nice case study of the problem.

No comments: