Saturday, November 30, 2013
Sharing Massive Data
In BBC Technology: How do game companies readily share very large 50GB plus files? This interested me because I recently had to do this for an analytics project. I did not have quite the problem they had, my files were smaller, and did not have to be moved often, still an intriguing problem. I remember once dealing with this in a large government installation, during a time when networks were far slower. Working with the output of a simulation. Estimated it would take days to transfer. We wrote the file onto a big mag tape, you know the ones you see spinning in sixties movies, and then took it to another site escorted on a taxi. Still, as we get more real time data, the problem will occur more often even today. Nice case study of the problem.
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment