Storage Problems Simplified
“Our central file system was getting hammered in a way it had never been hammered before. The NFS caches couldn’t go fast enough — they did not have enough RAM on them.” Greg Brandeau, Pixar
“My last challenge to the industry as a buyer is to see how fast can you make [storage] cheaper and make storage retrieval faster and occupy less space in my data center, because I’m out of room,” said Bob Eicholz, vice president of corporate development at Efilm LLC in Los Angeles.
OK, so physical size, performance, and finding relevant stuff is what matters. Hmmm. The size stuff is working itself out. We need to improve access and general performance by putting a huge centralized cache in between of all the storage devices and the network, (huge meaning capacity, not physical stature). And we need to implement IIM – prepare data (classify,categorize, tag, etc.) so that when we need to manage it (find, archive, move, protect, etc.) it becomes feasible regardless of the volume of data we deal with.
Seems simple to me.