The Great Disk Drive in the Sky: How Web giants store big—and we mean big—data
The storage system backing Google’s search engine has to be able to serve millions of data reads and writes daily from thousands of individual processes running on thousands of servers, can almost never be down for a backup or maintenance, and has to perpetually grow to accommodate the ever-expanding number of pages added by Google’s Web-crawling robots. In total, Google processes over 20 petabytes of data per day.
