posted on Monday, January 22, 2007 11:37 AM
by
Jonathan Hodgson
How the big players scale out
Whether it is Google, eBay or MSN - they all need to scale to millions of users.
How eBay manages it's storage is an extreme problem,
"eBay's storage engineering team ('Eleven people', Strong said) utilizes 2 petabytes of raw digital space on a daily basis to run the site and store its data, yet has to add about 10 terabytes of new storage every week to cover new transactions"
TechNet paper talking about how MSN scales out SQL Server with data dependent routing to partition data across a federation of servers - this is becoming a bigger issue as sites use multi-tenant data architectures.