Who We Are

Union Square Ventures is an early stage venture capital fund located in New York City. We focus on IT-enabled services in the media & marketing, financial services, healthcare and telecom verticals. We look to back passionate, experienced entrepreneurs who are focused on creating highly scalable services and significant value propositions for their end users.
Hear Fred Wilson on Businessweek's Blogspotting podcast. from spring 2006. Also, listen to Fred and Brad's most recent Businessweek podcast in fall 2006.

Our Focus

Learn more about what we look for in investment prospects.

  • Subscribe in MyYahoo!
  • Subscribe in NewsGator Online

Mailing List


Powered by FeedBlitz

Mathematics - How much is enough

I did not study a lot of science in high school so this reference to mathematics is likely to be my last effort to come up with a model from high school science that sheds light on the evolution of the information technology business.

After eBay’s purchase of Skype, it became clear to many of us that peer to peer file sharing networks were a potentially serious information technology services platform, so I got to thinking about how big this infrastructure really was.

iSupply reported last fall that total PC shipments for 2005 would be 211 million.
IDC recently pegged the number at 209 million.


So let’s assume around 210 million PCs were shipped last year. I tried to get a handle on the size of the average hard drive by playing around with different search terms in Google, but this is not something Google does well. The “expert” on the sales floor at CompUSA told me the average drive they sell these days is 80 Gigabytes.

My friend Sam tells me that, if those numbers are correct, the total storage capacity of the PCs shipped last year is 16.8 Exabytes (10 to the 18th). Sam also pointed me to this post thinking it might help me wrap my head around how may bytes that really was.

Encouraged, because this seemed like a lot of bytes, I began to wonder if we would ever be able to store more bytes than we could produce.

It turns out that Gordon Bell, now at the Microsoft’s Bay Area Research Center has been thinking a lot about how many bytes a person can produce in a lifetime. In this related note he says that as long as you don’t want to store video it is eminently feasible to store a lifetime’s work. Despite Gordon’s admonition to stay away from video, I thought the best way to think about the most we would ever want to store was to imagine that every person on the planet would store full motion high definition video of every moment of their lives.

So I went back to my friend Sam, who told me the following. It takes about 1.6 Gigabytes to store an hour of HDTV or roughly 40 Gigabytes for a 24 hour day. That means it would take about 15 Terabytes to store an HD video of one persons life for one year. If you multiplied that by the roughly 6 Billion people on the planet, we would need about 87.6 ZettaBytes (10 to the 21st) per year to store all the bytes we could produce in that year.

As foggy as my memory of math is, I am aware that that is a big number and that the gap between 10 to the 18th and 10 to the 21st is substantial. What is remarkable to me, though, is that once you have stared those numbers in the face, you realize that if the storage capacity of PCs and the number of PCs shipped annually both continue to grow at the same pace, and you make the assumption that there is a limit to the number of bytes a human can produce, we are not that far away from the day when we will be able store all the bytes we can produce right on our PCs.

One could toss that away as another useless piece of information, except that it suggests that there will be a day – sooner than we may have thought – when our most talented engineering resources will turn their attention away from the problem of storing more bytes and to the problem of making better use of the bytes we have already stored. That transition, which may already be underway, will have a huge impact on the development of the information technology business.

February 2, 2006 12:21 PM, By Brad Burnham
Tags: math p2p storage

Comments (9)

Brad, that's a great post.

Definetely worth thinking about.

Posted by Daniel Nerezov (Check me out on Hiveresume.com) , February 2, 2006 11:39 PM

what, you only want to store video looking in one direction with one fixed focus? i'd want to store many times that amount of video if i truly wanted to capture my life.

Posted by John Ludwig , February 3, 2006 01:52 AM

Nifty. Well, since the difference between 10^18 and 10^21 is a factor of 1000 which is roughly 2^10....

If we keep doubling every 18 months, and assuming that i continue to buy my personal share of the global computing infrastructure, I'll be able to do HD quality storage of my entire life, including the time i'm asleep, in about 15 years. Actually, given that roughly half my life is over at this point, call it 13-14 years.

Start companies anticipating bulk video editing or video indexing / filtering applications, lifetime data collection applications. Any resource getting that cheap means we'll use the heck of it and taping/saving/videoing all sorts of (now seemingly) inane things. And I might say that by then we'd be unsatisfied with ONLY an HD version of our lives.


-Al

Posted by Al Chang , February 3, 2006 04:08 AM

We'll be storing 3d movies soon, that might take up a bit more room, but then we'll just use holographic storage anyway...

Of course there will still be no more room left over after downloading all that porn...

Posted by - ET , February 3, 2006 03:21 PM

It will be interesting to see if capacity can keep doubling at it's current rate: at some point we will hit the hard limits of physics. You might enjoy this article by Seth Lloyd of MIT:
http://www.edge.org/3rd_culture/lloyd/lloyd_print.html

"I have a kilogram of matter confined to the volume of a liter; how many states, how many possible states for matter confined to the volume of a liter can there possibly be? ... The amount of information that can be stored by the ultimate laptop, 10 to the 31st bits, is much higher than the 10 to the 10th bits stored on current laptops. ... A typical state of the ultimate laptop's memory looks like a plasma at a billion degrees Kelvin"

Posted by Stan James , February 6, 2006 05:23 AM

How much math is enough? The pundits must have asked themselves the same question before they arrived at the concept of infinite.

Posted by AA VC , February 7, 2006 05:32 PM

i believe i read an article in mit's technology review mentioning this problem as well. they mentioned that at the rate the population is growing, the mb/physical size, and even given technology advances, that we'll still encounter a storage issue because we won't have enough storage space on earth!

it's definitely a problem that will need to be analyzed and solved.

Posted by David Wang , February 25, 2006 06:44 PM

I live at 22615 Commonwealth in Seattle. Been up here before?

Posted by Mike Flacklestein , July 6, 2006 09:01 PM

I bet that number has increased.

Posted by Small Business Hosting , October 2, 2006 04:45 PM

Job Board