Mr. Moore in the Datacenter

Yahoo is celebrating its tenth anniversary, which led me to reflect on the fact that a decade is a very long time in Silicon Valley, particularly when viewed through the lens of Moore’s Law. As Ray Kurzweil and others have observed, when humans contemplate exponential progress, we tend to overestimate what can be accomplished in the short term (where the curve is relatively flat), but we tend to underestimate progress in the long term (when the curve gets very steep, goes up and to the right, does a hockey stick, etc.). People tend to think more easily in powers of ten (as opposed to the powers of two prevalent in the technology industry), so a decade is a good duration to look back and consider what Mr. Moore has done for us lately, after we’ve had six or seven doublings of memory density, computing speed and bandwidth. The datacenter is a great place to look to see these trends converge.

Given my background, it is perhaps not surprising that I’m a big fan of consumer-oriented web services such as Google and Yahoo, as well as recent Mobius VC investments Technorati and NewsGator. I’m equally enamored with enterprise-focused software-as-a-service businesses such as RightNow, and Mobius VC portfolio companies Postini, Quova and Rally Software Development. Another cool software-as-a-service startup offers a hosted application wiki and is called JotSpot, which was founded by Joe Kraus and Graham Spencer, two of the guys with whom I co-founded Excite back in 1993. Though these enterprise and consumer oriented companies have different revenue models, their delivery model and back-end architectures for serving their customers are fundamentally similar.

Each of the companies I have mentioned above have benefited greatly from the drastic increase in the amount of storage, computing power, bandwidth and datacenter rack space that a dollar buys in 2005 versus what a dollar bought for the same thing in 1995, back when Yahoo and Excite launched their sites. I spent some time poking around the web trying to find 1995 prices for CPUs, RAM, storage, bandwidth and colo space, but it turns out that this kind of pricing archaeology is difficult to practice online, as all searches for these things turned up advertising and commerce sites focused on selling me these commodities today, not ten years ago.

I related my problem to my colleague Jocelyn Ding, who is the SVP Business and Technical Operations at Postini, and she was able to track down some old price lists from a variety of vendors from 1995, 1998 and 2000 for bandwidth, cage rental, one and four CPU servers and storage systems. Thanks go to Jocelyn for helping me put some real numbers behind my somewhat obvious assertion that a dollar goes much further in today’s datacenter than it did a decade ago. I also dug up a good whitepaper detailing costs of enterprise storage since 1992 which includes projections to 2010, which can be found here. For some items, the prices didn’t go back to 1995, so in those cases, I have extrapolated the price trend to estimate 1995 costs based on 1998 or 2000 costs relative to today’s costs:

Bandwidth: $1100/megabit/month in 1995 vs. $128/megabit/month in 2005

Cage Space: $175/sqft/month in 1995 vs. $25/sqft/month in 2005

Disk Storage: $1,300,000/TB in 1995 vs. $3,300/TB in 2005 (SCSI RAID)

1-CPU Server: $25,000 in 1995 vs. $1,000 in 2005 (web server class machine)

4-CPU Server: $360,000 in 1995 vs. $38,000 in 2005 (with 16GB RAM)

In addition to the price reductions, we also have to look at the compute performance of a web server class machine in 1995 vs. today. Given five or six performance doublings since 1995 courtesy of improvements in clock speed, bus speed, architecture changes from 32 to 64 bit, additional cache memory and faster RAM, a conservative estimate would be that today’s single CPU 1-U “pizza box” web server is roughly fifty times faster than last decade’s model. Couple that with the 25x price difference for this pizza box, and your 2005 dollar buys you more than one-thousand times as much compute power as it did in 1995. Bandwidth is at least ten times cheaper than it was in 1995, floor space in the data center is seven times cheaper and enterprise-class storage is at least four hundred times cheaper than it was only a decade ago. With some smart software and network engineering, the cost per gigabyte of storage can be brought down an order of magnitude further still using a distributed filesystem based on low-end IDE drives. Finally, with the rise of Linux, Apache, MySQL and open source in general, software license costs can also vanish from the equation when running a large-scale web service.

What does this mean for a web-services company? The cost to deliver an application to an end-user has dropped dramatically for these companies and the cost to operate their data centers therefore has much less of an impact on their costs of operations and capex budget than it used to, which means their gross margins for delivering their product have improved significantly since 1995. For companies like Yahoo, Google and more recently, Technorati, this means the cost to deliver a page view or search results page has gone down dramatically, while the average size of a search-results page is perhaps only marginally larger since 1995. Even considering the size of a search index (Google’s 8B pages today vs. Excite’s 10M in 1995) has grown nearly one thousand-fold, the costs of computing power and storage have accommodated this expansion while bandwidth costs and rack space have fallen nearly tenfold.

For enterprise-focused companies like, Postini, Quova and Rally, the story is similar. Add in a subscription-based recurring revenue stream and you have a business model that has all the benefits of a dependable revenue stream and profit margins that can approach those of a traditional software company. Thanks to the low cost and high performance of today’s hardware coupled with an elegant service architecture, Postini is able to process several hundred million email messages per day for its customers with an extraordinarily light hardware footprint and does so quite profitably as a result.

The fun thing about doing a retrospective like this is to realize that when I write about this again in 2015, the increases in CPU speed, memory density and bandwidth will make today’s costs and capabilities look as quaint as 1995’s do today. Thus the environment will continue to become more hospitable to the software-as-a-service model, more entrepreneurs will create meaningful businesses based on this model, VCs will continue to invest in these ideas (myself included), and we’ll all be able to enjoy some mind-blowing applications a decade from now that are simply not possible today.

  • Exponential Cost Curves and the Datacenter

    Everyone knows that exponential curves don’t last forever.  However, it’s remarkable to look at how they apply to specific cost curves – especially when they enable a radical transformation of how technology is used and deployed. …

  • The Analog Analog – How to Explain Your Idea to a VC

    Allen Morgan at Mayfield has a nice series up on his blog about the ten commandments for entrepreneurs.  His post today is Commandment #6: Explain Your New Ideas by Analogy To, or Contrast With, Old Ideas. He’s right.  Mostly.  At …

  • Re: Mr Moore in the Datacenter

    The lesson from Moore’s Law in the Datacenter is simple: machine resources are not valuable.
    Human resources (time, attention, mindshare), in contrast, are valuable, whether they belong to your customers or to your employees.
    Here’s a spreadshe…

  • J McCarthy

    Great overview of an incredible ten years. An interesting corollary is the impact that these falling prices have had on the profitability of running a data center…..As servers have gotten smaller the Googles/Yahoos/Salesforces of the world have been able to put more servers/CPUs per square foot while paying less per square foot due to basic supply/demand of colo/hosting space….While at the same time the major cost drivers for running a data center excluding bandwidth (electric, real estate, people costs) have been steadily increasing on a unit cost basis. Add to that the HVAC/heat dissipation and electric issues associated with high-density (1U servers and blades) and you have a fairly interesting environemnt in which to operate…Anyone care to write about how the past five years have treated the hosting/data center providers? Any predictions for the next 5 years?

  • thanks for a gret post…obviously not a coincidence that some of the most successful business models over the last ten years are consumer services that exploit these trends the best, i.e., eBay, yahoo, google, etc.

  • Thanks for the comments. I too would be interested to see a breakdown of the operating costs and capex budgets for a pure-play datacenter hosting business today vs. a decade ago. The electric bill at a datacenter is no doubt one of the largest expense line items given that HVAC and the ever-increasing power consumption per-square foot from high-density hardware are all folded in to the electric bill. A while ago, I saw a company called Solar Data Centers and initially saw it mainly as a marketing gimmick and as a strange choice of businesses for an eco-consious management team, but when one considers that power is such a large cost for hosting providers, this model might turn out to make a lot of sense. Certainly anyone running such a power-hungry enterprise has an economic incentive to reduce the cost of their juice. Go to for more info.

  • Moore's law is enabling software as a service companies

    Amen! Software as a service is becoming more viable every day as bandwidth, disc space and processing power continue to decrease in price!From McInblog: Mr. Moore in the Datacenter.: QUOTEFor enterprise-focused companies like, Postini, Q…

  • Moore’s law is enabling software as a service companies

    Amen! Software as a service is becoming more viable every day as bandwidth, disc space and processing power continue to decrease in price!From McInblog: Mr. Moore in the Datacenter.: QUOTEFor enterprise-focused companies like, Postini, Q…

  • This is promising to someone like me who is trying to build an ASP based company. I am planning on releasing one of my products (an online document management solution) in May and I am now talking with a couple of ISP’s about hosting and possibly working together to provide that solution and others (i have more in the pipline) and deliver them as value added services to their customers. I will be diving deep to see what it really costs them to host my software so I guess I will be learning the details in regard to power, bandwidth, etc. I will try to post some findings as I discover them.
    Nonetheless, I agree that a lot of entrepeneurs will be looking into this model. I, personally, went from “appliance” to ASP since I looked at the cost and user experience values of both.
    Anyway, great blog article. I have subscribed to this so I cannot wait for what else is coming.

  • Joyent buys TextDrive

    Joyent buys TextDrive (and merges the two totgether, which makes for quite a nice bunch of interesting people and services)….

  • Joyent buys TextDrive

    Joyent buys TextDrive (and merges the two totgether, which makes for quite a nice bunch of interesting people and services)…

  • poker 820

    poker 820

  • poker 32

    poker 32

  • Advanced MP3 Catalog Download

    Download advanced mp3 catalog pro Advanced MP3 Catalog is designed for anyone … Generate and print reports and CD covers, export your catalog, search for …

  • barrister modestus

    Dear MOORE,
    I am highly esteemed to write you this very urgent letter I am Barrister modestus kola, a
    Solicitor and Personal Attorney to Frank MOORE,a national of your country who before his death was an oil merchant who works
    in Nigeria Liquefied Natural Gas Company {NLNG}. On the 4th May 2002, my client his wife and their only kid were involved In a plane crash,Three of them unfortunately lost their lives. Let me refer you to the front page
    of (BBC) World News of Saturday, 4 May 2002,). You can check it through (their websiteat).
    Since then I as the Personal Attorney of the deceased had made several inquiries to your embassy to locate any of my clients extended relative, but this has proved unsuccessful. After several unsuccessful attempts,I decided to trace his relatives through the Internet to locate any member of his family but to no avail, hence I contact you.
    I have decided to contact you to assist in repatriating the money and property left behind by my client before they get confiscated or declared unserviceable
    by the Bank where this huge Deposits were lodged Particularlythe Bank where
    the Deceased had an Account valued at about $9.7M {Nine MillionSeven Hundred
    Thousand United States Dollars}as at last two
    months assessment.
    The Bank has issued me a notice as the Attorney to the Deceased to provide the Next of Kin or have the Account confiscated within the Next 21 official working days since i have been unsuccessful in locating the relatives for over the years that i have been searching. On this order,I seek your consent to present you as the Next of Kin to the Deceased since you bear the same surname, as the bank is ready to listen to you providedyou have the correct Information of the Account,which i will give to you immediately you agreed to assist me, so that the proceeds of this Bank Accountvalued at $9.7Million Dollars can be paid out in your favor.
    As a Barrister, I have all the necessary Legal Documents that will be used to back up the claim. I guarantee that this transaction will be executed under a legitimate banking arrangement that will protect you fromany breach of law. I have agreed to give you 40% for your assistance,while60% will be for me. All I requires is your honest cooperation to enable us seeing this deal through.
    Inc lude your private telephone number for me to call you ,I will be waiting for your urgent response via my private e-mail([email protected]) for more directives
    Barrister modestus kola Esq.

  • Find search engines across the world with Search Engine Colossus

    Gain quick, efficient access to search engines from countries around the world with Search Engine Colossus – International Directory of Search Engines…