CIO CORNER

This is the MIT CIO Symposium blog. We invite participation from speakers, sponsors, attendees, and interested parties.

Google Unveils Its Container Data Center

By annie shum | April 3, 2009

Google provided a look inside its data center operations at the Google Data Center Efficiency Summit held Wednesday (April 1, 2009) in Mountain View, Calif. The presentations included a video tour of a Google data center, which showcased the companys use of shipping containers to store servers and storage.

Four years after the first reports of server-packed shipping containers lurking in parking garages, Google today confirmed its use of data center containers and provided a group of industry engineers with an overview of how they were implemented in the company’s first data center project in the fall of 2005. “It’s certainly more fun talking about it than keeping it a secret,” said Google’s Jimmy Clidaras, who gave a presentation on the containers at the first Google Data center Efficiency Summit today in Mountain View, Calif.

The Google facility features a “container hanger” filled with 45 containers, with some housed on a second-story balcony. Each shipping container can hold up to 1,160 servers, and uses 250 kilowatts of power, giving the container a power density of more than 780 watts per square foot. Google’s design allows the containers to operate at a temperature of 81 degrees in the cold aisle. Those specs are seen in some advanced designs today, but were rare indeed in 2005 when the facility was built.

Google’s design focused on “power above, water below,” according to Clidaras, and the racks are actually suspended from the ceiling of the container. The below-floor cooling is pumped into the hot aisle through a raised floor, passes through the racks and is returned via a plenum behind the racks. The cooling fans are variable speed and tightly managed, allowing the fans to run at the lowest speed required to cool the rack at that moment.

“Water was a big concern,” said Urs Holzle, who heads Google’s data center operations. “You never know how well these couplings (on the water lines) work in real life. It turns out they work pretty well. At the time, there was nothing to go on.”

Google was awarded a patent on a portable data centerin a shipping container in October 2008, confirming a 2005 report from PBS columnist Robert Cringley that the company was building prototypes of container-based data centers in a garage in Mountain View. Containers also featured prominently in Google’s patent filing for a floating data center that generates its own electricity using wave energy.

Holzle said today that Google opted for containers from the start, beginning its prototype work in 2003. At the time, Google housed all of its servers in third-party data centers. “Once we saw that the commercial data center market was going to dry up, it was a natural step to ask whether we should build one,” said Holzle.

The data center facility, referred to as Data Center A, spans 75,000 square feet and has a power capacity of 10 megawatts. The facility has a Power Usage Effectiveness (PUE) of 1.25, and when the container load is measured across the entire hangar floor space, it equates to a density of 133 watts per square foot. Google didn’t identify the facility’s location, but the timeline suggests that it’s likely one of the facilites at Google’s three-building data center complex in The Dalles, Oregon.

Data center containers have been used for years by the U.S. military. The first commercial product, Sun’s Project Blackbox, was announced in 2006. We noted at the time that the Blackbox “extends the boundaries of the data center universe, and gives additional options to managers of fast-growing enterprises.”

It turns out that containers have developed as key weapons in the data center arms race between Google and Microsoft, which last year announced its shift to a container model. Microsoft has yet to complete its first container data center in Chicago.

April 1st, 2009 : Rich Miller
Google’s containers are real. And it’s not an April Fool’s Joke.

Topics: Uncategorized | 1 Comment »

One Response to “Google Unveils Its Container Data Center”

  1. sainath on April 13th, 2009 11:26 pm

    a PUE of 1.25 is definitely impressive. anything under 2.0 is good.

    with the tech slowdown and credit crunch, commercial data center space is expected to become more scarce. there is not a lot of net new capacity being funded and built up. those relying on colocation facilities should start looking at campus facilities with expansion plans.

    apart from looking at the engineering / mechanical / technical specs, its time for co-lo buyers to start looking at the income statement / balance sheet of co-lo providers … unless you happen to have shipping containers with servers hanging off the roof!

    [email protected]
    http://www.obviousideas.com
    enabling cio success

Leave a Reply