Slashdot Banner
Stories
Slash Boxes
Comments
typodupeerror delete not in

Comments: 112 +-   'Power Capping' the Datacenter on Wednesday July 22, @06:32PM

Posted by samzenpus on Wednesday July 22, @06:32PM
from the slow-your-roll dept.
power
database
programming
software
it
snydeq writes "Datacenter operators seeking increased server density may soon turn to power capping, an emerging technology that limits the amount of electricity a server can consume, InfoWorld reports. The practice, which can be applied at the rack level, ensures that no server draws above a set power level, thereby increasing datacenter capacity within a rack-level power envelope by as much as 20 percent, according to a proof-of-concept study at Baidu, China's largest search company. As with powering down servers during off hours, of course, power capping incurs calculated risk, as those in charge of business-critical applications may be reluctant to set power limits below maximum utilization. Yet given IT's need to contend with the permanent energy crisis, the notion of power capping the datacenter could prove advantageous."
story

Related Stories

This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More
Loading... please wait.
  • lame...a much better way of handling this is what datacenters are already doing: simply sell you power circuits, say 20 amps each for a set price. if they want to discourage power use, they simply have to raise the price. low tech, and works perfectly well. you can always get a good power strip with a ammeter on it if you want to know what your servers are drawing.
    • lame...a much better way of handling this is what datacenters are already doing: simply sell you power circuits, say 20 amps each for a set price. if they want to discourage power use, they simply have to raise the price. low tech, and works perfectly well. you can always get a good power strip with a ammeter on it if you want to know what your servers are drawing.

      This is certainly an alternative. I think that either way we should see owners of devices examining how much processing power they really need an

      • With SSDs and the reduced issue of plater spin up, I can imagine servers that stand-by and wake up if there is any activity on a specified port

        SSDs don't actually consume much less power than platter-based drives, but they're far more expensive. The spin-up/down is mitigated if there's good caching on the controller, and I think that's the key here -- caching. You can have a couple of terabytes on a server, but the drives aren't called until something is requested which *isn't* on the controller's buffer.

        I should point out though that power consumption of HDs are insignificant compared to the rest of the system. If you want to avoid the spin-u

        • Just as I posted that I remembered that idle power draw on 3.5" drives isn't 1W, it's ~4W... I was thinking about 2.5" drives. This is compared to the 40W to 60W that a typical CPU will consume.
          • Just as I posted that I remembered that idle power draw on 3.5" drives isn't 1W, it's ~4W... I was thinking about 2.5" drives. This is compared to the 40W to 60W that a typical CPU will consume.

            This is why I was suggesting a smart system that can deactivate cores or subsystems until they are actually needed. Most servers aren't designed with energy consumption considerations, so they still draw a fair amount of power even there are five users visiting the web site. If they could be made to use the least res

            • the new AMD chips can do this, but apparently it isn't quite as responsive as they'd like. Perhaps exposing hooks to allow the OS to control this would work better.
            • If they could be made to use the least resources possible to get the job done, then it would probably end up saving a fair amount of money long term.

              Finally found the term they used: "power gating". Here's an Ars article [arstechnica.com] about it.

              The relevant bit:
              Traditionally, Intel has been able shut down an unused core by cutting its active power, but even though it's in a sleep state, that core is still dissipating plenty of power because of leakage current. Intel's power gating technique involves a new transistor design, and it lets Intel cut the leakage current, as well, so that the sleeping core's power dissipation drops to near zero.

              AMD also has some ter

    • simply sell you power circuits, say 20 amps each for a set price.

      This is a great way to waste money. If you don't use power capping, then you'll be paying for 20A but only using 10A-12A if you're lucky. Power capping allows you to use the full 16A that you're paying for.

      • Power capping allows you to use the full 16A that you're paying for.

        Alternatively, a power meter will let you pay for the full 16A you use. Networked power meters are certainly less complex than "power capping". Why not just use those?

  • How long until.. (Score:4, Insightful)

    by Rayeth (1335201) on Wednesday July 22, @06:46PM (#28789703)
    One only wonders how long it will be until every spreadsheet process becomes "business critical" to override restrictions such as this.
    • Re: (Score:2, Insightful)

      One only wonders how long it will be until every spreadsheet process becomes "business critical" to override restrictions such as this.

      When the business involved has to pay a larger and larger bill, that which is considered "critical" is increasingly analyzed as the bottom line gets thinner and thinner. When margins are fat, daily $4 lattes are "critical" to staff morale. Conversely, when times are really tight, staff morale is critical at "well, you ain't fired yet, is yeh?".

  • Not a crisis (Score:4, Interesting)

    by tsotha (720379) on Wednesday July 22, @06:47PM (#28789707)
    "Permanent energy crisis"? There's no such thing as a permanent crisis. Yes, energy costs are going up because we're more sensitive to the impact of new capacity. But that hardly constitutes a crisis. The word "crisis" has been practically stripped of meaning - everything these days is a goddamn crisis. When the girlfriend you were about to dump gets pregnant - that's a crisis. A few bucks more on your energy bill - not a crisis.
    • They meant "opportunity".

      • Or you'll find that there's no such thing. It depends which link you click.
      • Peak oil isn't a crisis either. We can replace every erg of energy from oil with nuclear if we're motivated to do so. Even if we don't, during my lifetime peak oil will mean as an American I might, at some point, have to pay almost as much for gas as the Europeans are paying now, plus a few commodities will cost more.
          • Re:Not a crisis (Score:4, Interesting)

            by tsotha (720379) on Wednesday July 22, @07:49PM (#28790151)
            Sigh. I understand all that, but the numbers are hardly insurmountable, or even very uncomfortable. How many nuclear power plants could we have built for the trillion dollars we spent on "stimulus"? Four or five in every state, by my calculations. The idea that everything is just going to fall apart when the price of oil goes up is just silly.
              • Re:Not a crisis (Score:5, Insightful)

                by FooAtWFU (699187) on Wednesday July 22, @08:56PM (#28790553) Homepage
                The Stone Age didn't end because they ran out of stone. The Oil Age might end when we start to run low on oil, but that doesn't mean we won't have plenty of alternatives.

                The economic argument for all sorts of magic coming from having oil traded in USD is weak. A barrel of oil is worth whatever the next buyer things a barrel of oil is worth, a dollar is worth whatever the next guy who gets it thinks it's worth. These things are both fungible, they're both pretty liquid. There's a vibrant currency exchange market. If people think the dollar or the barrel-o-crude is not worth what it used to be, the prices are perfectly capable of shifting to match. Look at the last big recession and oil crisis of the 1980s. Look at 2008, for crying out loud. The US dollar may wax and wane, the US economy may shrink 10% in a bad year, but oil dropped from over $100 a barrel to something like $30.

                As for the money supply, the Federal Reserve is pretty capable of generating as much or as little of our little fiat currency as they feel like. The national debt (and the price at which people are willing to buy it worldwide) is what's going to be weighing on the US and its economy over the next several decades, much more than any medium-of-exchange games. The government and the private sector compete for loans: when there's more debt, it's more expensive for private firms to borrow and that hurts economic growth - because look! Treasury bonds! They're nice and safe. Why would you invest in a risky old Business in /this/ economy?

          • nothing to understand, we have coal sufficient for centuries and the means to make it into every major type of hydrocarbon fuel. No crisis. No peak oil.

            • nothing to understand, we have coal sufficient for centuries and the means to make it into every major type of hydrocarbon fuel.

              It's true that there's enough coal for centuries. However, if we keep using it the way we do now, these centuries will be spent underwater. The power crisis will kick in when sea levels start rising so fast that power will be capped during peak ours, for *everyone*. Either we start adapting now, or we'll pay for it tenfold later.

  • by clarkcox3 (194009) on Wednesday July 22, @06:58PM (#28789787) Homepage
    Ins't this just putting a friendlier name on "overselling"?
    • We can pack in 20% more boxes because we don't really have the power to meet demand should all of them spike at once, but that doesn't usually happen.
    • We can sell in 20% more airline seats because we don't really have the room to meet demand should all of the customers actually show up, but that doesn't usually happen.
    • We can claim unlimited bandwidth, because we don't really have the capacity to meat demand should all of our customers actually download 24/7, but that doesn't usually happen.
    • etc. etc. etc.
    • Yes, power capping allows safe oversubscription of power. Honestly, these days if a business isn't overselling they're leaving money on the table.

      • Re: (Score:3, Interesting)

        It depends what they are overselling and to what degree. Overselling a plane screws whoever is left behind (large impact over small set of customers). Overselling bandwidth slows someone's download or game (small impact over many customers).

        Overselling a rack and causing servers to a) fail or b) corrupt data costs in hundreds of thousands or more pretty quickly in damages and legal fees. It's a much wiser business decision to just increase the power capacity (not that some suits will think this is the
        • The point of power capping is that it doesn't cause any kind of failure; servers just slow down when they reach the cap.

      • Re: (Score:2, Insightful)

        Honestly, these days if a business isn't overselling they're leaving money on the table.

        Yes, and it is that kind of amoral and unethical crap that is giving the shaft to the consumer day after day after day.

        Just because you can do something, and it will be profitable, does not mean that you should do it.

        Overselling anything should be expressly prohibited by law in the strongest terms possible. Honestly, it really pisses me off. At the very least, the amount of overselling should be disclosed to customers

        • by Anonymous Coward on Wednesday July 22, @09:27PM (#28790769)

          Yes, and it is that kind of amoral and unethical crap that is giving the shaft to the consumer day after day after day.

          You're right! Gyms, for example, shouldn't sell memberships to more people than they can fit in the gym at the same time. Otherwise, if every one of their members decided to go to the gym at once, they'd have to turn some away!

          (Seriously - overselling is just another risk. Taking no risks is bad. Taking too much risk is bad.)

  • Tell me why it doesn't make sense to buy power at off-peak rates and store it locally to meet peak demands.
    • how exactly are you planning to store such a massive amount of power and avoid losing energy in the transfer?
      • Beacon Power is an American corporation specializing in flywheel based energy storage headquartered in Tyngsboro, Massachusetts. Beacon designs and develops products aimed at utility frequency regulation for power grid operations. The storage systems are designed to help utilities match supply with varying demand by storing excess power in arrays of 2,800-pound (1,300 kg) flywheels at off-peak times for use during peak demand.

        http://en.wikipedia.org/wiki/Beacon_Power [wikipedia.org]

        The people who keep saying we can't find

        • 2,800lb flywheels, plus the related cirtuits, plus maintainence of the flywheel ain't cheap.

          Plus, proper power capping can reduce infrastructure cost, since the power distribution/conversion whatsoever system in the datacenter needs to be designed according to the maximum load, which means they need a lot of headroom on their power supply. By doing so, they can reduce the maximum load.

          The only problem... is how they will reduce power while minimizing the interruption to the workload on peak times. Not an ea

        • Those are insanely expensive and only store enough power for a few MW load for a handful of minutes. In theory they are better than a UPS in the long run due to not needing to replace batteries every few years but they aren't going to shift much load from offpeak to peak.
        • Wow. Beacon Power's flywheels are actually pretty amazing:

          The basic unit of Beacon Power approach is the Smart Energy 25, that is basically an enormous steel vacuum bottle holding a 2,800-pound cylinder made of carbon and fiberglass composite that is levitated by magnets.

          Beacon's flywheels take in electricity and use a motor to spin the cylinder so fast that the surface hits Mach 2. The spinning cylinder stores most of the electricity's energy for as long as needed (thanks to the near frictionless vacuum a

        • and how much for the insurance in case one of those kinetic bombs decides to go off?
      • how exactly are you planning to store such a massive amount of power and avoid losing energy in the transfer?

        I was going to make that point, so instead I'll make the counterpoint: the value of the energy lost would have to be within the peak/off-peak cost differential.

        • Or more precisely, the differential PLUS the cost of the storage system (which includes buying more land, having more staff, more insurance, etc.).
    • Tell me why it doesn't make sense to buy power at off-peak rates and store it locally to meet peak demands.

      This has been possible for consumers in the UK for decades. In the UK, they have "storage heaters". These are heaters that store heat at night, at off-peak rates (the meters measure peak-time and off-peak usage) and then release the heat during the day when it is needed. Many people also use delay-timers on other devices such as dishwashers to take advantage of off-peak rates. It amazes me that this

      • It amazes me that this concept has failed to reach the USA, although it is a lot more difficult to store "cool" than it is to store heat, so perhaps the possible gains are smaller across much of the USA.

        The problem isn't with household usage patterns but with the fact that the utilities generally don't have a time-tiered pricing system. My electricity meter is of the old-fashioned dumb sort, as is most people's, so there's no incentive to use power at off-peak times. That's changing, but slowly. If smart meters were ubiquitous, I think people would respond (and there are many places in the US that need more heating than the UK!).

    • It does make sense. That's exactly what i/o Data Centers is doing in Phoenix. They're installing a thermal storage system [datacenterknowledge.com] at their huge Phoenix ONE data center. The building chillers will cool a solution of water and 28 percent glycol. The thermal storage tank contains Cryogel ice balls, which freeze when the system is charging at night, and then cool the glycol solution during the day. The glycol solution is then pumped through a heat exchanger, which chills water in a separate loop used in the data center
  • If I'm reading the article right, this doesn't save any energy at all (and might increase total energy consumption). It's a way of spreading out power use over time, so you can get more servers without increasing peak power capacity. It makes sense for some loads (why run at 2Ghz for 2 minutes of every 30 when you can save power by running at 500Mhz for 8 minutes). But for interactive loads it won't be good.

  • Our Policy (Score:3, Interesting)

    by teknopurge (199509) on Wednesday July 22, @07:02PM (#28789837) Homepage
    I can't see any legitimate provider capping power usage. We have 20A running to a client rack by default - if they need more circuits we charge them per circuit. The only place I can see people wanting to make an argument for capping power usage is if a provider has oversold their power infrastructure and is starting to feel the pinch because they're not charging enough. Same goes for bandwidth: if you want to price things cheaper and cheaper to attract customer, I believe it';s unethical to then raise rates after-the-fact because of poor planning/forecasting.
    • Power capping is intended to be used by the server owner; e.g. in a colo that would be the customer, not the provider. You give the customer a circuit and they use capping to fit as many servers as possible on it.

    • The testing revealed that the optimal workload was reached at a CPU utilization of around 50 to 60 percent with peak power at about 300W per server.

      Wouldn't it be cheaper to start with a CPU that runs 50%~60% slower and uses 50%~60% less electricity?

  • Scaling down the use or throttling the usage during off peak times could be a good thing, but how much energy would it really save in the long run? It has been noted that data centers energy usage could double by 2011. Would steps like this really make a dent in that trend? I would grant that it might lower the curve, however it won't stop the trend of growing datacenter energy usage. I don't subscribe to the "permanent energy crisis" argument. There *is* a "permanent political crisis", meaning that things
  • This happens to be why my quarter rack space has only 2 1U computers in it. It was supposed to be a quarter rack (10U), but I was told I had only 7U of space. Okay, not a problem, I can put in 7 1U systems, 14 if I purchase the half sized systems. Then I was told I have only 2A, oh, and here's a switch that'll turn it off if you go over. Which means my quarter rack has two 1U servers in it.

    Worse, even the full rack is allowed only 15A before you have to buy a secondary power conduit to the rack at this particular colo.

    I suspect it's more a way for the facility to make money than it is to reduce energy usage. When I visited the facility last to move boxes, 4 racks were being emptied and a good 60% of them were completely empty anyway, so the facility may not be long in this economy.
     

    • A rack is only allowed 15A (in your case) or 16A usually out of 20A, because NEC code states you can only drive a circuit at 80% of it's max capacity (16A on a 20A circuit, 24A on a 30A circuit, etc). Colo customers should be taking this into account when they buy power. If you want to buy 10U of space, and expect to fill it with 10 1U servers, be prepared to pay an appropriate price, as it's not just space, but power, and cooling to cool all that power going into those serves. Every watt of heat you make i
  • Americans (and Europeans outside of France) are going to get over their nuclear power allergy really, really quickly once their lifestyles start to suffer more than a certain amount. Especially when counties like Iran and India start using it heavily and manage to undercut our economies with cheaper energy.

    Flat out, if the carbon / climate change problem is as bad as is portrayed these days, and we think peak oil is a looming problem, nuclear is the ONLY rational response to the problem over the next few de

  • I'm sure we can all think of circumstances where we care more about how long a machine stays on and somewhat functional than how fast it is.

    Like movie watching: a few dropped frames are a small price to pay for finishing the film. If it's bothersome, maybe the brightness can be lowered during actiony bits.

    Or typing while the thing is actually in your lap: not burning your groin is far more important than a hastily typed "find -exec dostuff {};" operation in the background finishing quickly.

  • I'll believe this when I see more sites that start dropping unnecessary ads and tracking when under heavy load. (Slashdot does some of that; under heavy load, most users get a canned home page. When the system is less busy, the "customization" machinery is used.)

    The real killer is overdoing "customization". Customization makes serving pages far more expensive. Consider Google's problems with "Michael Jackson" searches. Google used to answer the most common queries from a cache in the first server to

    • You should set the power cap slightly higher than the server's typical power usage, so the server rarely or never slows down. Also, in corporate IT there is no other provider, so the alternative to power capping is usually to not buy any more servers.

    • APC doesn't allow per-outlet monitoring, only per PDU monitoring. UCSD or UC Berkley is working on small per-outlet devices to both monitor and control loads (i.e. servers) that are to cost less than $20/piece. Assume they are controllable via HTTP, and you can do some fine power control.
    • Re: (Score:3, Informative)

      Basically every colo datacenter is metered. Standard is 2x20A circuits (16A max draw) per rack. If you want 30A or quad 20A circuits in your rack you generally pay a hefty overage charge. At our DR colo provider they require metered PDU's. I have this capping capability with my HP servers which means I can fill a rack right up to the edge but make sure I don't overload the circuit by keeping my peak usage closer to average. You also need to use staggered startup on your servers if you want to play it that c
He is the MELBA-BEING ... the ANGEL CAKE ... XEROX him ... XEROX him --