Facebook

Facebook's Corona: When Hadoop MapReduce Wasn't Enough 42

Nerval's Lobster writes "Facebook's engineers face a considerable challenge when it comes to managing the tidal wave of data flowing through the company's infrastructure. Its data warehouse, which handles over half a petabyte of information each day, has expanded some 2500x in the past four years — and that growth isn't going to end anytime soon. Until early 2011, those engineers relied on a MapReduce implementation from Apache Hadoop as the foundation of Facebook's data infrastructure. Still, despite Hadoop MapReduce's ability to handle large datasets, Facebook's scheduling framework (in which a large number of task trackers that handle duties assigned by a job tracker) began to reach its limits. So Facebook's engineers went to the whiteboard and designed a new scheduling framework named Corona." Facebook is continuing development on Corona, but they've also open-sourced the version they currently use.
Intel

Intel Details Eight-Core Poulson Itanium Processor 102

MojoKid writes "Intel has unveiled details of their new Itanium 9500 family, codenamed Poulson, and the new CPU appears to be the most significant refresh Intel has ever done to the Itanium architecture. Moving from 65nm to 32nm technology substantially reduces power consumption and increases clock speeds, but Intel has also overhauled virtually every aspect of the CPU. Poulson can issue 11 instructions per cycle compared to the previous generation Itanium's six. It adds execution units and re-balances those units to favor server workloads over HPC and workstation capabilities. Its multi-threading capabilities have been overhauled and it uses faster QPI links between CPU cores. The L3 cache design has also changed. Previous Itanium 9300 processors had a dedicated L3 cache for each core. Poulson, in contrast, has a unified L3 that's attached to all its cores by a common ring bus. All told, the new architecture is claimed to offer more than twice the performance of the previous generation Itanium."
Facebook

Submission + - Facebook's Corona: When Hadoop MapReduce Wasn't Enough (slashdot.org)

Nerval's Lobster writes: "Facebook’s engineers face a considerable challenge when it comes to managing the tidal wave of data flowing through the company’s infrastructure. Its data warehouse, which handles over half a petabyte of information each day, has expanded some 2500x in the past four years—and that growth isn’t going to end anytime soon.

Until early 2011, those engineers relied on a MapReduce implementation from Apache Hadoop as the foundation of Facebook’s data infrastructure. Still, despite Hadoop MapReduce’s ability to handle large datasets, Facebook’s scheduling framework (in which a large number of task trackers that handle duties assigned by a job tracker) began to reach its limits. So Facebook’s engineers went to the whiteboard and designed a new scheduling framework named “Corona.”"

Power

Germany Exports More Electricity Than Ever Despite Phasing Out Nuclear Energy 473

An anonymous reader writes "Der Spiegel reports that Germany has exported more electricity this year than ever before, despite beginning to phase out nuclear power. In the first three quarters of 2012, Germany sent 12.3 terawatt hours of electricity across its borders. The country's rapid expansion into renewable energy is credited with the growth. However, the boost doesn't come without a price. The German government's investments into its new energy policy will end up costing hundreds of billions of dollars over the next two decades, and it still relies on imports for its natural gas needs. It also remains to be seen whether winter will bring power shortages. Is Germany a good example of forward-looking energy policy?"
Power

Submission + - Germany exports more power than ever despite phasing out nuclear enegery (google.com)

An anonymous reader writes: The german magazine "Der Spiegel" writes, that "the current export from Germany reached a record high this year — despite nuclear phase. Reason is the boom in green energy." Especially in the Netherlands power-plants are shut down because "electricity imported from Germany is cheaper." Is Germany an example of forward looking energy policy after all?
Businesses

The Island of Lost Apple Products 105

concealment writes "most of Apple's products are so popular that it seems everything the company does is destined to succeed. But it doesn't take much digging to find a trail of failures and false starts. Even in recent years, there are examples of products that seemed great but never resonated with consumers, and some that seemed so destined for failure it's hard to imagine why any company would have brought them to market. Here are some examples of Apple veering a bit off course."
Cloud

Why Would a Mouse Need To Connect To the Internet? 249

jbrodkin writes "In this hyper-connected, networked world, many more of our devices are getting linked to the cloud, whether we want them to or not. That's sometimes good, and sometimes bad, so when a basic device like a mouse requires a user to go online and set up an account to activate all of its functionality, people are understandably going to ask why? The latest entry in the saga of 'Why the hell does this thing need to connect to the Internet?' comes from Razer, which has caused an uproar by asking users to register gaming mice on the Internet. While it's mainly for syncing settings across devices, gamers are complaining that certain functionality might not be available unless you create an online account for your mouse. Razer has responded to the controversy, but its answers aren't entirely satisfactory."
Intel

Cray Unveils XC30 Supercomputer 67

Nerval's Lobster writes "Cray has unveiled a XC30 supercomputer capable of high-performance computing workloads of more than 100 petaflops. Originally code-named 'Cascade,' the system relies on Intel Xeon processors and Aries interconnect chipset technology, paired with Cray's integrated software environment. Cray touts the XC30's ability to utilize a wide variety of processor types; future versions of the platform will apparently feature Intel Xeon Phi and Nvidia Tesla GPUs based on the Kepler GPU computing architecture. Cray leveraged its work with DARPA's High Productivity Computing Systems program in order to design and build the XC30. Cray's XC30 isn't the only supercomputer aiming for that 100-petaflop crown. China's Guangzhou Supercomputing Center recently announced the development of a Tianhe-2 supercomputer theoretically capable of 100 petaflops, but that system isn't due to launch until 2015. Cray also faces significant competition in the realm of super-computer makers: it only built 5.4 percent of the systems on the Top500 list, compared to IBM with 42.6 percent and Hewlett-Packard with 27.6 percent."
Earth

Open Compute Wants To Make Biodegradable Servers 102

1sockchuck writes "The Open Compute Project has challenged students at Purdue University to develop a biodegradable server chassis. Although the steel used in most server chassis can be recycled, the OCP says it wants to "explore designs that retain the needed resiliency but push the boundaries of sustainability," even allowing a chassis to be composted. The project aligns with Facebook's goal of separating the technology refresh cycle for CPUs and other components from the surrounding chassis and racks. The Purdue students will tackle this issue next semester, but Slashdot readers can brainstorm the issue now. Is a biodegradable server chassis viable? If so, can it be affordable?"
Data Storage

Submission + - A year after Thailand flooding, hard drive prices remain high (techreport.com) 1

crookedvulture writes: "Last October, Thailand was hit by massive flooding that put much of the world's hard drive industry under water. Production slowed to a crawl as drive makers and their suppliers mopped up the damage, and prices predictably skyrocketed. One year later, production has rebounded, with the industry expected to ship more drives in 2012 than it did in 2011. For the most part, though, hard drive prices haven't returned to pre-flood levels. Although 2.5" notebook drives are a little cheaper now than before the flood, the average price of 3.5" desktop drives is up 35% from a year ago. Prices have certainly fallen dramatically from their post-flood peaks, but the rate of decline has slowed substantially in recent months, suggesting that higher prices are the new norm for desktop drives."
Intel

Submission + - Cray Unveils XC30 Supercomputer (slashdot.org)

Nerval's Lobster writes: "Cray has unveiled a XC30 supercomputer capable of high-performance computing (HPC) workloads of more than 100 petaflops. Originally code-named “Cascade,” the system relies on Intel Xeon processors and Aries interconnect chipset technology, paired with Cray’s integrated software environment. Cray touts the XC30’s ability to utilize a wide variety of processor types; future versions of the platform will apparently feature Intel Xeon Phi and Nvidia Tesla GPUs based on the Kepler GPU computing architecture. Cray leveraged its work with DARPA’s High Productivity Computing Systems program in order to design and build the XC30.

Cray’s XC30 isn’t the only supercomputer aiming for that 100-petaflop crown. China’s Guangzhou Supercomputing Center recently announced the development of a Tianhe-2 supercomputer theoretically capable of 100 petaflops, but that system isn’t due to launch until 2015. Cray also faces significant competition in the realm of super-computer makers: it only built 5.4 percent of the systems on the Top500 list, compared to IBM with 42.6 percent and Hewlett-Packard with 27.6 percent. However, Cray also leads Appro (3.6 percent) and SGI and Bull (3.2 percent each)."

Hardware

Submission + - Open Compute Wants to Make Biodegradable Servers (datacenterknowledge.com)

1sockchuck writes: The Open Compute Project has challenged students at Purdue University to develop a biodegradable server chassis. Although the steel used in most server chassis can be recycled, the OCP says it wants to "explore designs that retain the needed resiliency but push the boundaries of sustainability,” even allowing a chassis to be composted. The project aligns with Facebook's goal of separating the technology refresh cycle for CPUs and other components from the surrounding chassis and racks. The Purdue students will tackle this issue next semester, but Slashdot readers can brainstorm the issue now. Is a biodegradable server chassis viable? If so, can it be affordable?
Hardware

Samsung May Start Making ARM Server Chips 116

angry tapir writes "Samsung's recent licensing of 64-bit processor designs from ARM suggests that the chip maker may expand from smartphones and tablets into the server market, analysts believe. Samsung last week licensed ARM's first 64-bit Cortex-A57 and Cortex-A53 processors, a sign the chip maker is preparing the groundwork to develop 64-bit chips for low-power servers, analysts said. The faster 64-bit processors will appear in servers, high-end smartphones and tablets, and offer better performance-per-watt than ARM's current 32-bit processors, which haven't been able to expand beyond embedded and mobile devices. The first servers with 64-bit ARM processors are expected to become available in 2014."
Biotech

Submission + - Ear-powered medical devices in development (gizmag.com)

cylonlover writes: Our ears work by converting the vibrations of the eardrum into electrochemical signals that can be interpreted by the brain. The current for those signals is supplied by an ion-filled chamber deep within the inner ear – it’s essentially a natural battery. Scientists are now looking at using that battery to power devices that could be implanted in the ear, without affecting the recipient’s hearing.

The “battery chamber” is located in the cochlea. It is internally divided by a membrane, some of the cells of which are designed to pump ions. The arrangement of those specialized cells, combined with an imbalance of potassium and sodium ions on opposite sides of the membrane, are what creates the electrical voltage.

A team of scientists from MIT, the Massachusetts Eye and Ear Infirmary, and the Harvard-MIT Division of Health Sciences and Technology have recently succeeded in running an ultra-low-power radio-transmitting chip using power from these battery chambers – in guinea pigs’ ears.

Hardware

Submission + - Samsung may start making ARM server chips (computerworld.com.au)

angry tapir writes: "Samsung's recent licensing of 64-bit processor designs from ARM suggests that the chip maker may expand from smartphones and tablets into the server market, analysts believe. Samsung last week licensed ARM's first 64-bit Cortex-A57 and Cortex-A53 processors, a sign the chip maker is preparing the groundwork to develop 64-bit chips for low-power servers, analysts said. The faster 64-bit processors will appear in servers, high-end smartphones and tablets, and offer better performance-per-watt than ARM's current 32-bit processors, which haven't been able to expand beyond embedded and mobile devices. The first servers with 64-bit ARM processors are expected to become available in 2014."

Slashdot Top Deals