Coolest Cluster Ever 279
sw155kn1f3 writes "Scientists at Los Alamos National Laboratory built a cheap (less than $1k per unit) 294-unit Beowulf claster dedicated to run astrophysics calculations. According to their website it's 85th fastest computer in the world. Seems cool and promising as it made with cheap components and off the shelf hardware."
mainstream (Score:1)
Imagine... (Score:5, Funny)
Imagine a... (Score:1, Funny)
-)
astrophysics...astromech? (Score:1, Offtopic)
Re:astrophysics...astromech? (Score:1)
Re:astrophysics...astromech? (Score:1)
Threepio is Faggy? (Score:2)
Obligatory (Score:4, Funny)
Re:Obligatory (Score:3, Funny)
Slashdot culture archive (Score:3, Interesting)
I'd love to read something like this, if anyone ever gets around to setting up a website to archive these.
It's very difficult to identify trends (like, say, what the meaning of hot grits is) long after the fact -- you're looking at hundreds of thousands of old tech posts. But if someone is thoughtful enough to make a note that this is happening...well, five or ten years from now, it could be quite a fun to read little work.
Uh oh (Score:3, Insightful)
Re:Uh oh (Score:3, Funny)
Sheesh...
Re:Uh oh (Score:2, Funny)
We should actually be worried about the eithty-fourth fastest computer in the world... Saddam Hussein has built it out of a warehouse of imported PlayStation 2s.
And they used Shuttle XPC SS51Gs! (Score:5, Informative)
I thought Shuttles Mini-PCs were cool before but this really resets the scale... Now where is the HOWTO for this thing?
LinuxBIOS support for Shuttle XPC SS51G? (Score:1)
Re:And they used Shuttle XPC SS51Gs! (Score:5, Funny)
I was thinking that too when I saw the picture. I mean, how are they securing those boxes? The way it looks, I certainly wouldn't want to be standing near that rack when an earthquake hits...
But then, imagine: Cause of death: crushed by Beowulf cluster. That's a geek's dream come true!
Re:And they used Shuttle XPC SS51Gs! (Score:2)
Re:And they used Shuttle XPC SS51Gs! (Score:2)
The question has to be... why? I've never understood why so many people build clusters with essentially desktop PCs. Haven't these people ever heard of the 1U rack mount case? Yes, it's a slightly more expensive inital outlay. But surely the cost savings in terms of floorspace and power/cooling for such a large volume would outweigh that in no time flat? Plus the Shuttle, like most other desktop cases, don't have the option of hot swappable drives. With the number of machines in this sort of cluster, drive failure is a major problem. The ability to just pull the failed drive out of the front to replace it would be a huge win.
Re:And they used Shuttle XPC SS51Gs! (Score:2)
Re:And they used Shuttle XPC SS51Gs! (Score:2)
http://space-simulator.lanl.gov/ [lanl.gov]
Um, how does that make it the 'coolest'? (Score:5, Insightful)
Perhaps if it was going to run simulations of ultra-low temperature physics... get it? haha. I kill me.
Not that impressive (Score:1)
Re:Not that impressive (Score:3, Interesting)
For $294,000US, this has to impress you.
All of the top 10 fastest computers in the world are multi-multi-million dollar machines. This is a breakthrough because it represents another milestone in bringing supercomputing accessible.
$264k one day, $100k the next. I sincerely hope that soon small-to-medium enterprises can own supercomputers. With all the low budget physics stuff going on at Universities around the world, cheap supercomputing can only be a good thing.
Re:Not that impressive (Score:4, Informative)
Actually they can with software like that from Dauger Research [daugerresearch.com], Project Appleseed [ucla.edu] and Wolfram Research [wolfram.com] with gridMathematica [wolfram.com]
The cool thing here is that this code can be run on all of the desktop computers that already occupy companies and universities world wide allowing for easy access to supercomputer level computational speed (for those problems that can be attacked using parallel computation of course) using the same computers normally used for productivity.
Very cool.
Re:Not that impressive (Score:2)
For less than $300,000... (Score:4, Interesting)
Granted, I don't know what the hell they'd do with the computer, but it would be kind of cool to be on the list.
Re:For less than $300,000... (Score:1)
kick your opponent's butts in [insert favorite fps here]... ???
Re:For less than $300,000... (Score:2, Insightful)
The point being, if you are creaticve, you could find quite a few interesting things to do.
Re:For less than $300,000... (Score:2, Interesting)
There are thousands of complex systems that could be modeled that might provide fasinating insights. What happens when you run the Game of Life for 10^100 generations? How about compiling the Linux kernel in a genetic algorithim? Who knows?
Or.... (Score:5, Funny)
Like a prosititute.
You go to your high school reunion, what's, more impressive, the "Hugh Hefner" 100 $3k prostitutes that come with you, or the "Bill Gates" story about the 300 1k computers in your mom's basement?
Re:For less than $300,000... (Score:2)
Who'd pay the insurance and electric bills?
"Granted, I don't know what the hell they'd do with the computer..."
They'd spend another amount of cash on a OC-48 connection to the internet and then offer webhosting to website owners who think they might be next in line of getting linked in a story at slashdot.com
Re:For less than $300,000... (Score:2)
Duh! Doom III of course!
Nice Guys, Too (Score:1)
Why build one anymore? (Score:1)
Re:Why build one anymore? (Score:3, Interesting)
Shuttle (Score:2)
Now if there was ever an advert for Shuttle XPC systems, the image does that just nicely.
If I only had 1 Shuttle XPC, that would be great. I suppose Shuttle ought to add this site to their news section. Hopefully their web server runs off these systems and a fat internet pipe... just to test the /. load.
Wahaaaa, Now I know where those SS51Gs are (Score:2)
1000 machine beowulf cluster (Score:4, Interesting)
Yes, but... (Score:1, Offtopic)
Bull (Score:1, Redundant)
Re:Bull (Score:2)
And 499 more (Score:1)
I'd like to say USC has a machine in the top 100, but we don't. :(
Perhaps... (Score:2, Funny)
Whoah.. (Score:3, Funny)
I'm guessing the story submitters ran out of anti-MS ammo tonight. Heh.
It's satire, laugh.
Re:Whoah.. (Score:4, Funny)
Re:Whoah.. (Score:2, Funny)
That misperception disappeared when SNL inexplicably rose to popularity.
Re:Whoah.. (Score:2)
No, I meant misperception:
I had no intention of implying that he had ever concieved.
So M$ FUD partisans going bored? (Score:2)
When it will be the time M$ reaches the top 500 on supercomputing? Linux has been for long there. And it is getting nearer and nearer the first places. However, till now, Redmond couldn't manage to gather even a humble supercomputer made of crappy Windows. What is strangeas there are libraries for parallel computing on Windows.
So it seems that Windows is not ready for the bleeding edge... And no one knows when it will be...
Re:So M$ FUD partisans going bored? (Score:2)
1. Xbox's 2. ??? 3. Profits!! (Score:2)
Yeah, I know it's not true, but it definately seems like it might have been a good idea.
Reminds me of.... (Score:2, Insightful)
Although if I recall correctly they ended up quite a bit higher on list.
Like all government news... (Score:3, Interesting)
We are the last to know about it
Hmm... (Score:5, Funny)
2. ???
3. SLASHDOT!
Laugh, it's a joke.
cheap clusters can also be bad (Score:2, Funny)
Supercomputers are controlled by USA export laws, but powerful beowulf clusters can be made by anyone with a reasonable amount of money and knowlage. Since the software is free and of the shelf components can be used... wouldn't it be possible for terrorists to use open-source software to create their own supercomputers to test nucular weapons, crack American law and millitary encryption, ect... ?
I believe this 'beowulf' techonology, as great as it is, could be possible dangerous to American interests. It is my hope that this software will soon be controlled by the American millitary and not be spread for free because I fear for the safety of my family and country (bless them both) if terrorists have access to supercomputing technology.
Re:cheap clusters can also be bad (Score:3, Funny)
Re:cheap clusters can also be bad (Score:2)
85th Fastest in the World? (Score:4, Funny)
But now that they've got the 85th fastest computer, what will they have to do to maintain that coveted position? I imagine the people who are running 86th are rushing out to buy more nodes. My own computer is the world's 27,385,422nd fastest, and I'm battling like crazy to get to 27,385,421.
Re:85th Fastest in the World? (Score:3, Funny)
I'm not going down without a fight.
Re:85th Fastest in the World? (Score:2)
Socrates? Hmmmm.
Re:What about the first 84? (Score:3, Informative)
(Dammit
The *real* reason for building this (Score:2, Funny)
Nobody worded it the way I wanted, so... (Score:2)
Ahh, Comic Book guy (Score:2)
Since the headline reminds me of the Comic Book Guy, I will dedicate this post to him. Besides, if this cluster, supercomputer, beo thingy is only 85th fastest in the world, you would think that they would use it to figure out the Comic Book Guy's rating scale (or something of equal importance) as opposed to some physics mumbo jumbo.
An excerpt:
[BABF01] Treehouse of Horror X: Desperately Xeeking Xena [snpp.com]
(The Collector, slowly, strikes a dramatic pose)
Collector(CBG): Lucite hardening ... must end life in classic Lorne Greene
pose from "Battlestar Galactica." Best ... death ... ever!
Yes! (Score:2, Funny)
On a (Score:2)
Re:On a (Score:2)
Sure, off the shelve cheap stuff... (Score:3, Interesting)
i can imagine the small size of the Shuttles being an advantage, not to mention the "coolness" factor looking at it. (i assume the "cool" in the intro refers to emotion and not teperature!!)
But getting computation done cheap is no longer the challenge. It's getting the data from one node to the other. They still need "custom" expensive equipment for this.
I see they use 3com gigabit ethernet. having this 300+ gigabit switch capability is not "cheap".
Until one can buy this kind of networking equipment for really cheap, we shouldn't mention things like "of the shelve Beowulf super computer in the top 100".
Re:Sure, off the shelve cheap stuff... (Score:5, Informative)
i can imagine the small size of the Shuttles being an advantage, not to mention the "coolness" factor looking at it. (i assume the "cool" in the intro refers to emotion and not teperature!!)
But getting computation done cheap is no longer the challenge. It's getting the data from one node to the other. They still need "custom" expensive equipment for this.
I see they use 3com gigabit ethernet. having this 300+ gigabit switch capability is not "cheap".
Until one can buy this kind of networking equipment for really cheap, we shouldn't mention things like "of the shelve Beowulf super computer in the top 100".
Up until 3 hours ago, we [swin.edu.au] said we were the only machine in the top500 dedicated solely to astrophysics. Now we are one of 2
But we use 180 processors, @ 2.15 GHz, and get about 0.90 Gflops/processor, whereas they get about 0.88 gflops/proc, getting us in the top 180th.
The difference being they have faster memory, and we have a big badass switch. They have two switches, with something like only 10 gigabit between the switches! We have 250gbit within our one switch. a third of our nodes have 2 gigs RAM, and we also have room for upgrade to more nodes on our switch, and they don't. So, in the words of Nelson "Hee haw!"
When they say $1000 per proc, they are not factoriing in their two switches. This will bring the price up to about $500,000, unless someone is donating a switch or 2
We have about the same cost ratio - something like 250,000
how about an Ask Slashdot with these guys? (Score:2)
Do you need a hard drive in each node? (Score:3, Interesting)
What is the advantage of having a hard drive in each node. Can't you boot each node off of a networked image and load the OS and whatever "work" into memory.
thanks
Where do yo swap... (Score:3, Informative)
Ok, modern LANs, especially this one is a lot faster, but you still don't want to burden your cluster communications bus with disk I/O requests.
Anyway, that 80 gig Maxtor does not add much to the cost of the node.
Re:Where do yo swap... (Score:2)
It's not the price of a hard disk in a cluster node that causes the trouble, it's the fact that you now have one more power-drawing, heat-generating, moving part - that's more likely to fail than anything else in the system!
Re:Where do yo swap... (Score:2)
The main problem with file loads over a network is the lack of multicast protocols for file transfer (I know there are ways, but they are experimental).
Interestingly enough, these boxes also have firewire which can be used as another form of cluster interconnect.
What would you use one for? (Score:2)
And I'm hoping I won't get the obligatory "pr0n collection" jokes.
Re:What would you use one for? (Score:2)
Topology? (Score:2)
What's the bandwidth of that trunk? Also, what's the capaity of the connections between each 16-port card and the backplane?
Just curious... suppose all the units on a 16-port card have 1Gbps each, but only 8Gb total to the backplane. Then the backplane, in turn, has only 8Gb to the other switch. These are just made up numbers, but how would beowulf handle it? Can it group jobs requiring higher communication throughput onto the nodes which are closer to eah other? Does it have to be told the topology, or does it figure it out?
Re:Topology? (Score:4, Interesting)
Just curious... suppose all the units on a 16-port card have 1Gbps each, but only 8Gb total to the backplane. Then the backplane, in turn, has only 8Gb to the other switch. These are just made up numbers, but how would beowulf handle it? Can it group jobs requiring higher communication throughput onto the nodes which are closer to eah other? Does it have to be told the topology, or does it figure it out?
Sounds like they have 10 ports @ 1Gbit each free, so get about 10Gbit between the switches. When we [slashdot.org] (position 180 on the latest top500) were investigating thin-tree connections, we thought that we might be able to effectively run one job on a third of the nodes, another on the second third, and miscellaneous jobs on the 3rd (since we have two or 3 researchers who like to use lots of resources, and people like me who only need a single proc at a time). So you just partition the nodes and only allow your mpi jobs to sit on one group at a time.
Then there are things like openmosix which deal with topology automatically somehow. They will try to calculate the speed of the interconnect and the various nodes' procs (if heterogenous), and work out the distribution in the most efficient way. I am going to try to convince my sysadmin to try out openmosix on the lesser-used nodes of the cluster, because there is a feature of it that I think one of us might like - the combination of memory of the different nodes in one big contigous space, but right now we are busy cleaning up after the upgrade.
Hmmm..I'll bet they needed this to figure out.... (Score:2)
Small... (Score:2)
Not sure who makes those plain metal racks, but I picked some up at costco(brown box), and they are sweet. They have big caster wheels so you can get to the cables. I use them in the closet, tv rack, and my server rack.
Setting up the hardware is easy, I'm curious about the clustering software. Wonder if any 3d rendering packages exist (opensource/free) work on a linux cluster.
-
"Marijuana? Cocaine? I'm not going to talk about what I did as a child." - President Bush
Jabberwocky cluster? (Score:2)
Take all of our fun away by using a beowulf cluster... damned scientists. Everything else just sounds lame.
The-tyger-cluster? Sounds more like some sorta lame attack. Bah, ferget it.
Good and Good Again (Score:2)
I've followed Mike Warren's earlier Linux clusters with interest: Loki (x86), mid-90's, and Avalon (Alpha) a few years ago.
The free software and low cost supercomputer are not so much news anymore since every intelligent consumer of compute cycles has at least one of these clusters available. No one has to "imagine" them anymore; they are real and commonplace.
What's a nice development here is that the Los Alamos team has not only brought down the ratio of
but they've started looking to bring down the ratio of as well.It represents an uncharastically appropriate use of resources at the Department of Energy and it also helps point the way for businesses looking to further minimize operational costs of racks of computers in air-conditioned rooms.
blah blah blah (Score:2)
hahaha, I'm so funny. Laugh at my stupid played-out beowulf cluster joke...
Yes (Score:2)
Re: (Score:2)
ACK! (Score:2)
GAHH! Finally a story where the beowolf cluster is an actual part of the story and you misspell it!
Re:Wow (Score:5, Informative)
Actually, the heat pipe doesn't replace the fan, it just lowers the number of fans used in the system, since the case and processor fan can be combined.
Tom's Hardware has a review of one of these things (not the same model though)... have a look [tomshardware.com].
Re:ha! (Score:1)
ie. where each beouwulf cluster is set to solve a particular problem. once done it sends the answer(s) to other beouwulf clusters, in accordance to the master plan by the Big-CHEESe beowulf cluster, the BRAIN, if you will. In this way, the entire package of beouwulf clusters can work together as a super Beowulf Cluster, or Super Bluster for short.(more on that later)
You don't understand!!! (Score:1)
Re:I doubt this thing will run for long... (Score:2)
So much for it being the coolest cluster ever.
Re:I doubt this thing will run for long... (Score:2, Funny)
But it's a dry heat.
Re:I doubt this thing will run for long... (Score:2, Insightful)
How can you have that as your sig when your entire post was one big troll against Intel, Maxtor, and DDR SDRAM? It's not ironic, it's hypocritical.
You have to be kidding (Score:2, Insightful)
Also don't forget that you've got 3 years warranty on those Maxtors, and you can just reload the OS on the bare drive from a copy of one of the other 280 someodd. Sure they suck, but are you really ever even using them? I bet they just got a special on a whole box of em and 80's were all there were.
RAM is exactly where these computers need in large, fast quantities. RDRAM, while arguably faster, is a money sucking wench, and 333 is just perfectly fine if you actually do your homework and buy the right chips. Sure, if you go and pick up the deal of the century at the lowest priced vendor online then you can expect to get some odd results. But if you are buying 300 gigs of the stuff you can get a pretty sweet deal out of a reputable manufacturer and get the nice chips to boot. And don't forget that those come with a warranty too; so you just send the dicey ones back....who cares if you lose a few boxes for a day or two?
It's the coolest because it puts off less heat than most, using the head-pipe feature off the cpus. Run a big HVAC and hook it up to those pipes, and all of a sudden you have A/C cooling directly on your chips, and its more quiet to boot.
This thing is built out of parts that are in *your* computer. It's built from the parts that are moving the fastest thru the vendors. Every single part of this cluster could be purchased in lot quantities at a very reduced cost due to slowdowns in the last 9 months.
Not including the network backbone, you can build the very computer they are using for much less than a grand per node and have it rate; I think that was the point and I think that they made it.
Think again - EDA tools prove this wrong (Score:3, Interesting)
Sorry, but commodity PC hardware really does have a place in real computational work on the design of multimillion-gate standard-cell ASICs like the ones going into the latest Nvidia and ATI cards. The Suns are, for now, necessary, but it won't be long until commodity hardware usurps its place for a fraction of their overpriced niche monopoly in EDA tools.
rats (Score:2)
Kind of like owning a hot rod Pinto (not), and taking heat from your friends until one shows up in the top ten at Daytona...
Re:rats (Score:2)
I think the only thing that will help that rat's nest is an air brush
Yes, Gallery is working good for me. I went thru a 1/2 dozen apps/script sets before I tried Gallery, and it is well above the rest.
Re:I doubt this thing will run for long... (Score:2)
Yes, they should have bought IBM deskstars instead. They are cheap and they know exactly what they are going to get.
Last year I bought a maxtor harddrive, only thing it ever did for me was crash my BIOS. So I got it replaced with a deskstar, at least I knew that one was going to work. It did.... for half a year. And BTW since then I have only bought seagate drives.
Re:you have got to be kidding me (Score:2)
Re:Using Shuttle XPC SS51Gs no less... (Score:2)
Re:Last Post.... (Score:2)
Until I press Submit that is.
Re:Did anyone else notice ? (Score:2)
I dont know what you downloaded, but the jpeg "ss1" on the front page is 1,160,721 bytes ... or 1.10MB