Weta Digital Supercomputer For Hire 184
sushi writes "NZ's Stuff news site is reporting: 'Peter Jackson's special effects shop Weta Digital has teamed ... to establish a world-class supercomputing facility in Wellington which will be rented out to clients worldwide.' Currently comprising 504 IBM blade servers, each of which contains two 2.8 Gigahertz Intel Xeon processors, 6 Gigabytes of memory and 40 Gigabytes of storage, and ranked 80th in the top 500 supercomputers, they are intending to upgrade into the top 10. Also covered at the Australian Financial Review."
So... (Score:3, Funny)
Nah... (Score:1)
Re:Nah... (Score:1)
Dead Aliver?
Deader Aliver?
Re:Nah... (Score:3, Funny)
Re:Nah... (Score:2, Insightful)
No point in dragging down a person who has proclaimed himself to be the most devout Christian since the Apostles.
Re:Nah... (Score:2, Funny)
Mods on crack? (Score:1)
Dupe? (Score:5, Informative)
Re:Dupe? (Score:5, Funny)
Imagine (Score:3, Funny)
Good (Score:1)
Awesome (Score:3, Funny)
Re:Awesome (Score:1, Funny)
Re:Awesome (Score:2)
Re:Awesome (Score:1)
I highly recommend checking out GoF member Dave Allen's Elastic Purejoy self titled album (from 1994). It ranges from very GoF inspired dance-rock to grunge rock to psychedelia and everywhere inbetween. Between songs wi
Re:Awesome (Score:2)
I have been really reluctant to buy old CDs I used to have to try and relive old the days but I will have to make another exception for GOF I guess.
Re:Recent good music (Score:2)
I'll check out your suggestions.
One more thing... (Score:2)
Re:Awesome (Score:5, Insightful)
Re:Awesome (Score:4, Funny)
"To Pure Mathematics - may it never have any practical use!"
Re:Awesome (Score:2, Insightful)
Or, you know, a spell-cheeker...
Re:Awesome (Score:1)
Better than:
'We have foundz ze nth dimenzion of ze nd dimenzion of the nd dimenzion of ze univerz'
How will this bring joy to our lives and prevent world poverty?
'We have foundz ze nth dimenzion......'
Re:Awesome (Score:3, Insightful)
Now, for 'real time', it'd be shat
top 500 ! (Score:5, Informative)
Correction? (Score:5, Insightful)
Re:Correction? (Score:3, Informative)
It has 1080 processors [top500.org] (540 blade servers) and is at rank 80.
Weta's primary cluster (not for rent!) has 1176 processors [top500.org] and is at rank 77.
Doomsday scenario (Score:5, Interesting)
How soon before the bad guys set up a dummy corporation and start running nuclear bomb or protein folding simulations on this cluster? I'd be very interested (probably along with some governments) in Weta's and Gen-i screening processes. Will anyone who can foot the bill get access?
I know, this is tinfoil hat stuff, but it's late and I get this "glass half full" visions when I'm sleep deprived.
Cheers,
E
Re:Doomsday scenario (Score:5, Insightful)
How soon before the bad guys set up a dummy corporation and start running nuclear bomb or protein folding simulations on this cluster?
The hardest part by far in making a nuclear weapon is getting the fissile material. If you are able to get highly enriched uranium you don't even need to do any simulations, the design is fairly simple and no testing is needed. Plutonium is a bit harder.
The point though is that computer simulations of nuclear weapons is the least of your problems, and is by no means required. Computers aren't secrets, and getting a few hundred of them together in a cluster is a task anyone with $100,000 can easily accomplish. Compared to getting the required fissile material, any required computations are easy.
I'm not sure what you're getting at with protein folding. Is their some doomsday weapon you can create by knowing how proteins fold? Even if it is, it's not a big concern. No one has gotten even close to completely simulating a protein folding. There's simply not enough computing power yet. What's been done to date are just small scale simulations.
Re:Doomsday scenario (Score:1)
Not as much using simulation to try to figure out how to make a cheaper or more deadly weapon.
Re:Doomsday scenario (Score:3, Interesting)
I think it would depend on how open it is. The New Zealand government is strongly anti-nuclear (however rational or irrational that may be). eg. US nuclear vessels aren't allowed within the NZ economic zone. This type
Re:Doomsday scenario (Score:1)
Re:Doomsday scenario (Score:2)
And, yes - they are evil.
Re:Doomsday scenario (Score:1)
my precious..... (Score:3, Funny)
Finally! (Score:4, Funny)
for one second (Score:2, Funny)
Re:Finally! (Score:2, Funny)
Re:Finally! (Score:2)
rent it out (Score:4, Insightful)
Re:rent it out (Score:2, Funny)
But yeah, renting it out seems like a smart idea.
Re:rent it out (Score:1)
Re:rent it out (Score:1)
Re:rent it out (Score:1)
OOO! I've got an even better idea - why don't they rent it out to other companies and stuff? That way, when they're not using it, it isn't going to waste; I mean, tihnk how useful that could be.
We should start a petition asking them to do that.
Digital Supercomputer? (Score:2, Funny)
Re:Digital Supercomputer? (Score:1)
Re:Digital Supercomputer? (Score:2)
Re:Digital Supercomputer? (Score:2)
Re:Digital Supercomputer? (Score:2)
You're living on it [h2g2.com]! ;-)
An idea... (Score:5, Interesting)
Yeah, I know, the logistics of it, the devil would be in every detail... Neat to think about though.
Re:An idea... (Score:3, Informative)
Re:An idea... (Score:2)
Re:An idea... (Score:5, Insightful)
You know, that only has ~500 nodes right?
It has 500 nodes that are highly and quickly interconnected. It's like the difference between 500 people working on a problem in the same room, and 500 people spread across the country communicating by postal mail. Most interesting problems require a lot of inter-communication, so 500 slowly connect nodes isn't too usefull.
Re:An idea... (Score:2)
It's good (Score:1)
Re:It's good (Score:2)
The problem with starting it out as widely distributed is the marketability of such a system. If you walk into a university or corporation trying to sell them the idea of 2000 machines run by people around the States, they'll picture half of them as being 14 year olds with modem connections.
That might be overstating it a bit, but the way I see it, even if you have 1000 people with two machine
Re:It's good (Score:2)
Faster pr0n (Score:1)
distcc? (Score:3, Funny)
(Go Gentoo!)
Imagine a b..... (Score:1, Funny)
Don't even say it!
Weta's old cluster (Score:5, Interesting)
That's a total of 124GHz and 124GB of RAM. We're using it to render architectural fly-through movies.
Hmm... I'm all hot now... Need a cold shower!
Re:Weta's old cluster (Score:3, Funny)
We're using it to render architectural fly-through movies
Give us a link to one of these movies and we would be happy to SlashdotYouNow
Re:Weta's old cluster (Score:2)
That's like asking him to pull your finger. Only the foolish, horribly masochistic, or hopelessly naive would fall for that one.
Once and for all... (Score:1)
We will now truly be able to figure out how many New Zealanders it takes to change a light bulb.
Re:Once and for all... (Score:4, Funny)
We will now truly be able to figure out how many New Zealanders it takes to change a light bulb.
Just one, but he won't change the bulb - he'll fix it using bind-a-twine and 8-guage fencing wire.
(Disclaimer: exiled Kiwi)
I hope that was 40 terabytes... (Score:1, Redundant)
Re:I hope that was 40 terabytes... (Score:2)
If you can't even read the stub correctly, I know you didn't RFTA...
Noooooooo.... laptop hard drives... (Score:5, Interesting)
I guess with 6 GB RAM each they shouldn't have to do much (or ANY, if I was running this) swapping, and if the jobs are tweaked to not use the hard drives too intensively, they might be OK. If what you do uses the hard drives for much, they are sh*t, to put it mildly. If you could plug these [seagate.com] into the blades, they's be very useful, quick machines. But you can't yet.
The really crap thing is, if you do want SCSI drives in the IBM blades, you connect a module ot the side of the blade which gives you a couple of proper SCSI drive bays. Which halves the number of blades-per-bladecenter to 7.
Given the bladecenter is 7U tall, you'd be better off with 7 1U servers with SCSI bays already in and better NIC options. The internal networking of the bladecenter is awful for everything but the simplest low-requirement setups - it's hideously expensive to give each blade a couple of gigabit connections.
Even these cheap little things [dell.com] are 1U, take 2 U320 SCSI drives, and have dual Gigabit connections built-in.
And I *still* can't get USB dongles to work with thes fscking blades, grumble grumble.
Having said all that, when can I play on this thing? My Folding@Home could do with a bit of a boost, and with Hyperthreading I could have 2016 units running simultaneously.... although it might get a little warm behind the racks, 1008 2.8 GHz Xeons pump out a good bit of heat!
Re:Noooooooo.... laptop hard drives... (Score:1)
For storage, the blades are provided with Fiber channel access for SANs.
Re:Noooooooo.... laptop hard drives... (Score:2)
They provide compute density (1/2 U for two processors), nothing more. A significant portion of people I know run blades diskless off of ramdisk or NFS where decent systems actually house the storage. In blades, the only mechanical component that is not hot-swappable is the drive, so there is a desire to not rely on it at all for a lot of people I know.
Hideously expensive to get both gigabit NICs connected? Technically speaking, those Ethernet switch
I need to get more sleep... (Score:3, Funny)
"Weta Digital Supercomputer For Hire"
as
"Weta Digital Supercomputer On Fire"
Thought, whoa, finally some big news on Slashdot!
But no... Anyone willing to go with me to put them on fire for some hot Beowulf cluster action?
Small potatoes (Score:3, Interesting)
If they're going to market this capacity, they had better do it quick. The shelf life of computational power is not much greater than milk.
Connectivity Question (Score:5, Funny)
~D
They tried ... (Score:3, Funny)
They tried, but they discovered an error in the protocol whereby the one who held the token wouldn't let it go.
=)
Tolkien Ring (Score:2)
And I bet the majority on here haven't had to worry about taking a whole office network down by knocking off a terminator on a 10base2...
Damn kids today. Got everything easy.
Re:Tolkien Ring (Score:2)
Re:Connectivity Question (Score:2)
Weta Digital please read this! (Score:2, Interesting)
What about #77 (Score:2, Interesting)
top 500 page for the cluser here [top500.org]
Why don't they just combine the two. That would surely grant them a top 10 spot...
sure they did the LOTR trilogly but.... (Score:1)
Re:6gig of memory? (Score:1)
Re:6gig of memory? (Score:4, Informative)
Only 6gig of memory? Is it me or that that seem a stupidly low amount when dealing with a amachine of this power?
That's 6GB for each of the 504 (not 512??) nodes, or 3GB per processor, almost 3TB total. Trust me, that's plenty for all but the most extreme uses.
Re:6gig of memory? (Score:5, Insightful)
Do remember that 90% of the time, it's not the size that matters , but the organization.
I've worked on a relatively small cluster processing experiment in college with 12 boxes on a 10 Mbps LAN with a combined memory of 1.5 Gb RAM . It might not look much , but with 32 MB of RAM on each box (each had 128 MB ram) being held by the home cooked shared memory daemon (this was waaay before memcached was born, Ok) , the boxes ran the number crunching beautifully
The operation needed was simple, to sort and process an amazingly HUGE chunk of data in almost realtime (in this case some wierd algorithm some Mech teacher wanted and did up in C).
Anyway in about 7 weeks and reusing a dozen of the college's vanilla PCs we did a LOT of interesting things
So my question is , how's the server connected memory wise (most of these tasks are highly memory bound or at least that's the major bottleneck to optimise).
Re:6gig of memory? (Score:4, Funny)
Re:6gig of memory? (Score:2)
Re:6gig of memory? (Score:1)
Re:6gig of memory? (Score:1)
Re:6gig of memory? (Score:1)
Re:6gig of memory? (Score:3, Informative)
Re:This is great (Score:3, Funny)
Missile trajectories? All you need to calculate that stuff is a Playstation2... Quick! We need to keep these "supercomputers" inside honest nations too
Re:This is great (Score:2, Informative)
Who's honest (Score:2)
On one side , real nuclear testing is banned
The US of A knows the importance of mutually assured destruction (@see{Cold War})
Re:This is great (Score:3, Interesting)
Re:This is great (Score:2)
Re:This is great (Score:4, Funny)
Re:Image a... (Score:2, Interesting)
Re:40 Gigabytes of storage.. (Score:2, Informative)
Re:40 Gigabytes of storage.. (Score:2)
Re:40 Gigabytes of storage.. (Score:2)
450MB for 30 seconds isn't very much when you consider how much time and power it takes to produce those 720 images.
In other words, of the many calculations done in rendering (including ray-tracing, AI, etc.) very little those calculatio
Re:40 Gigabytes of storage.. (Score:2)
I'm sorry. But they are just images. Even if they have a large colour-space and aren't compressed, they are nothing compared to the amount of data used during the processing of the image.
And don't forget, each server is only g
Re:King Kong (Score:4, Funny)
Why do you think they're renting out the cluster?