Sony Tape Storage Breakthrough Could Bring Us 185 TB Cartridges 208
jfruh (300774) writes "Who says tape storage is out of date? Sony researchers have announced a breakthrough in magnetic tape tech that increases the data density per square inch by a factor of 74. The result could be 185 TB tape cartridges. 'By comparison, LTO-6 (Linear Tape-Open), the latest generation of magnetic tape storage, has a density of 2 gigabits per square inch, or 2.5 TB per cartridge uncompressed.'"
By way of context... (Score:5, Interesting)
Obviously, the cost of packaging a given number of square inches of HDD platter is markedly higher, so the tape is likely to offer better value(if you are using enough to spread the, generally alarming, cost of the drive(s) and possibly robotic library around a bit); but it's hard to beat the density of a very tightly controlled rigid medium that never leaves a controlled environment during its entire life.
Re: (Score:3)
Have you looked at the prices of a tape? In the last 10 years tape is on par on price with disks, and that is exluding the price of a tape deck.
Oh, I was delighted when the stodgy traditionalists finally bowed to the inevitable and let me move all the nearline and less-demanding-I/O to HDD. Tape still seems to be a bit more reliable if you want to just put something on the shelf and then spin it up in 5 years, HDDs can be a bit touchy about that.
Re: (Score:3, Insightful)
Re: (Score:2)
Tape still seems to be a bit more reliable if you want to just put something on the shelf and then spin it up in 5 years, HDDs can be a bit touchy about that.
Ya, I had a SCSI disk (run 24/7 for 7 years, then off for 3 years) that refused to spin up, but "tapping" on the side it with a screwdriver handle during power up fixed that. :-)
Re: (Score:3)
The problem with that is that at 10pm on a Friday night, after a server failure, when your only tape drive won't read the tape back properly... who do you call? Any tape drive that you order online isn't going to arrive until Tuesday at the earliest and very few local stores carry a $3500 tape drive.
That's why I dislike tape for smaller businesses if you don't have
Re: (Score:3)
Our failure rate for LTO is 2 in 12,000 (and one of those was dropped) over the last 10 years.
Re: (Score:2)
Ooh! I also have an anecdote! One of my LTO tapes' leader broke off in the drive, ruining not just the tape but the drive itself. $5k oops.
It was great for offsite backups, but my data needs have eclipsed LTO's capacity. I don't have the budget to keep upgrading my drives to chase my ever increasing storage needs. On the other hand, I scrounged up a server and a disk array to make a 28TB backup server for no extra cost.
Re: (Score:3)
2 in 12,000 isn't in anecdote, it's data.
Re: (Score:2)
I've just looked. I can get Quantum MR-L5MQN-01 LTO-5 tapes with a native (uncompressed) capacity for about £20. The sweet spot for disks right now seems to be 3TB at about £80, so that's twice as expensive per TB, but only if you don't include the tape drive. An LTO-5 drive costs about £1,300. To save that much I'd need to be using about 100TB of storage, which is a fairly small filer for a business, but an insane amount for a home user. Shopping around a bit, I can find some LTO-5 d
Re:By way of context... (Score:5, Informative)
To save that much I'd need to be using about 100TB of storage, which is a fairly small filer for a business, but an insane amount for a home user.
That's an insane amount for most businesses too! I've helped some small business owning friends out with their computer needs before and they couldn't fill a 1 TB hard drive if they tried. One of them, a veterinarian, said he wanted to keep a copy of his xray images on Amazon S3 as an off-site backup. I thought ok that's going to be a lot of data. Total was around 60 GB for 8 years' worth of xrays. The database backup for his practice management software is about 3 GB compressed.
Re: (Score:2)
Re: (Score:2)
Some will have backup needs as small as 50-100GB and most can probably fit all their data onto a single 1TB drive / tape.
Yeah, but (Score:5, Funny)
Re: (Score:2)
LOL, no. LTO is normally about 1/3rd the $/GB of SATA drives and 1/5th the price of NL drives. As an example LTO5 tapes are currently around $20 each when bought in reasonable quantities and hold 1.5TB uncompressed for a cost of $.0133/GB, the cheapest 3TB SATA drive at Newegg right now is $105 for a cost of $.035/GB.
Re: (Score:2)
LOL, no. LTO is normally about 1/3rd the $/GB of SATA drives and 1/5th the price of NL drives. As an example LTO5 tapes are currently around $20 each when bought in reasonable quantities and hold 1.5TB uncompressed for a cost of $.0133/GB, the cheapest 3TB SATA drive at Newegg right now is $105 for a cost of $.035/GB.
And the drive to read them? Tape is more expensive than disk up to about 50TB when you factor in all the costs.
Re: (Score:2)
Are you including power and cooling into the TCO calculation for disk?
Either way we're backing up around 38TB just for weeklies so it's obviously cheaper for us, and we're a midsized enterprise.
Re:By way of context... (Score:5, Funny)
Re:By way of context... (Score:5, Insightful)
There's always a tradeoff between hoarding and becoming a librarian. I could dedicate the next month of my free time to reducing my storage footprint, or I could cough up another $200 to increase my server space a bit. With the exception of running something like Grand Perspective, Space Monger, Baobab, etc. I'd rather just spend a few bucks.
Re: (Score:2)
But what's the point of recording your entire life if you have no bookmarks to get to the interesting parts?
Re:By way of context... (Score:4, Insightful)
Don't forget the 75GB of text documents. Even if they're uncompressed, that's around 30 million pages of text.
It's the most impressive collection of slash fiction about Kirk and Spock getting it on in the known universe.
Re:By way of context... (Score:4, Insightful)
Re: (Score:2)
What I'm more curious about is how the hell you end up with 75GB of text documents.
But is it even usable? (Score:5, Interesting)
So at 185TB per tape with the write speed of LTO6 "at speeds up to 400MB/s (1.4TB/hr) [quantum.com]" [optimal]....~132 hrs per tape. But in reality 300 MB/s or 1 TB/hr so about 176 hr/tape. 168 hours in a week.....Next weekly back up starts before the first one finished.....
Yeah, I know, they're not all level 0 backups.....you get the idea....sometimes it might be better to have 2 smaller tapes, than 1 large.
Re: (Score:2)
185TB
How many Library of Congresses full of porn is that?
Re: (Score:2)
It is estimated that the LOC, including video and audio is about 3000 TB. So, you would need 17 of these tapes I guess.
http://blogs.loc.gov/digitalpr... [loc.gov]
Or was your question rhetorical?
Re: (Score:3)
It's only the Bohner memorial Porn wing...
Re: (Score:2)
If the density is greater, the speed will (probably) be greater if the tape pull speed is the same....
Re: (Score:2)
It's probably a horses for courses thing though. There are plenty of applications, particularly in the scientific research arena, that generate vast amounts of data that can be spooled off to tape for archiving/distribution pretty much at leisure before the hot storage is wiped for re-use. Even with Internet2, I could easily imagine somewhere like Arecibo, CERN or the SKA being all over this kind of storage
Re: (Score:3)
Re: (Score:2)
Periodically you swap over to a new tape.
Every 180 years to be precise. Your bigger problem would be material rot, assuming you would want anything more than a couple of decades worth of backup.
Re: (Score:3)
I wonder if they really mean 185TB or if that is the usual 50% compression ratio marketing wank, in which case it would only take half a week two write.
Re: (Score:2)
185TB is the uncompressed size, as noted in the last word of the summary.
Re: (Score:2)
My guess: when the technology which increases the data density by a factor of 100 is ready, then also the writing mechanism will be significantly faster.
Re: (Score:2)
Initially I thought that might not be true because tape will still be linear and you would still need to move it past the read heads.
But, if you work to make the read heads (and the tape) wider you could still have the same velocity of tape, but write more data (on top of the more data you're writing because of density increases) and actually achieve very good throughput.
Re: (Score:3)
Let's assume a 100m long piece of tape that holds 1TB. That means each meter of tape is about 10GB/m of storage density. If tape flows past the head at a rate of 1m per minute, you are looking at read/write rates of 167 MB/s.
Now, let's change the bit density of the tape to be 50 GB/meter. The tape still flows past the read/write head at 1m/min. Which gives us read/wri
Re: (Score:3)
Yeah, if you really need to back up 180 TB per week, then you should probably save time by writing multiple tapes in parallel. They wouldn't need to be smaller, though - you could still save a lot of storage room by reusing the large tapes.
Re: (Score:2)
Re: (Score:2)
IMHE tape is always an order of magnitude slower than the advertized speed, so it is likely even worse than what you calculated.
If your tapes are writing that slowly, something is wrong, and I'd be worried about shoe-shining. Without putting much effort into it, my LTO5 jobs currently run at around 125-135MB/s. With modern tape, it helps a lot to stage to disk first, or get software that can multiplex backup streams to keep the tape buffers fed.
Re: (Score:2)
Be careful with multiplexing, it speeds backups but can make restores brutal. We did a test restore of our full file server once and realized we couldn't hit the 72 hour SLA due to shoe shining during restore, we ended up pulling our multiplexing back from 8 to 2 which required a few more drives in the library to complete weekly backups in the same timeframe.
Re: (Score:2)
Though were I see this really being useful (at least to me) is recording scientific data. Experiments can put out obscene amounts of information and I could easily see hooking one of these up to a detector and being happy that you only need to change tapes once a week or so.
Re: (Score:2)
Unless they make the tape material out of unobtainium, odds are high that you would break the tape well before the 9 months is up. LTO-5 end-to-end read/write durability is only about 200 passes. Half that number if you do a full tape verify after write (which counts as an additional R/W pass).
If you use a different tape for each day
Re: (Score:2)
I would expect with a higher density tape, you would get a higher write speed as well.
The read and write speed of the tape can be electrically increases much easier than speeding up how much tension that a fast rolling tape can handle.
Re: (Score:2)
I don't think you can make valid estimations about the write speed of this new potential format by assuming it'll work at LTO 6 speeds. As density goes up, so does write speed.
Consider LTO 1 through 6:
It seems that doubling storage density yields slightly more than double the speed. (And obviously, like going from LTO5
Re: (Score:2)
So at 185TB per tape with the write speed of LTO6 "at speeds up to 400MB/s (1.4TB/hr) [quantum.com]" [optimal]....~132 hrs per tape. But in reality 300 MB/s or 1 TB/hr so about 176 hr/tape. 168 hours in a week.....Next weekly back up starts before the first one finished.....
Yeah, I know, they're not all level 0 backups.....you get the idea....sometimes it might be better to have 2 smaller tapes, than 1 large.
If that is the case then your backup strategy is totally wrong. To get the best performance from a backup you should be streaming your data to the actual tape, however this in practice is rarely true.and consequently you get what is commonly called a "shoe-shine effect" in that the data will be written to the tape then stop while waiting for the next batch of data to catch up, however when the next batch of data arrives the tape has to reposition itself. Obviously this is very inefficient and can add a cons
Re: But is it even usable? (Score:5, Funny)
Say what? Everyone here keeps telling me that RAID is backups!
Re: (Score:2)
Re: But is it even usable? (Score:5, Informative)
We have had RAID failure twice now. The idea is that even with things like SMART, the errors in the second disk (or 3rd etc) don't become apparent till you try and recover and thrash the disk properly.
The other reason why RAID isn't a backup is because it doesn't account for software/human failures - good luck recovering your data from a RAID after accidentally running "rm -rf /", whereas time indexed backups will allow you to go back a few days/weeks/months and recover your data after you discover it's not on the disk any more.
RAID is there to keep systems running in the event of a hardware failure - its no substitute for a backup.
Anyway, the errors on the disks should become apparent during their operation because you should be doing regular scrubs to find the errors. Putting the data somewhere, forgetting about it and not actually checking its still there for a few years is a pretty good recipe for disaster no matter how you store it. That said, I've seen a few cases where a drive fails, and the increased load on the other (similar age) disks sends another over the edge soon after, so one disk going bad should probably be an early warning that you're likely to see the other disks start to fail soon too (so don't hang about waiting to replace the dead one!)
Re: But is it even usable? (Score:4, Insightful)
Re: But is it even usable? (Score:4, Informative)
Tapes saved our ass when the motherboard blew out on their main server and took out the RAID to boot. We were able to retrieve the data from backup without any problem.
Re: But is it even usable? (Score:4, Interesting)
You have no idea what you are talking about. Most tapes are not written by people and put on a shelf. Most tapes are automatically managed by a tape library, such as this one [ibm.com] (note that thing can store up to 900PB.) Read failures do not happen, because the library and host software together automatically count cycles and copy to a different tape when the cycles get too high, as well as detecting corrected errors and signalling when there is a problem with a tape.
z/OS, for instance, has a hierarchical storage manager where, by policy, data that is not accessed in certain period of time is moved first to slower (cheaper) disk, then to tape. Where I work, the 'to tape' time is about a month. In over 30 years of using such systems I have seen the 'DFHSM is recalling from tape' message many thousands of times, and I have never once encountered a situation where the recall failed or the data was corrupted. And the recall typically takes less than a minute.
It seems that most people on here only have experience with crappy home tape systems.
So let's do your contrasting with HDDs. That library holds up to 900PB, and uses 1.6kVA of power. It takes up 163 square feet of floor space. By my calculation, that would take over 1 million 1TB HDDs in a RAID array. How much floor space would that take? How much power would it use? How much heat would be generated?
If you have a lot of data, and do not need all of the data 'right this second', and (most importantly) have a system that can manage the data without causing the user to jump through hoops, tape makes an excellent solution. And that describes most large companies.
Re: (Score:2)
The best solution is not just disks, not just tapes, but a multi-pronged solution.
For example, most drive arrays can replicate asynchronously via a WAN link. This provides protection against drive failure, but provides no protection against deliberate destruction of data.
One useful tool is D2D2T. Have all the machine data hit a landing zone that is deduplicated. Then, depending on how critical the box is, have that machine's data sent to two sets of tape for long term storage, or just let the machine's d
Re: (Score:2)
Re: (Score:2)
This is the backup system i eventually settled on.
First line of defence is is raid 6 running on ssd's on our hyper v server.
Second is altaro backup backing up our vm's to a nas drive running raid6
Third is shadow protect which runs on the domain/file server, to provide long term historical backups.
The altaro backups are copied to an offsite drive once per week.
Re: (Score:2)
Nobody mentions ZFS? The only thing that can concievably survive an accidental dd followed by an accidental rm -rf?
Re: (Score:2)
Nobody mentions ZFS? The only thing that can concievably survive an accidental dd followed by an accidental rm -rf?
And still, you'd be stupid to not have a proper backup since you're screwed if (a) you end up with massive filesystem corruption (software bug, hardware failure, etc. or (b) your server catches fire (or similar failure that physically destroys all your disks).
Re: (Score:2)
SMART is trash. I have had drives that were making whirring and clicking sounds, but SMART still checked out as OK.
Re: (Score:2)
Two words: background scrubbing (Score:2)
With any raid 4/5/6 system, parity and thus read errors aren't tested on normal read access. That means that unless you specifically tell the software/controller to do so, all raid does is *write* parity bits. It never checks the validity. A good practice and usually implemented in enterprise SAN/NAS systems, is to use background scrubbing to do just that. Background scrubbing uses "unused" IO capacity to read all disks, check parity and figure out which disk has errors. If the disk can reallocate sectors i
Re: (Score:2)
Love the comment "disks aren't that expensive anymore". Do you know what RAID was when it came out, what the 4 letters stand for? I was working in a job in previous life where would go through a room full of RAID drives pull out the ones with red lights, swap for the fresh drives and sh
Re: (Score:2)
Re: (Score:2)
my weekly backups at work are in the 5-6 TB range per week. we have LTO-4 in a 96 slot tape robot with 3 drives
185TB per tape means i can have most of my tapes last all year and just switch one out monthly to send offsite. or instead of sending monthly backups offsite, i can fill the tape with weekly backups and send the same one tape offsite but with 10 times the data
Future of sony media? (Score:3)
Re: (Score:3)
180TB of DRM, 5TB of content.
Then how would you fit a rootkit in there?
/ducks
Re: (Score:2)
Nostalgia (Score:5, Funny)
What's next? Discs of vinyl which can hold up to 1000 songs?
Re: (Score:2)
You probably can pull that off with compressed music in a lossy format like OGG and a CED disc:
http://en.wikipedia.org/wiki/C... [wikipedia.org]
If the CED is able to keep a image quality at least comparable to the VHS, you can use an ARVID solution to store data on it:
http://en.wikipedia.org/wiki/A... [wikipedia.org]
At the 325 KB/s mode, you can store up around 1.1 GB of data per side of the CED, or 2.2 GB total, thus allowing you to store 1000 songs of up to 2.2MB of size.
Re: (Score:2)
Restore something after every backup (Score:5, Interesting)
If you don't restore at least one file after every back up, you are going to discover (as a company I worked for found) that your tape is blank when you need it most.
Re: (Score:3)
Rubbish, what you found is that you had inadequate backup software and monitoring of the backup process.
Re: (Score:2)
It was state of the art; recommended by IBM; and was reporting successful backups to the AS/400 without errors.
The only way to be sure is to restore something. Then you know.
If your entire company (or personal financial life) is literally at stake on the backup, based on experience, I recommend you restore items from the backup to confirm success. It's a lot of risk mitigation for a couple minutes extra work.
But hey, your funeral, eh?
Re: (Score:2)
Re: (Score:2)
I've always said if you don't have an offsite, offline, and verified backup you don't have a backup at all =)
Another wonder-tape that will never materialize... (Score:2)
I remember several of them.
We've probably seen this technology used before. (Score:2)
Re: (Score:2)
All I'm seeing in these reviews is a bunch of off-the-wall fiction completely unconnected to reality. Is this a joke?
1 star
I've been saving up for over 14 lifetimes to purchase this box to help me record home movies, however I was very dissapointed with the product, as upon opening it burst into an array of colors to the likes of which I'd never seen, cured my mono, cured my dog's mono, gave me x-ray vision, allowed me to fly, raised my IQ by over 170 points, gave me the power of invincibility, gave me the power of invisibility, crafted me a working Iron Man Suit, and above all made me a sandwich that tasted like dreams. It did all these things but it didn't even work right when I tried to use it for my home movies with my dog. I threw it out yesterday.
Security cameras (Score:5, Interesting)
Re: (Score:3)
Well they seem to do OK. Whenever they show those 5 pixel faces on the TV, they always seem to be able to identify the culprit.
And the price of a 185TB cartridge (Score:2)
Proprietary format? (Score:2)
Sorry, I'm waiting for holographic storage... (Score:2)
Ok, so what's the actual size? (Score:2)
Why does it seem like every time there is a "major breakthrough" or new format that offers "massive stoarge", when it actually materilizes it is way less storage then advertised? I thought when Bluray was announced it was suppose to feature up to 250GB, and I remember reading an article years ago that Pioneer created a 500GB disk.
And what about all the major breakthroughs in hdd that I hear about every other year, yet space seems to be going up at a fairly slow but consistent pace.
Must either be a) marketin
Re: (Score:3)
http://en.wikipedia.org/wiki/B... [wikipedia.org]
Conventional (pre-BD-XL) Blu-ray Discs contain 25 GB per layer, with dual layer discs (50 GB) being the industry standard for feature-length video discs. Triple layer discs (100 GB) and quadruple layers (128 GB) are available for BD-XL re-writer drives.
And what's the throughput on one of these things? (Score:2)
Doesn't much help if backing up to tape and recovery of said "gobs and gobs of data" takes longer than the remaining lifespan of the universe.
Only problem... (Score:2)
It installs rootkit software on your server that won't let you do any backups if it finds even a single MP3 file.
Not just size that counts (Score:2)
It's not just the size that counts! Granted that 185TB data cartridges is impressive, but how long does it take to read/write such a monster?
Obligatory (Score:2)
Re: (Score:2)
Re: (Score:3)
Re: (Score:3)
Re: (Score:2)
Re: (Score:2)
Funny my first thought was the original Star Trek using tape drives 200 years into the future.
And now it just might be true.
Re: (Score:2)
They could be ROM/flash cartridges, like oversized SD cards.
Re: (Score:2)
I'm pretty sure I actually saw some giant reel-to-reel machines occasionally. You're going to have to stretch pretty hard to explain why you'd put flash in such a format...
Re: (Score:2)
Maybe 200 years in the future they managed to make flash memory ultra thin and flexible, and decided to string them end to end to be read or written sequentially? /me stretches
Re: (Score:2)
I don't think so. Sure the exterior design is similar, but they don't actually show tape.
They do call their data storage media tapes, occasionally, though.
Re: (Score:2)
Don't forget they'll add crazy DRM that forces you to connect to the Internet before you access your data. Also the drives will be slow to load and you'll have to reboot them every five minutes due to lock-ups. It will also have some wild name like Yello-Drive.
Toshiba will probably make a competing drive that fails. As a final insult to Sony they will make Drive that "upscales" your current drive without all the annoying issues of the Yello-Drive. It'll do a damn good job too, but; ignorance rules and peopl
Re: (Score:2)
I'd love an affordable tape backup system that had about 10 TB+, but I'm not going to buy Sony.
Re: (Score:2)
Sony will turn it into a propietary format, allowing someone else to develop a work around at 1/3 the price.
Why would you say that? All they need to do is patent the technology then collect royalties and/or licensing agreements. Not any different to what has been done already in the magnetic tape industry. I suppose you could create a propriety format but we are talking magnetic tape.and any company would be stupid if the tape reader device can't read earlier tapes (assuming LTO type format) to a certain point such as say LTO-7 (assuming) then LTO-6 and LTO-5 although going back further would just increase the pr
Re:Don't worry, NSA will still buy American (Score:4, Insightful)
The joke is that every time Sony's tried that gambit in the past, they failed miserably. Betamax and Minidisc are two great examples of this.
Re: (Score:2)
Estimates are that between 50 and 80% of the worlds data is on tape. If you have not heard of it, that is your problem.