How Long Do You Want Digital Media To Last? 398
spamfiltertest writes "CNET asks 'Would you like your digital-storage media to last 20 years, 25 years, 30 years, 35 years or 40 years?' If you're an organization or government agency, the U.S. government and an optical-disc industry group would like you to answer that question in a quick survey. I would think that we would like our data to last forever, but maybe it's just me."
I'll take the survey in a bit, but... (Score:5, Insightful)
If you're an organization or government agency, the U.S. government and an optical-disc industry group would like you to answer that question in a quick survey.
I work in the records department of a two year tech college. We use document imaging hardware and software to store student files on WORM optical media permanently and then we destroy the physical paper files over time.
We expect that our digital media will far outlast what we have on other permanent storage mediums, such as microfiche, which go back to 1972. If the "antiquated" microfiche can hold up that long why not our records stored on the digital media?
We realize that no storage method is 100% foolproof (i.e. you can misfile microfiche, lose physical files, misplace pages, etc) but we have put a lot of faith into the setup we currently have. If time has a negative effect on both the originals and backups we could find ourselves reverting to tried and true methods used in years past.
It's mildly humorous to me that long term data integrity (i.e. "forever") is never mentioned when companies present you with all the benefits of a digital setup. The benefits of the system are great (such as easy access to student information at various sites without any reproduction necessary, security features, etc) but will our microfiche outlast our digital media? I may never know but currently, based on recent discussions about the degradation of digital media over time, it appears that it may.
I feel sorry for the poor bastards that would have to go back to storing and reproducing everything to and from microfiche if and when we find out that digital media might not have the necessary longevity we require.
Re:I'll take the survey in a bit, but... (Score:5, Insightful)
The trend is not for newer storage methods to outlast older ones by any stretch of the imagination.
Stone inscriptions, stored reasonably well, will last quite a long time. Books printed with appropriate inks and stored well will also last ages. Comparing to those, "antiquated" media like microfiche will be useless much earlier.
From what I recall, we use newer media forms not because they last longer but because they're more convenient. You can store information much more densely on a DVD than you can on microfiche, which is in turn a more dense storage form than paper, which was a big improvement over marble and clay tablets.
If you really want longevity you should take your microfiche and cut the words into sheets of gold.
Re:I'll take the survey in a bit, but... (Score:4, Interesting)
For me, I treat digital media like traditional media - particularly books.
While the digital media maybe flimsy, there is no reasonable reason why the information therein should _not_ survive for more than 40 years.
At the very least, one can be sure that it would have historical significance. And I'm fairly certain that I would be alive 40+ years from now, which would merit the necessity for me having the media, or atleast the information therein. While the information may eventually become irrelevant, it would at the very least have posterity value.
Digital information is no different from a library of books - it's just stored digitally. I do expect my books to last as long as possible (hell, books have lasted centuries, if not more). Then why should it be any different for other media?
Re:I'll take the survey in a bit, but... (Score:4, Insightful)
The difference is that with books, all you will need to read them in 40 years is your mental ability to read, your natural vision, and maybe a set of bifocals.
In 40 years try to find a way to read your DVD full of MSAccess95 DBs, Word 95 docs, etc. Heck I still have a shoebox full of cassette tapes that (at least used to) have Commodore VIC20 software on them. I've got an 8" floppy-disk that we use as a frisby in the office. None of those have anywhere near the longevity of a book, due to technilogical change, totally seperate from any media degredation. From TFA:
(One should consider the issues of digital obsolescence and migration - Is 100 years (or 'forever') really practical for typical long-term digital storage strategies? While you may need to preserve data for a particular length of time, is it really necessary to preserve that data on any particular technology or can it be migrated to newer technologies?).
Re:I'll take the survey in a bit, but... (Score:5, Interesting)
I second that. Even on a more basic note...even if you had the ability to read the content (word 95, msaccess...etc.)..what if you don't have a DVD player to read from? Sound hard to believe? Not really.
One example I recently read about...during the compilation of the Led Zeppelin DVD and CD sets..they were going through the archives, and found much of the sound of the concerts they were trying to save and reformat, was on old 2" analog tape of some kind. As I understand the story, they had methods of baking the tapes to get them unstuck and playable for transfer, but, they ran into the problem of trying to find a tape player for the media!! They had to look worldwide and had a very difficult time finding one that was functional and high enough in fidelity.
And c'mon...this for concerts recorded only 30+ years ago in the 70's.
Stuff recorded on todays DVD standard...well, could possibly be hard in 40 years to find a player backwards compatible enough to read today's media....
Re:I'll take the survey in a bit, but... (Score:4, Funny)
When I'm extracted from the CryoPod in 3056.
Re:I'll take the survey in a bit, but... (Score:3, Insightful)
Unlikely. CDs have been around for almost 25 years, and all proposed next-gen drives (Blue-Ray and HD-DVD) will have CD and DVD compatibility.
Moreover, people have large collections of DVD movies, which alone will ensure the availability of DVD drives for years to come.
VHS is 29 years old, and you can still buy players. Heck, even Laserdisc and Betamax p
Re:I'll take the survey in a bit, but... (Score:3, Interesting)
I can use a flash light to read to the holes...
And realy I do have the 30 year old paper tape!
Re:I'll take the survey in a bit, but... (Score:3, Interesting)
Yes, the technology is likely to be supported, but what what will happen to the disks that you already have? Will they still be readable 5 years from now? 10 years? 20?
Let me tell you: they won't. And copying the data to new media (say, every year) sometimes it not an option.
I stopped using CD-Rs for storing my important data when some 2-3 year old not-so-cheap disks starte
Re:I'll take the survey in a bit, but... (Score:3, Interesting)
I'm not sure how much longer my turntable will hold out.
I heard that NASA was having a similar problem a few years back, GIGABYTES of date from space-probes was being lost because it was stored on tape (magnetic?) for which there were only a few readers available, so the media was degrading at a higher rate than they could recover it, given the volume of data, and throughput of
Re:I'll take the survey in a bit, but... (Score:5, Funny)
I did, but this Joseph Smith guy dug them up and completely mistranslated them.
Re:I'll take the survey in a bit, but... (Score:2, Interesting)
Re:I'll take the survey in a bit, but... (Score:3, Interesting)
This works fine if you are dealing with a fairly limited amount of data but what happens if you are a library, the Census Bureau, or some other agency that may have longer storage requirements. Hopefully the organizations that require massive amounts of data to be stored essentially "forever" have considered the task of migrating from the "current" media to "future" media. I'd hate to be the organization that
A short History of written media (Score:5, Interesting)
Re:I'll take the survey in a bit, but... (Score:2)
I feel sorry for the poor bastards that would have to go back to storing and reproducing everything to and from microfiche if and when we find out that digital media might not have the necessary longevity we require.
I feel sorry for our society and culture when I think of how much information and content is now only available digitally. Don't get me wrong, digital is good: it provides quick access, easy searching, etc. However, It is still new technology (especially with the constant advances in materi
The answer (Score:2)
Re:I'll take the survey in a bit, but... (Score:2)
We expect that our digital media will far outlast what we have on other permanent storage mediums, such as microfiche, which go back to 1972. If the "antiquated" microfiche can hold up that long why not our records stored on the digital media?
The Research Libraries Group (RLG) anticipat
Re:I'll take the survey in a bit, but... (Score:2)
Not always forever (Score:2, Interesting)
My company recently started deleting our email after 90 days. One of the reasons I heard was to protect us in lawsuits.
Re:Not always forever (Score:3, Funny)
Re:Not always forever (Score:2)
That's records management, and yeah, it's best to delete stuff after a period of time. Business wise.
As a home user though, I want my backup cd's and dvd's to be there until I get rid of them.
I don't want to have my digital photo albums start decaying after 10 years.
I have some already at 6 years old.
Re:Not always forever (Score:2)
Re:Not always forever (Score:3, Interesting)
Which is often the reason. I imagine the government cares because there is a statute of limitations on how long information can remain classified. So if the physical media the records are kept on expires before the statute of limitations comes into affect, there is no records for them to release.
But lawsuits are a huge reason, as you said, when computer records are involved. You keep everything that could incriminate you on age sensitive media and
Forever (Score:2, Funny)
Re:Forever (Score:2)
Follow the chain of technology upwards (Score:2)
Re:Forever (Score:2)
Last forever (Score:3, Funny)
While they're at it, can they make my car run forever? I also want to stay young forever, if that's not too much trouble.
53.3 Years (Score:3, Funny)
Re:Last forever (Score:2, Funny)
You can choose from good, fast, or cheap. God was under both time and budget pressures, because there were 7 days allocated for the project, and he had already used up 5 of them. If he was to get a day off, 'fast' had to be one of the compromises.
So, he had
Re:Last forever (Score:2)
While they're at it, can they make my car run forever? I also want to stay young forever, if that's not too much trouble.
Sure it would be nice if our bodies or car lasted forever, but if your 1900 Model T still ran like it did in 1900 would you still want to drive it to and from work every day? I wouldn't.
Now data is a different story. It is very common for data in one form or another to outlive a human life. Although its not that old, I am listening to
Until a pron-raid (Score:2)
Make it.. (Score:5, Insightful)
Re:Make it.. (Score:4, Insightful)
if you want you could probably etch your data on a block of gold, but what would that cost?
Re:Make it.. (Score:3, Interesting)
I think the whole reason for the survey is that it's not cost-feasible to make long-lasting media, and that the efforts to drive prices ever-lower will also product media of lower quality. If you want long lasting media, you're going to have to pay for it. Personally, I'd be OK if they made two (or more) different grades. I don't need most of my computer fil
Re:Make it.. (Score:3, Insightful)
The real limitation here (Score:3, Interesting)
When is the last time you saw a 5.25" disk drive? How easy is it to find a Jaz drive these days? WORM reader? Something that will read your old files stored on analog cassette tape? I could go on naming defunct storage media solutions for half the day.
The only real solution for long-term storage is to keep the files "live" on a system someplace. Under and other arrangement even if the *media* the
Re:The real limitation here (Score:2)
Every time I go home, I have 2 of them yet.
>Something that will read your old files stored on analog cassette tape?
Got 1 backup tape reader, for reading files off my backup tapes and my Dad's backup tapes. Never really used a cassette reader, but I do have paper tapes and punched cards still.
>This became a major concern to me once I switched over to all digital photography.
One reason I still use FILM, 100 years and the film is still there.
I k
Re:Make it.. (Score:2)
Re:Make it.. (Score:2)
Well, unless you're a secret agent of some sort.
Secrets? (Score:5, Funny)
Re:Secrets? (Score:5, Funny)
Maybe Not Forever (Score:3, Funny)
Re:Maybe Not Forever (Score:4, Funny)
forever, but... (Score:5, Insightful)
sum.zero
Re:forever, but... (Score:2)
Re:forever, but... (Score:3, Insightful)
Provided:
Then with a long enough key, it is possible to prove that the data is secure for, oooh... a couple of billion years.
Note that these points apply to most forms of encryption in common use today. Every bit you add to they key leng
I want media tied to my vital functions (Score:5, Funny)
Re:I want media tied to my vital functions (Score:3, Funny)
I think you mean your vital signs, unless you want to have to redownload all that pr0n everytime you take a crap.
Do I not understand the question correctly? (Score:2, Interesting)
does it matter? (Score:5, Insightful)
Re:does it matter? (Score:5, Insightful)
I think we'll see CD media be readable by the consumer for at least ten or fifteen years. The consumer will probably be able to get a CD/DVD reader if he so desires for ten or fifteen years after that -- after all CD and DVD are popular formats, unlike 8 track which was never very successful.
After that, I'm sure there will be companies that will be able to read your old optical media into the quantum dust specks or whatever they'll be using in fifty years. If your CD-Rs last that long -- which they probably won't unless you are very careful about storing them.
Re:does it matter? (Score:2)
OpenOffice IIRC can read your old lotus 1-2-3 spreadsheets from the early 80s, not to mention those WordStar files. It's also likely that OpenOffice stuff will be readable in twenty or thirty years, provided it's important. It's just zipped XML.
Re:does it matter? (Score:2)
Flat text files (Score:2)
Now, the text files of 25 years from now may well not use 8-bit characters (think Unicode here). So current text files may in fact not be directly readable by the current software in 25 years (though I would bet that there will be some software in 25 years that still has an "import old 8-bit files" option, again on UNIX/Linux if nowhere else).
HTML will almost ce
Re:Flat text files (Score:2)
Let's suppose you have a file that has the text "ABC" in it. Currently, the bytes in the file (in hex) are "41 42 43". But in a Unicode world, they should be "00 41 00 42 00 43" or even "00 00 00 41 00 00 00 42 00 00 00 43", depending on whether we wind up with 16-bit or 32-bit Unicode.
So the hypothetical Unicode text-file program in the future reads "41 42 43" and sees one and a half characters rather than 3, and the one complete character it
Re:does it matter? (Score:2)
The 8-track is a low fidelity end user thing that seemed neat to someone at sometime.
However, I would bet that any commercially available recording that has made it on 8-track is stored on some other more standard media that is still usable today.
You mean hardware? (Score:2)
For example, I have an old 20mb 5.25" drive with a logical edge connector. I don't think any modern system uses that kind of connector anymore, and though I have IDE controller cards that have it, they're all ISA cards. When was the last time you saw an ISA slot on a P4/AMD64 motherboard?
Life span for government (Score:2)
Why depend on physical media (Score:4, Interesting)
--
Or try a free Nintendo DS, GC, PS2, Xbox. [freegamingsystems.com] (you only need 4 referrals)
Wired article as proof [wired.com]
Re:Why depend on physical media (Score:5, Insightful)
The whole point of storing data on WORM media is to prove that the data remained unaltered during storage.
You want to be able to have an audit trail that shows any modifications (timestamps included) to the records. You also want to make sure that images that were stored were unaltered ("photoshopped"). You want to make sure that an exact copy of the information was stored and remains exact for the life of the media.
If it's not stored on write once media then that can't be guaranteed.
Re:Why depend on physical media (Score:2)
Erh, food for thought : 1) Major power surge burning out most electronics. 2) A careless administrator (you?) drops the entire server on the floor from 1 meter 3) The fire alarm goes, and drenches everything in water. 4) The machines gets massively o
Offsite backups (Score:2)
I Want A Known Quantity (Score:5, Interesting)
The length of time isn't terribly important, as long as it doesn't make the cost of new media too high (e.g. DVDs aren't too expensive, so if I have to reburn them every five years or move to the next media format at that point, that is a good use of money and time).
100+ years (Score:5, Interesting)
As long as needed. (Score:2, Insightful)
How long? (Score:3, Funny)
Data Archive Services want something different... (Score:5, Funny)
Pretty much the only way to make your media last forever is to have it stored in a solid state (like being etched into the surface of a DVD) and then sealed and stored in a moistureless, airless, lightless temperature controlled environment. But with all the talk about self-destructing DVDs and CDs that the recording industries are trying to push, I don't think even that's possible.
CONVERT ALL YOUR DATA INTO BINARY AND THEN LASER ETCH IT INTO GLASS! THEN SANDWICH IT BETWEEN TWO OTHER LAYERS OF GLASS AND HIDE IT ON A MOUNTAINTOP! YOU MUST SAVE YOUR PR0N COLLECTION FOR ALIENS TO DISCOVER AFTER WE'VE BLOWN OURSELVES TO ATOMS!!
This rant was brought to you by the Reynolds Society for Tin Foil Hats... Remember, only Reynolds Wrap brand tin foil can protect you from the strongest of the alien mind-control rays!
Die with me (Score:2)
Data != Media (Score:5, Insightful)
If you have media that you know won't last over 30 years, just copy it onto new media at the 20-25 year point. In most cases, that's not that big of a deal. Besides, by the time that 20-25 year mark rolls around, it's very likely that you'd want to convert to a faster "online" media anyway, like holographic storage.
"Forever" would be nice, but... (Score:5, Insightful)
So if you want stuff to last forever, each generation of people needs to convert the old stuff into a new format. But if you are only doing this once a generation, it's not that big of a deal. You could even make it a family tradition, the passing of the old to the new. Assuming of course that you actually care about keeping something 'forever'.
The Darl McBride answer... (Score:2)
"Do the Right Thing. It will gratify some people and astound the rest." - Mark Twain
Longer than the copyright protection (Score:5, Interesting)
Re:Longer than the copyright protection (Score:2)
Re:Longer than the copyright protection (Score:4, Insightful)
I Want My Unborn Grandkids (Score:2)
Re:I Want My Unborn Grandkids (Score:2)
I suggest picking out your favorites and get them printed onto Fuji Crystal Archive paper. These will last for your grandkids to view in case the digital bits are lost somehow.
Personally, I bought the negatives from my wedding photographer and made several silver halide prints onto traditional B&W fiber paper. I toned then in selenium. These should last several hundred years assuming no natura
Forever??? (Score:2)
3.5" floppies took about 2 decades to become obsolete, do they seriously expect this new standard to last 40 years without the need/request to transfer everything to another format?
How long? (Score:2, Funny)
42
NIST study about CD/DVD Longevity (Score:4, Informative)
microsoft's reply (Score:2)
Depends on which media! But no archiving (Score:4, Interesting)
I will not "archive" materials. If it's important, it stays online, migrated & backed-up. If it's no longer important -- delete. Online (HD) isn't that expensive. Archives can get lost or corrupted. Or readers may no longer be available.
Tiered costs? (Score:3, Interesting)
Therefore, optical storage producers would be smart to offer several "levels" of guaranteed life, and you could purchase based on how long you think you need you need your data to live. e.g. price per unit... 5 years: 1 dollar, 10 years: $1.50, 20 years: $2.00 etc.
I say "forever" (Score:2)
Of course we want our data to last forever... (Score:2)
Permanent Media (Score:2)
1. A punch card reader; and
2. Punch cards made out of that plastic that lasts for a length of time statistically indistinguishable from forever.
Presto! Permanent media.
Tape lasts 100 years (Score:2, Interesting)
Floppies last 4-5 years
The problem isn't storage, it's READING the data stored in an old format. We have many miles of census data stored on punch cards and paper tapes, but don't have the machines to read them anymore - at least not in quantity.
So making it last isn't important - I can still play my records, but it's hard to find needles to play them.
Choice (Score:2)
DVDA? (Score:2, Funny)
I say porn industry because its DVDA.org... Double vag... come on, you all watch southpark.
At least one year longer than copyright (Score:2)
Maintained, digital format is superior (Score:2)
My response... (Score:2)
Artistic creations (photographs, movies, etc) which cannot be replaced are now stored almost exclusively in digital form. Having media decay with time creates an ongoing job of having to continuously re-copy data. Should you miss any, it's gone forever. In my estimation, this is even more important for families that want to maintain an historical record of their lives for posterity. I've recently come across writings and records of my ancestors dating back several hundred years, and it's a wond
I want my digital pictures to last forever (Score:3, Insightful)
Now I have a nice digital camera(Canon Digital Rebel) that was expensive, but I got it for a good reason. I am about to get married and do the whole family thing. I hope someday that a great-grand kids over maybe even a further down the line will be able to look at all the pictures I will take and maybe understand a little better where they came from, what the world was like, and how pretty there great grandma was:)
How about... (Score:2)
Forever is bad (Score:2)
The difference between good policy and reality (Score:5, Insightful)
Professional archivists tend to recommend that data be turned over onto new media every 5 years regardless of how well it's weathering the years.
But the truth is that, paradoxically, the most critical data tends to be the least likely to be refreshed, because access to it is typically quite limited.
Our own department of defense doesn't know where it stashed all of it's nuclear materials over the years. Why? because they recorded it on a magnetic tape, put the tape in a vault, and had someone stand in front of the vault with a gun for 40 years, and now the tape has turned to goo, and in other cases the tape seems readable but there is no technology available to read it.
We should always strive for and recommend rigorous archival policies, but we should also strive for media that can possibly withstand the ages should some knucklehead put it in a concrete box or just forget about it completely for a few decades instead.
10.000 years (Score:3, Interesting)
Re:I have 1.2MB floppies a good as day one and.. (Score:3, Insightful)
Re:Digital media is easily migrated... (Score:4, Insightful)
The files I wrote in the late '70s are still around today, and completely readable and editable.
Whatever editor I used (I used edlin for a very short time, and then WordPerfect and MS Word - as well as several no-name apps - on DOS machines - later I found vi and emacs under Unix - and have dabbled in OpenOffice and Abiword on my Linux systems) I made sure it had the option of saving the files as plain text - or I quickly stopped using it.
Nowadays I am using XML for anything significant (that I think I may want to publish - on the web or in print) - and plain text for everything else (and XML is really plain text from a software standpoint).
I don't have any software incompatibilities because I don't use proprietary formats to begin with.
Everyone doesn't think like that, however I am trying to educate as many as possible. Some yahoo sent me a Visio drawing the other day; I sent him a message saying, "save it as jpeg or png so I can read it". He did, and I was happy (not to mention I could easily incorporate his drawing in my own documentation/notes or translate it to some other format if needed).
This happens all the time, someone sends me a Microsoft Project file, or some other format that I do not have software for. I force them to change it to an open format - and after awhile they learn (at least to send me data that fits my open model - or that I can translate to something open). When their tools are dead and their files are useless, I will still be able to reference information that happened in the past.
So, your argument about software is only valid if you use proprietary file formats (only readable by one software application). I do not - and so your argument is not valid for me.
No one should use proprietary file formats for this reason - proprietary file formats hinder the migration of data from one technology to another (hardware or software).
Re:What about Decentralized Replication? (Score:3, Insightful)
1) The data over time becomes corrupted. This can be from ordinary memory copy errors (a stray cosmic ray turns a 1 into a 0 or the other way around), or when you send a packet over the network somehow the checksum works out even with corrupted data (it does happen quite often... especially over many generations of data). It happens, so get used to it, and over thousands of years it will be a huge issue. I've found that bit rot over even 10-15