Guide to Digital Preservation from NIST 190
Little Hamster writes "The scientists working on the Digital Preservation Program at the National Institute of Standards and Technology (NIST) has released an excellent 50 page guide on care and handling of CDs and DVDs for long term storage. It talks about the effects of light, moisture, radiation, scratches, marking, adhesive labels, and even playback on the discs. For those slashdotters who is not familiar with the physical made up of these optical discs, there is a very nice chapter explaining all the background. And if you only want to know how to care for your precious data, there is a one page summary. And yes, they agreed that glued-on labels are harmful."
Post it notes? (Score:2, Funny)
Felt markers for labeling CDs (Score:5, Funny)
Re:Felt markers for labeling CDs (Score:3, Interesting)
Re:Felt markers for labeling CDs (Score:2, Interesting)
The recommendation to stay away from any marker that uses solvents is somewhat silly for the reason you hinted at - water is also a solvent.
No, Sharpies are NOT safe (aaargh!) (Score:3, Informative)
NIST tells us not to use anything solvent-based, and Sharpies are solvent-based markers. In fact, the Sharpie Materials Safety Data Sheet [sharpie.com] (pdf) tells us they contain 3 different solvents - a propanol, a butanol, and an alcohol. One Eric Teel of Jefferson public radio (in Oregon) wrote the manufacturer of Sharpies and they said there could be problems [findlaw.com].
Damn, and I've got hundreds of CD-Rs written on with Sharpies. I hope they last till I get around to buying a DVD burner and transferring the data.
Re:No, Sharpies are NOT safe (aaargh!) (Score:3, Informative)
Looks like water-based felt pen or printing on printable-surface DVD-R is the right answer long term, but I think your CD-Rs will last a couple more years.
Ahem... (Score:2)
I dont trust any format. (Score:5, Insightful)
If it wasnt for multiple backups I'd have been stuffed, so for my personal stuff (and work) I keep everything on the hard disk. Luckily the size doubles every few years, so as long as the size of the data doesnt outgrow the size of the drives, I'll be fine.
It wouldn't hurt to get all your old disks and tapes and (un?) back them up onto a spare hard drive before its too late.
Re:I dont trust any format. (Score:3, Funny)
Re:I dont trust any format. (Score:3, Funny)
You haven't heard about the state of Florida voting results in the last US Presidental election, have you?
Re:I dont trust any format. (Score:3, Informative)
That's if you keep the card reader working right - at the college computer center where I worked in 1972, a repairman had to come in and basically rebuild the card reader once
Best for floppies... (Score:1, Funny)
The solution... VIAGRA!
Re:I dont trust any format. (Score:2)
For other media I have made the same experience as you.
Re:I dont trust any format. (Score:2)
Re:I dont trust any format. (Score:2)
Re:I dont trust any format. (Score:2, Informative)
Spare disks sometimes count but only if the documents are never going to change and the disk is archived, otherwise there'll always be a "newer version" and it'll most likely be on your primary disk (which may be a point of failure).
Not trying to be pendantic but
Re:I dont trust any format. (Score:2)
The key I guess is to keep a spare drive in a second system and backup routinely and replace the drive as a routine. That may not allow for rolling back to a particular date (virus, discovery of otherwise corrupt files, etc), like the standard tape backu
Re:I dont trust any format. (Score:3, Insightful)
I agree with using the hard disk as best backup. The size is small for the amount of data held and the access time to huge numbers of files is only thousandths of a second.
Hard disks have also inherent disadvantages. They are extrememly fragile, they must be screwed into the PC and be connected by confusing cables before use, the cost-per-megabyte is still eight times greater than removable optical disks like CD-R
Re:I dont trust any format. (Score:2)
Make sure that the resolution of the scans of your alternate ID papers is good enough to recreate credible documents. With current 2400 DPI scanners selling for $100-$150 US, that shouldn't be a problem.
2400 DPI? You wouldn't actually scan an 8.5x11" paper at that would you? Unless you want to save a 500MB file for each document.Re:I dont trust any format. (Score:2)
I didn't do the actual arithmetic so the file size might be in that range for a 8"x11" scan at 2400 DPI. I live in the US with US citizenship so I don't have Migra problems and I'm not all that familiar with the techniques of forging ID documents.
My main point with the message is that few people make the connection between having a high-resolution scanner and the possib
Re:I dont trust any format. (Score:2)
An 8.5x11" scan at 2400x2400 dpi, 1 bpp takes a bit over 64 MB. Compression (you could use something like Group III fax compression or PNG here) would no doubt reduce the image size significantly. Such a scan would easily reproduce text or halftone images pretty accurately.
(That said, it's still overkill most of the time. 600 dpi is often good enough. A higher-resolution
Re:I dont trust any format. (Score:2)
Yes, I will see to this as soon as I bury those barrels of water and diesel out in the desert, stockpile 10,000 rounds of anti-aircraft ammo, and prep my 10 year supply of tinfoil berets.
Re:I dont trust any format. (Score:2)
C'mon, a new ID is much cheaper, and (to follow the original thread) much lighter to carry around.
Besides, wouldn't it be just a lot, well, easier, to change into a Canadian when you're in a place where the locals have been conditioned to believe that the Americans are responsible for everything that's wrong i
Re:I dont trust any format. (Score:2)
You mean virtually every other nation on Earth?
Re:I dont trust any format. (Score:2)
When I was young... (Score:5, Funny)
For CDs especially do not:
2. Use a pen,pencil,or fine-tip marker to write on the disc.
When I was young, we didn't have those fancy automatic CD burners, we had to manually write to them. And if you made one error, you had to walk 20 miles through a blizzard to the "local" dealer.
Re:When I was young... (Score:3, Funny)
Re:When I was young... (Score:2)
caddy & military cases (Score:5, Interesting)
Re:caddy & military cases (Score:2, Informative)
Re:caddy & military cases (Score:2, Informative)
Re:caddy & military cases (Score:2)
Black felt marker? (Score:2)
Re:Black felt marker? (Score:1)
Looks like CD storage racks got it wrong then... (Score:4, Interesting)
Re:Looks like CD storage racks got it wrong then.. (Score:5, Funny)
Anybody who was able to get the 50 page article know why doing the horizontal bop is bad?
Re:Looks like CD storage racks got it wrong then.. (Score:5, Informative)
Physical mishandling of the disc is usually the cause of polycarbonate*
layer damage. The polycarbonate may also flex or bend if
stored for a long period of time in a nonvertical position.
and
Long-term horizontal storage, particularly in a
heated environment, can cause the disc to become permanently
bowed. While the data may still be intact, the disc may not operate
properly in the drive or permit the laser to follow the track.
*3.1 Polycarbonate (Plastic) Substrate Layer
The polycarbonate substrate makes up most of the disc, including
the area that is read by the laser (opposite the label side on CDs). It
is present on both sides of a DVD, even a "single-sided" disc with a
label on one side. This substrate provides the disc depth necessary
to maintain laser focus on the metal and data layers. It also gives the
disc enough strength to remain flat. Anything in or on the polycarbonate
layer that interferes with the ability of the laser to focus on
the data layer will result in the misreading of data. Accordingly, fingerprints,
smudges, or scratches, as well as such substances as dirt,
dust, solvents, and excessive moisture (which polycarbonate will
absorb), can interfere with the ability of the laser to read the data.
Contact of any foreign material with the polycarbonate substrate
layer should be avoided.
Re:Looks like CD storage racks got it wrong then.. (Score:2)
Re:Looks like CD storage racks got it wrong then.. (Score:2)
Re:Looks like CD storage racks got it wrong then.. (Score:2)
It's probably like with vinyl LPs, where no position is perfect, but over the long haul they're best off standing on edge, packed sufficiently to give one another support, but not so tight that they pressure-warp one another.
Re:Looks like CD storage racks got it wrong then.. (Score:2)
For long term storage purposes - apparently so.
For convenience purposes ( i.e. being able to read the little title on the side of the case ) ? Heck no.
Re:Looks like CD storage racks got it wrong then.. (Score:2, Insightful)
Re:Looks like CD storage racks got it wrong then.. (Score:2)
Yes, but not of ignorance. Just because the horizontal design looks better in many cases.
Re:Looks like CD storage racks got it wrong then.. (Score:2)
Why should the taxpayers pay for this?
Plus the RIAA could say that the money that they have **extorted** ahem - collected - from 'pirates' has been going to research the greater public good of legitimate music CD buyers.
Maybe the RIAA really is run by morons if they can't see that a positive public relations opportunity such a
Re:Looks like CD storage racks got it wrong then.. (Score:2)
They don't want you to keep cds for a long time, they'd be perfectly happy if everyone scratched up their cds and had to buy new ones every couple years. Much of their buisness comes from people buying stuff they already have bought in the past, it doesn't matter if it is on an old format like tape or if they just destryed the original.
I think the CD-RW boom has hurt the music industry in this way. Now, you can mak
Re:Looks like CD storage racks got it wrong then.. (Score:2)
Digital Preservation (Score:5, Funny)
I'd have to argue... (Score:4, Funny)
Light can make pretty colours on your walls from the reflection off a CD.
AOL CDs make cool coasters - so moisture is good!
Radiation - anyone try putting a CD in a small bowl of water, putting a paperclip on it and putting it in the microwave?
Scratches - Two words(acronymns): AOL CD
Marking - See Scratching
Adhesive labels - but what other kinds of labels can you get? Surely the adhesive types are preferable to the kind that aren't adhering. I mean if I put a CD in a drive with a label that didn't adhere, I'd ruin the drive alot faster than with an adhesive label.
This was only a test (of my idiocy). Had this been a real example of my idiocy, someone would have killed me by now!
Re:I'd have to argue... (Score:2)
j/k, I'll just do it myself then hire the lawyer that did the McDonalds coffee lawsuit. Be seeing you.
Re:You fuck nut! (Score:2)
Guide to Analog Preservation from LoC (Score:5, Informative)
The Library of Congress has a guide right here! [loc.gov]
DRM (Score:5, Insightful)
Can't wait! (Score:2, Funny)
Boy, I can't wait to use my ??? on my ??? in the future!
is CD still a backup media? (Score:4, Interesting)
I've made simple rsync scripts (rsync over ssh for laptop to desktop wireless communication, rsync from disk to disk for desktop). This solution implies good data organization (basically live/shared/cold) but is really fast, simple and up to date.
Are there other
I'm currently planning a bigger (200-500GB) solution based on Firewire drives (I'm using Macs, but it also works on PCs). Do you have any advices/experiences on using those solutions in simple home network?
Re:is CD still a backup media? (Score:2)
You should still be burning snapshots / archival material off to DVD-R periodically with the idea that if you lose a single disc you don't lose everything. The contents of the DVD-R should be protected by recovery data [sourceforge.net] so that even if the media gets badly scratched, you'll have decent odds of being able to repair the damage. (And
Re:is CD still a backup media? (Score:2)
I have read through most of the pdf. It looks to be mostly a compilation of data from a great many sources that aren't from organizations on the level of NIST. I thought they were doing some testing, I had hoped to read about accelerated aging
Re:is CD still a backup media? (Score:2)
I'm kind of interested in what you are doing. I have a similar problem - I've got a large set of data that needs to be shared between work, home, and laptop machines. It's constantly a pain because I've got different versions of the same files on different machines, and backup is a real problem.
Supposing I have the most recent version of file A.cpp on the home machine, and most recent version of file B.cpp on the work machine, if I have to restore the laptop, I'm in a real crunch. I won't get the most
Re:is CD still a backup media? (Score:2)
Well, yes. The problem is that the Win32 compilers don't support the directory traversing API's that UNIX does, and I was trying to write something portable that could be compiled with both gcc and DJGPP. Yes, I could have gone Win32, but I would basically have two different codebases for the differing platforms. Generally speaking, anything that relies on the Win32 API's can't be ported without substantial effort.
what are we made of?! (Score:5, Funny)
8. Expose recordable discs to prolonged sunlight..."
in other words, make no change in your lifestyle whatsoever.
Gee, NIST forgot a lot of things (Score:3, Funny)
They forgot a lot of useful tips. Here they are:
DO:
- not write anything on CDRs. No Data means no data to lose
- use a felt-tip marker to write your data in readable hex format on the label side of multiple CDS, as a backup.
DON'T:
- use your CDs as freesbies to play with the dog
- use your CDs as under-glasses
- punch a hole on the side of the CD to hang it on your key ring
Re:Gee, NIST forgot a lot of things (Score:2)
But can I still cut the write-protection notch in the CD so I can write to the other side?
Timely article... (Score:5, Interesting)
I've been shopping for the best brand of CD-RW I can find for longevity, and I'm going to be backing up all my extremely high dpi scans to disk, twice, and storing a set in seperate locations. I sell my original artwork, so this is important to me. I'm glad to know I shouldn't be stacking these vertically. I don't care much about my music CDs since I rarely buy them new or pay more than $5, and keep them in a large binder w/out jewel cases... but my personal data is certainly more important. From now on I will keep my backup data CDs in proper cases and store them as recommended. I'd also like to know which markers are safe to use. I've always used Sharpies in the past.
I also back everything up to the second hard drive in my system, but when dealing with 50-75MB files that can become impractical quickly. I'm paranoid now because I've been through several hard disk failures this year alone.
Does anyone recommend a particular brand of CD-R(W) disks best known for longevity, while on the subject...?
Re:Timely article... (Score:3, Informative)
In addition you should be looking to add parity/recovery data to your CD-R/DVD-R backup files, which serves two purposes: (a) allows you to verify that the files are
Re:Timely article... (Score:2)
But if I was you, I'd just burn to CD-R's as they are a lot more reliable.
Re:Timely article... (Score:2)
-DON'T buy Memorex "high-speed" CDRW tho, they crap out after about 10 rw's.
Re:Timely article... (Score:2)
Right, but you have to be careful these days. The Taiyo Yuden's are made in Japan. Lots of FujiFilm is Taiwan these days, so who knows what you'll get.
At Best Buy only the 30-pack of FujiFilm is made in Japan. I use 'em for my archival stuff. I use the crappy ones for data transfer 'cause I don't care if they're dead in 2 months.
Re:Timely article... (Score:2)
Re:Timely article... (Score:4, Interesting)
How original and funny you are. If I wanted to see anything that might be in Playboy I could just go take a bath, because I'm a busy chick without time for pr0n. You also conveniently ignored the part where I mentioned I was backing up my own artwork. Just because I might enjoy drawing boobies does not make it pr0n0graphy.
So nyeh.
Every five years, move your complete library (Score:5, Informative)
Thus my MP3 collection has migrated over time from Jaz cassettes to CDR to large hard disk to DVD.
Apart from the practical aspects of finding a reader for old media, the sheer space taken by old media (e.g. my twenty-odd Jaz cartridges) makes it useful to move regularly.
My MP3 collection, freshly re-created from my original CD collection, fits onto ten data DVDs while it would require about 70 CDRs.
Doing this, while also keeping multiple archives on hard disk (CVS mainly) means I have no problem accessing projects that I worked on 15-20 years ago. No way would I have confidence in diskettes or backup tapes from the same period.
Though I do have a 50cm-wide 150Mb removable Wang disk that has some interesting stuff on it if anyone has an old Wang VS lying around.
Re:Every five years, move your complete library (Score:3, Funny)
Sorry, I don't want to have anything to do with your old Wang. And stop lying about it's size. 50cm, yeah right.
Media capacity follows the standard (Score:2)
Re:Every five years, move your complete library (Score:2)
Never imaged a few hundred floppy disks, eh?
I finally broke down and imaged all my old install diskettes, by now completely irreplaceable and some still necessary to my computing world. Took much of a week to image 2 CDRs worth of floppies, and that was with two machines working on it.
Yep, real convenient!
Actually, 360k floppies from 18 years ago are mostly still good (I have a few hundred of those yet to image
Amazing. (Score:4, Funny)
This supposed guide on how to keep CD/DVD discs preserved reminds me of a story back in high school. A friend of mine (around 1997-98) carved his name onto his CD so that other people wouldn't steal it.
Of course, this bright individual decided to carve his name onto the UNDERSIDE of the CD, instead of the top side.
Before I knew this, I asked him if I could borrow the CD so I could rip it to mp3. When I saw the underside of the CD, I realized that there was no help for this person whatsoever.
I think White Zombie plus Acid does bad things to today's youth. Mostly acid.
The most amazing thing is that he graduated high school.
The main lesson here is to TRY and take care of your albums. Don't leave them out, let your kids throw them around the room. But then... this sort of thing is obvious to any doofus who has made it out of high school.
Oh wait...Nevermind.
Re:Amazing. (Score:2)
they forgot the most important one... (Score:4, Funny)
destructive force - 3 year old boys on a sugar
buzz.
Heat and Humidity (Score:4, Interesting)
I live in Southern Mexico where it's hot and humid most of the year, and these conditions apparently make CDs very vulnerable to the fungus. Given that I don't have any environmentally controlled rooms in which to keep my CDs, what should I do? I'm really concerned that my CD-Rs will be ruined from the higher heat which, for most of the year is in the high 80s to high 90s.
I've considered putting my CDs and CD-Rs in the refrigerator, but I'm not sure how safe that is. Can anyone comment on that? My thought was to put them on a spindle and then place that in a ziplock bag, evacuate as much air as possible, and then stick it in the fridge. Can anyone comment on that? I'm afraid even with a little air in the bag, there will be enough condensation to cause a problem. If someone could give me some good advice on how to handle that, I'd really appreciate it.
Re:Heat and Humidity (Score:3, Informative)
Re:Heat and Humidity (Score:2)
A ziplock bag might actually make things worse, since in my experience, they tend to encourage condensation. Something that absorbs moisture, like fibrous cardboard, might be better as a liner for another container.
Free dessicants: Shoe store. (Score:3, Informative)
You can get free dessicants in a shoe store. There is a small package of silica gel in every box of shoes. Friendly shoe salespeople will be glad to give them to you, since they are normally thrown away.
Putting CDs in a refigerator will work if you put them inside two plastic zipper lock freezer bags, or inside a heavy plastic container. However, use great care when you take them out. Let the entire container warm to room temperature before you open the container. Otherwise the cold plastic will cause m
Remember to put the little silica gel bags inside. (Score:2)
I should have mentioned: Using TWO zipper lock FREEZER bags, not the thinner ones, or plastic containers will only work if you put the little silica gel bags inside.
I've stored vitamins this way for years. Multi-vitamins tend to be extremely sensitive to moisture, and degrade much more easily than CDs. Vitamins tend to show spots if they have been exposed to too much moisture.
Re:Free dessicants: Shoe store. (Score:2)
Keep away from children and your dog. It can cause major problems if the eat it. Any air-permeable container is fine; for example a film container with a few holes punched in it. If you or someone you know can sew, then little bags can be sewn up. Throw one in with ever
Re:Free dessicants: Shoe store. (Score:2)
Re:Heat and Humidity (Score:2)
The spindle thing I would question, though. Close contact isn't a good idea. Try slim jewel cases, stored upright in a box, and cover the box with a garbage bag taped up. If you must use
Water-based markers are recommended. (Score:3, Interesting)
First paragraph, page 30:
"Numerous CD vendors have noted that the thin protective lacquer coating can deteriorate from contact with certain solvents in markers. To eliminate the risk, water-based markers are recommended for CD labeling. As a solvent, alcohol is generally less damaging than xylene and toluene, which are common in aromatic solvent-based markers. According to anecdotal reports, alcohol-based markers can be used to label CDs without causing performance problems. However, there are no explicit lab test results to show what effect solvents in markers have on different CDs or DVDs, particularly over the long term."
CD-safe markers. R disks permanent. RWs wear. (Score:2)
More quotes:
"Many vendors sell CD-safe markers, and they vary in ink solution. They should not contain any solvents harmful to CDs or DVDs but should have a permanent quality. For risk-free labeling of any disc, it is best to mark the clear inner hub or the so-called mirror band of the disc, where there are no data (see Figure 12)."
"R discs: In theory, R discs should have a limited number of read times (several thousand) because of the cumulative effect on the data layer from the laser light. As wit
Misleading (Score:4, Informative)
"WOAH 50 PAGES!" Well... yea... but the important stuff is only on a few of them.
So if you plan on printing this out for easy reference... save yourself the extra 48 pages.
Pens for labeling CDs (Score:2, Informative)
Make copies! (Score:2)
Of course, you need to not clean your CDs/DVDs with a Brillo pad in between times, and generally take care of them. But for real permanent retention, nothing's better than a fresh copy.
BTW, this copy doesn't even have to be on the same media standard -- some
It DOESN'T answer the adhesive label question... (Score:2)
The recent reports concern CD-R's that are less than five years old, have nothing visibly wrong with them, but cannot be read.
doppler00 (Score:2)
Mylar punch tape, baby (Score:4, Interesting)
Re:Mylar punch tape, baby (Score:2)
Yup, etching human-readable data into metal and distributing it around the planet is about as good as you can get at the moment :)
See the Rosetta Project [rosettaproject.org] that uses Norsam Technologies HD-Rosetta [norsam.com] is a very interesting real-world example. Reading the Los Alamos National Labs tests of HD-Rosetta [norsam.com] gives some amazing results: 300 deg. C for 65 hours or exposures to saltwater/tap water/a si
Wrong approach (Score:3, Interesting)
I Found This Topic Interesting (Score:2)
I advocated backup to spare hard disk and pointed out that some sysadmins were starting to rsync to offsite hard drives as a primary backup method. Benefits were cost vrs tape, speed vrs tape, accessibility vrs tape, and reliability vrs tape, etc.
The other fellow argued that for home use CDs were much better because HE never had a CD read or write error in si
Re:Sharpies? (Score:4, Informative)
Re: solvents (Score:2)
I thought water is also a solvent? The article should make it clear which solvents are bad; though it is hinted that alcohol is better than aromatic solvents (which usually means xylene or toluene).
Re: solvents (Score:2, Interesting)
Sharpies
White-Out
Permanent Markers, unless there happens to be a water-based permanent marker out there.
That's a real bummer, considering that I'd rather not put a label on a CD that will later smudge or bleed.
For what it's worth
Re:Sharpies? (Score:2, Informative)
They
Re:Gold? (Score:3, Informative)
Of course you're assuming it's a lot of gold, and therefore should cost like gold jewelry. It is a very thin layer, and costs little; it just costs a bit more than a very thin layer of silver or aluminum. You might be getting, say, a dollar's worth (probably much less).
An extra dime or dollar a disk is too much for Wall-Mart's buyers
Re:Google's cache (Score:2)
And now I can do a search and see they have no mention of my method for labelling these disks: a black wax pencil purchased at an art store. Well, apart from their general advice to not use pencils, thoug