Vint Cerf Warns Against 'Digital Dark Age' 166
An anonymous reader writes: Vint Cerf, speaking at the American Association for the Advancement of Science, said we need better methods for preserving everything we do on computers. It's not just about finding better storage media — it's about recording all the aspects of modern software and operating systems so future generations can figure out how it all worked. Cerf says, "The solution is to take an X-ray snapshot of the content and the application and the operating system together, with a description of the machine that it runs on, and preserve that for long periods of time. And that digital snapshot will recreate the past in the future." Cerf is also pushing for better data preservation standards: "The key here is when you move those bits from one place to another, that you still know how to unpack them to correctly interpret the different parts. That is all achievable if we standardize the descriptions."
Already happened to a good portion of the early we (Score:4, Insightful)
A lot of the original web is gone, whats left is crowded out by seo bs. And I'd rather not have and ad company decide what part of the web is relevant to me.
Re: (Score:3, Funny)
A lot of the original web is gone, whats left is crowded out by seo bs. And I'd rather not have and ad company decide what part of the web is relevant to me.
Luckily I saved it to a floppy.
Already happened to a good portion of the early we (Score:4, Informative)
Re: (Score:2)
Re: (Score:2)
Wasn't NSA around back then with their backups? ;)
That is what VM's are for (Score:3, Funny)
just put the system in a VM image, save it, and there you go. Problem solved.
Re: (Score:2)
Re: (Score:2)
WMware has been around for a long time. Your 15 year snark might not be that hard to achieve actually...
A 15 year old datafile or binary doesn't sound nearly as impressive as it used to.
Apple II emulators ... (Score:2)
A 15 year old datafile or binary doesn't sound nearly as impressive as it used to.
Apple II emulators and disk images may have passed that 15 year mark.
Re: (Score:2)
AppleWin only *this* year correctly emulates the video hardware [youtube.com]
Re: (Score:2)
AppleWin only *this* year correctly emulates the video hardware
Video has worked quite well for quite a long time. Lacking support for a rare undocumented unsupported hack doesn't represent a major bug in the emulator.
Re: (Score:2)
> rare undocumented unsupported hack
Switching video modes **mid-scan line** is NOT some "rare" undocumented unsupported hack.
It is about achieving 100% cycle accurate emulation.
Re: (Score:2)
Switching video modes **mid-scan line** is NOT some "rare" undocumented unsupported hack.
Google it. People who used it back in the day mention it is not supported, relies on a hardware quirk and does not work on all Apple IIs.
It is about achieving 100% cycle accurate emulation.
And achieving 99.x% is an amazing technical achievement and extremely useful.
Comment removed (Score:5, Interesting)
Re: (Score:2)
you're funny, take your version 1 disk description and volume files and put them in the lastest version and see what happens.
Re: (Score:3)
Good luck on reading that VM image in 15 years.
Just this week I ran a Commodore 64 emulator inside a Win95 emulator inside Windows server inside a VM. And it was still blazingly fast compared to the old C64 floppy drive!
We're getting to the point now where the exponential increase in speed that made emulation so easy has slacked off, but we're also taking more care to properly document formats and archive software, so that less emulation is needed. I'm sure in 20 years I'll still be able to run that C64 software somewhere.
Re: (Score:2)
Apparently, there is a C-64 emulator written in Javascript? [kingsquare.nl] (I don't know enough to try it)
On the other hand, I've recently been playing Sim City 2000, an ancient DOS game in a DOS Box, provided for free by EA....
Welcome to the 90s! (Score:3)
Or whenever the first person warned about the same thing. Which was a loong time ago...
Re: (Score:3)
As we become more sophisticated, we design things that are more delicate. The more advanced we are, the less likely our creations will be accessible to those who come after we fall.
Which, considering that we've demonstrated these capabilities once already, and considering how long we or bipeds like us have been around, implies that it's happened before.
If there were more advanced civilizations before us, there's no reason to think we'd know about them.
Re: (Score:2)
If there were more advanced civilizations before us, there's no reason to think we'd know about them.
Some things would have survived, just like some of our products will survive for a very long time. Our geostationary satellites will be there for a very long time, for example.
Re: (Score:2)
That seems like a bizarre example... there are plenty of other stuff that will hang around for a long time. Building ruins will be around for millions of years. Radioactive waste will be around for a long time too (which is why it's so hard to deal with). If there were any civilizations like us in Earth's past, we'd definitely know about them.
Our local time capsule... (Score:5, Interesting)
Re:Our time capsule...Library of Congress (Score:3)
Library of Congress seems like the logical place to set up to archive old OS's, hardware, emulation and other items needed to read, archive, restore & recover old media. That is what the LoC does for 'documents.'
Re:Our local time capsule... (Score:4, Interesting)
Part of my old job (in a museum Exhibits department) was upgrading interactives and videos from the 80s and 90s to modern equipment - that included "transferring" laser discs the old fashioned way - plugging one of the still-working players from the floor directly into the capture hardware.
The thing is, I was transferring LD to DVD, which is actually a step *down* in quality. Kind of but not quite like how VHS is a step down from Beta (which I also dealt with).
The great thing about standards is there's so many of them!
Re: (Score:2)
You must have been using a sub-par encoder then. A single layer DVD disc usually allows a significant step up in quality compared to what you would get with an LD disc.
Re: (Score:2)
Be thankful they were just plain laserdiscs - the BBC Domesday Project [wikipedia.org] is an oft-cited example of digital obsolescence, involving weird analogue/digital laserdiscs and custom computer hardware...
Re: (Score:3)
Well, luckily the trend has been away from tying one specific format to one specific media. Instead of the Audio CD you can have an MP3/OGG/AAC file that'll play from a HDD, SSD, USB drive, burned to a CD, DVD, BluRay, stored on a tape and so on. That eliminates the need for ancient equipment and media. Of course that doesn't really make it any easier for a time capsule, but the way to preserve is to copy forward. Along with integrity checking those photos you take today can be just as pristine in 100 years
Re: (Score:3, Informative)
Last week I made a fresh copy of my 'archive' of everything computer related from my 20's. I copied everything off the 5 DVD-R disks that I burned in the early 00's onto a USB hard drive.
What was on the 5 DVD-Rs was what I copied then off about 30 CDR disks.
What was on the earliest few of the CDR disks was what I had copied there off DC2120 tape cartridges.
There is even one of the DVDs arranged with folders called 'CD4, CD4, CD6' and some of the CD folders have subfolders with names like 'Tape7, Tape8, Tap
Re: (Score:2)
In the case of the time capsule you describe, it was a dork thing, not a lack of standards thing.
Whomever put the laser disk in the time capsule thought they were being all futuristic and stuff. They should have put a
Re: (Score:2)
Whomever put the laser disk in the time capsule thought they were being all futuristic and stuff.
Then can you tell me what data storage method will still be in use in 50 or 100 years time? Without "being all futuristic and stuff".
Re: (Score:2)
I'd vote for the humble DVD - although obviously even now it's a legacy format. It's reached such critical mass that there will likely still be some working DVD readers out there 100 years from now, if for no other reason than to transfer old DVD-based archives and videos.
Even today you can buy floppy disk readers, for example. 100 years from now, you'll probably be able to buy external DVD/Blu-Ray/Whatever readers that plug into your USB 8.0 ports for $20 or so.
Re: (Score:2)
my vote: hemp paper or vellum, and lampblack ink.
It worked for the Chinese.
So far so good (Score:3)
I can fire up a TI-99/4A emulator or an Amiga emulator and run all my old software from three decades ago. Can someone name a general purpose computing platform (IE not including mainframes or supercomputers or other exotic low-volume hardware) whose software we cannot execute using an emulator?
Re: (Score:2)
so far so bad, the most important wares from the past run on the category you excluded, various non-IBM mainframe architectures that helped rule the business world in decades past, besides the pre-1964 IBM ones. Instead you are focused on geek toy/hobbyist/consumer ones.
Re: (Score:2)
Business accounting will not be remotely as interesting to future generations as video games, aside from the records. How they got the numbers is zzzzz. What the numbers were may be relevant.
Re: (Score:2)
The claimed goal in the article was " recording all the aspects of modern software and operating systems "
That means systems that make things, control things, track money, etc. Not just entertainment devices which are of far less import to future historians, archeologists, technologists, engineers, etc.
If you're only worried about things with popular appeal, I'd submit for consideration recording all extant porn would be of greater interest in future years than our games
Re: (Score:2)
Nobody wants to look at old porn.
Re: (Score:2)
yeah no one ever goes to see those temples in India and Pompeii...just a few milliion a year
Re: (Score:2)
Again: toys. All you care about is toys, it seems
Most people will care about the things they can relate too.
The only people who will care about COBOL are people concerned with actual historical records
Those people need to get laid more often.
Re: (Score:2)
most of them are probably more concerned with making it to the toilet in time to not piss themselves than scoring some trim.
Re: (Score:3)
An interesting list: http://en.wikipedia.org/wiki/L... [wikipedia.org]
Re: (Score:2)
The Wang PC.
Re: (Score:2)
I still have a dual 3.5 (built in) portable keyboard thing, somewhere. Not a typewriter, it doesn't have a printer. It does have an 8" custom CRT and runs on DOS, though. It sort of resembles a BBC Model A (which I also have), the diskette drives are mounted at the back facing the user - literally on top of the motherboard.
I think it's actually an Olivetti, can't find it to check though, it might be in the loft.
Re: (Score:3)
XBOX Classic. ...
"Xbox is just like a PC, it's easy to emulate!"
Yes, we've all heard this silly and pointless argument a million times and it usually ends in the same, and rather ignorant conclusion (or should I say assumption) that just because the Xbox is PC similar, it's hardware should be relatively easy to emulate. That's a very wrong frame of mind. How hard can it be? Very. Xbox's hardware is very complex and still poorly documented to this day. This requires some explanation.
1. Is a PC easy to emulat
Re: (Score:2)
the Xbox's CPU can be emulated, but not accurately and not in real time - which is the whole point of a useful emulation.
Not really relevant anymore. A single x86 CPU doesn't even run the same code in exactly the same way as it did 2 seconds ago. There could easily be an order of magnitude difference, if not several orders.
Re: (Score:2)
depends what else it's doing at that instant, I guess. But the idea of a hardware emulator I'm guessing here, is that it resembles a freshly powered up doing-absolutely-nothing-else-but-waiting-for-input target system as closely as technically possible - to the point where the *software* doesn't know the difference.
Re: (Score:2)
Plenty. Virtually all the AI software of the 60's and 70's is lost now. They were usually written in custom Lisp dialects for which no interpreter exists today. Even if you can find the interpreter code, there's no way you could run them, because they were heavily optimized for custom hardware that is long gone, the companies developing them also long gone, along with critical information that you'd need to write an emulator.
Lisp is especially problematic in this area because of the huge variety of non-stan
Re: (Score:2)
Mainframes are so easy I wonder if it was worth excluding them. Hercules can emulate pretty much all IBM and plug-compatible mainframes - to the point where, providing you have the reader hardware, you can read the OS straight off the old media and load the system on a VM on a Windows 7 host. On a laptop.
(I use Hercules for gits and shiggles to run IBM VMS/370 I found on an archival CDROM).
Does that mean? (Score:2)
We keep all the information about the Khardasians around?
In related news ... (Score:2)
The Apple business model. (Score:5, Insightful)
Anyone who's used Apple software for more than five years has been burned by forced format obsolescence - ClarisWorks, AppleWorks, old QuickTime codecs, the PICT format, SimpleText, Font Suitcases, the list goes on. And on. And that's just *one* platform and set of formats off the top of my head. I lose data to software "upgrades" so often that it's the single biggest determining factor in my upgrade cycle and a huge determining factor in the uptake and use of new software. We aren't heading for a digital dark age - we're in one already.
Re: (Score:2)
There exists a conversion path for every thing that you listed. If you are concerned about the longevity of a particular format, you should probably avoid proprietary solutions.
Re: (Score:2)
A long and twisty conversion path. Just like with Microsoft. You need Word for Windows 2.0 to read the Word for MS-DOS files. You need Word for Windows 6.0 (Office 4.3) to read the Winword2 files. You need Office 97 to read the Office 4.3 files. It's even worse with Apple, because they can.
Re: (Score:2)
It is twisty, but chances are you don't need anything that you didn't bother to convert after several generations of product. A theoretical loss to historians, but also a nice low-pass filter for them as well :)
Stop using non-Free Software (Score:5, Insightful)
Quite right, in fact most of what gets posted to /. including this story could be responded to with a phrase Eben Moglen has been saying for years in his talks: "RMS was right". Richard Stallman had it right years ago and, equally importantly, for the right reasons. Not "Open Source" (the younger movement Brad Kuhn rightly points out is built to greenwash proprietary-supporting non-copylefted Free Software (copy 1 [linux.org.au], copy 2 [slingshot.co.nz]) but strongly copylefted Free Software released and developed for freedom.
The Affero GPL version 3 [gnu.org] or later will keep software Free as in freedom and meet the needs of the future. Users will undoubtedly want to know how things work and benefit from software written by programmers allowed to understand how things work. This will help us avoid the very trap the grandparent post referred to (and you wisely advised against).
Re: (Score:2)
no you are and every other walled garden user
meanwhile I can still boot ms dos on an i7
Re: (Score:2)
It's worth it.
Agendas (Score:2)
Probably short sighted. (Score:3)
If we survive as a society, in 500 years, our technology will be so advanced there will be systems we cannot even conceive of that capable of analyzing pretty much any data or bytecode you throw at it. Documentation or support systems will most likely serve a more historical than practical purpose.
Re: (Score:2)
Though this fact doesn't lessen the importance of preserving as much as we can for posterity.
Re: (Score:2)
That sounds reasonable, but think of the engineering the Romans pulled off. It's often said we didn't really understand how they did some of those things and I'd wager that some of them may have been difficult to duplicate in say 1800 even with the vastly superior technology of that era.
FUD ? (Score:3)
This is a great idea. Preserve previous generations of software & data, emulate old hardware . Then we will be able to enjoy all the goodies from the Apple ][, IBM 360 and Commodore 64 era!
But wait, we can already emulate just about any old equipment. Most of what was worthwhile on floppy disks or tape is now online, available to most of us. Even our government, slow though they may be, has found ways of bringing old software & data to modern machines. Cloud storage and networking brings more interoperability over time and the future looks bright. Movies from the 1920s are available on modern media as well as Edison's cylinder recordings. So what's the problem? Oh, your dad's home movies. Sorry about that.
Legacy Support (Score:2)
We desperately need legacy support.
1) All existing and past applications should be able to run on current platforms. This can be done economically and gracefully with enveloping. That would even allow modern OSs to run software from all previous OSs even those not in their lineages or hardware histories. There is no good excuse for Apple, Microsoft and others making the OS's not compatible with legacy software. Access to legacy software is key to our being able to access our data into the future.
2) OS maker
Re: (Score:3)
There is no good excuse for Apple, Microsoft and others making the OS's not compatible with legacy software.
Sure there is. It costs a lot of money to keep everything compatible.
Re: (Score:2)
"It costs a lot of money to keep everything compatible."
What a short sited response you have. Consider:
1) there are hundreds of millions of older iOS devices and Macs.
2) older iOS offer an inexpensive way for new users to come into the fold and become customers.
3) Apple makes the vast majority of their money on software and content.
Ergo, by offering legacy support they greatly increase their market share and their income.
The same argument could have been made for PCs except they don't last.
Play the long gam
Re: (Score:2)
Play the long game. It's for winners.
According to who? They only need to think on a time scale terminating at their retirement.
I would suggest vinyl disks (Score:2)
Some of mine are over 50 years old and still work perfectly. Reproduction doesn't even require electricity. They are very low maintenance, but not very space efficient.
Re:I would suggest chiseled stone (Score:2)
There are some over 5000 years old and still work perfectly. Reproduction doesn't even require electricity. They are very low maintenance, but not very space efficient.
See what I did there? You've suggested a medium which may be somewhat practical for a very limited purpose, but wholly unworkable for the type or quantity of storage needed today. Unless you were going for humor, in which case I proffer a wry smile.
In reality, what is needed is not a static storage format but a dynamic one which regularly rea
RIP iPod click-wheel apps (Score:3)
I used to really like the Tempest game for that, and the card game wasn't too bad.
I wanted to get Monopoly and Mahjong for it and some other games but by then they stopped selling them on the iTunes store. There was a pirate torrent going around but the apps were encrypted and no way to install them on another device. Finally they just stopped making them.
Apps like that... gone forever.
iOS 3.0 apps that got the App store going... gone forever. I still remember playing the unofficial lights off game, beat all 150 levels. (Wrote a program to solve them)
Unless someone wants to make an emulator for the original iPhone you could do it by downloading the ROMs just like old Apple emulators, but how would you approve the apps without a 3.0 app store around?
In theory someone could crack Apple's old signing keys and have a local "FakeAppStore" program that validates them and allows installation on the emulator.
The "cease and desist" letter would probably arrive less that one minute after putting such project online.
Digital Archive (Score:2)
My wife did her thesis on this subject
The case for the creation of a reliable digital archive for the preservation of personal digital objetcs
http://explorer.cyberstreet.co... [cyberstreet.com]
legacy platforms and software subscriptions (Score:2)
This has already happened to some university researchers who used proprietary software for research that required yearly licensing or platforms that are no longer supported by university IT staff. Even better, the company may have gone out of business or the software has been discontinued.
Re: (Score:3)
A lot of people have been thinking about this problem of digital preservation for a long time. archive.org [archive.org] has a library of software which can run under emulation in Javascript on a browser. Basically the answer to his question is to work on emulation and archival.
Google has done several steps backwards in their digital preservation projects lately.
Re: (Score:2)
So close and yet so far away. I really don't understand what the issue is. The US Federal government has offered to copy everything at no (further) expense [wikipedia.org].
What is the matter with you people? Don't you understand help when it drops on top of you like a piano?
Re: (Score:2)
the software to which you refer has been modified to run on a platform that is pretty universally loathed. I have a fairly comparable collection of software that runs "native" (as in completely unmodified with the exception of later DOS titles that require access to CDROM images - platform hacking takes care of that at the host level) on a virtual machine using original Microsoft MSDOS.SYS and the other gubbins that make up MS-DOS 6.22 installed on a sandbox from original installation media (3 floppies for
Vint Cerf worried no one will remember him... (Score:2)
Re: (Score:3)
Not everything needs to be preserved for future historians. Mortality and the oblivion of time are fundamental aspects of the human condition; therefore, the things that do escape oblivion, like better literature and song and monuments, serves as a kind of immortality for men who achieved something worthwhile. Your tweets don't deserve that kind of glory.
Pretty much this. It is going to take millions of years to sort through the crap that is already here. Just wait until Web 3 or whatever is coming down the pike.
We need to hit the delete key even harder.
Re:Not everything is worth saving (Score:5, Insightful)
Not everything needs to be preserved for future historians
With respect, what is and what isn't worth preserving is up to future historians to decide. A bit chicken and eggish but there you are.
Re: (Score:2)
With respect, what is and what isn't worth preserving is up to future historians to decide
It's up to us to decide how much we care about what future historians want.
Re: (Score:2)
Re: (Score:2)
Deciding what was worth preserving is a useless job. Something was either saved, or it wasn't, and the decision has already been made.
Re: (Score:2)
Not everything needs to be preserved for future historians
With respect, what is and what isn't worth preserving is up to future historians to decide.
Historian don't make such a call, they preserve everything. A cuneiform clay tablet with a receipt for a shipment of wheat is preserved as if it had the story of Gilgamesh on it.
Decisions of what to preserve are more the domain of invading Vandals and the city residents trying to hide things from them.
Re:Not everything is worth saving (Score:4, Funny)
Re: (Score:3)
Re: (Score:2)
I just coffee'd my keyboard, you git!
Re: (Score:2)
Yeah! 200 years from now, all the music of today will be considered classical and be played on future-NPR with the same pretentious tones they play Mozart in today.
Or, the pretentious tones of the future will be the death metal growl, valspeak, or sound like Borat....
Re: (Score:2)
I can see it now:
"Vangelis has dentist today. NLF."
"3 Spartans like this".
Re:Sheldon Cooper sniffs Penny's pooper! (Score:5, Insightful)
Well, I must say, that's a better argument for NOT preserving everything that's on the web than I was going to make,
That being said, from the second link:
The obsolescence of data is a real problem. Much of my old digital art is on Jaz discs, which are obsolete and very expensive to get transcribed.
Couldn't have been THAT important if you didn't make a copy to other media when you saw that Jaz disks were obsolete. Just like there were probably 1,000 floppies (5-1/4, 3-1/2) that I tossed while going through my "archives." Anything important was long moved to other media.
Re: (Score:2)
You are embedding more information that could interest a future historian than you may think...
Re: (Score:3)
only ancient encryption not breakable by fast comp (Score:3)
>. You obviously do not understand encryption. Unless a weakness in the underlying algorithms is found, "a faster computer" will never be sufficient to break modern encryption.
Indeed you seem to be completely ignorant of the subject. The whole science of encryption is all about finding operations that a) can be done quickly by a smart phone yet b) cannot be undone slowly by a cluster. That's far from a solved problem. In fact it's funny you mention "modern encryption" because ALL modern methods of enc
Re: (Score:2)
Re: (Score:2)
Re:only ancient encryption not breakable by fast c (Score:5, Interesting)
Any and all other methods of encryption are subject to at least brute-force attack, which means they can be broken almost instantly, given sufficient computing power.
I think you may be underestimating how much computing power is required to brute-force attack modern encryption, especially when using a sufficiently long key. At the moment, we're talking about a modern PC operating until the heat death of the universe timeframe to break the encryption of a 2048-bit SSL certificate. Many of the early encryption schemes were broken because of flaws in the algorithms which allowed massive shortcuts to be taken or were weakened with very short keys (remember 48-bit keys?). Remember, with every bit added to the key, we double the inherent strength of the encryption, and cryptologists have gotten much, much better at creating incredibly secure algorithms as well.
It really isn't just a matter of waiting for hardware to catch up. Even with exponential speed increases in computing power (which isn't happening anymore, btw), in 30 years, we'll still be nowhere close to breaking today's state of the art encryption unless breakthroughs have been made that allow us to shorten the compute time via a weakness in the algorithms. It would take an unbelievable leap in computational efficiency (say, quantum computing) before we can even dream of brute forcing keywords of today's most secure algorithms, even within our lifetimes.
evidence is today's are like yesterday's. MD5, SSL (Score:2)
>. cryptologists have gotten much, much better at creating incredibly secure algorithms as well.
The evidence indicates otherwise. In fact, we're currently proving that most material which is currently encrypted can be readily decrypted by quantum comouters. We thought MD5 was secure, until it was broken. We thought SSLv1 was secure, until it was broken, we thought SSLv2 was secure, until it was broken. That goes back to the Caesar cipher. Caesar thought it was secure - until it was broken.
We have so
Re: (Score:2)
You obviously do not understand encryption. Unless a weakness in the underlying algorithms is found, "a faster computer" will never be sufficient to break modern encryption.
"You can't hide secrets from the future with math." - MC Frontalot
Re: (Score:2)
Post with your name and cite your sources.
Why Save Everything? (Score:2)
Re: (Score:2)
Actually, Bea Arthur said in an interview that it was actually "commandant," from the time she served in the marine corps and fought the Germans in WWII.
Re: (Score:2)
Little known fact: _Benson_ and _The Golden Girls_ were the same show.
Re: (Score:2)
Nah, it's from The Odd Couple, that show about the NASA Astronaut and Russian Cosmonaut who were totally-not-gay roommates. "I'll be your cosmonaut".