A RAW repository, The Internet Archive and OpenRAW 146
Stan writes "I just read this in the OpenRAW mailing list, OpenRAW plans to create a RAW repository, a final resting place for RAW file documentations of current and already abandoned digital cameras. The RAW repository will be hosted in the Internet Archive, which describes themselves as a digital archive of the Internet and other cultural artifacts. And they have all reasons to support OpenRAW, they currently photograph billions of book pages with cameras and store them in RAW format. Unfortunately the camera makers think different (which is not always a good thing)."
Which format again...? (Score:4, Funny)
Re:Which format again...? (Score:2)
Re:Which format again...? (Score:2)
I realize you were making a joke, but RAW isn't a single format. It is a generic term for dozens of different formats, each of which depends on the make and model of digital cameras. Even if you take just Canon, you've got several formats including at least CRW, TIFF (with an extended section containing the raw data), and CR2. Each of these formats supports several camera models which may or may not need to be taken into account when decoding.
Digital == Loss of freedom (Score:5, Insightful)
If you stick with film, you are only limited in your ability to develop your own negatives. If you can do this, you will be able to continue with film for as long as you want. Scan the negs and save them in whatever format you want. It doesn't matter because the actual physical artifact is still in your possession.
Not so with Digital.
In many ways, digital is superior to film. However, when it comes to ownership of your data, you are far better off with film than you ever can be with digital.
Re:Digital == Loss of freedom (Score:5, Interesting)
Unless someone arrests me and confiscates all my software, as well as removes all this purportedly legal software from the market, what is the risk of using this camera?
Re:Digital == Loss of freedom (Score:3, Insightful)
In 20 or 30 years time you might have trouble getting hardware which reads your data and runs an OS which runs your software.
Ok, you might be clued up enough to always copy backups to newer technology, but joe public is one day going to bring a CD out of his dad's attic and find he cannot even look at the photos on it.
Re:Digital == Loss of freedom (Score:5, Insightful)
There is always some risk, period. If I keep stacks of negatives in boxes in my house, then in 20 or 30 years time my house might catch fire and burn to the ground.
Okay, *I* might be clued up enough to always keep my negatives in a fireproof safe, but Joe Public is one day going to use a penny as a fuse replacement and find that he can't look at the photos on all that celluloid ash.
Re:Digital == Loss of freedom (Score:3, Insightful)
There's always some risk no matter what you do. Call it the 'shit happens' principle.
Re:Digital == Loss of freedom (Score:1)
Wouldn't it be nice if Joe's Dad used Smugmug/Flickr. I'm hoping that those guys will still be around in 20 years. I'm sure they'll have a disk array farm the size of Texas.
Re:Digital == Loss of freedom (Score:2)
The trick is to make the formats open (like this project is trying to), so that in 500 years when people dig out those antique nano-disks there will still be documentation for the format. With any luck if they get it right first time the format will still be the de facto standa
Re:Digital == Loss of freedom (Score:3, Insightful)
If anything digital makes it easier to guard against that, because it makes it trivial to ensure mutliple, backups. If you're *really* paranoid you make you've got atleast 5 backups in 5 different jurisdictions.
Re:Digital == Loss of freedom (Score:5, Insightful)
Just to nitpick a bit, most of the professional photographers I know use the various plugins to Photoshop to work with RAW images, so technically they aren't being forced into an upgrade path by the camera manufacturers. I personally use a Canon 10D, and the Canon software is so awful that I always use other tools to convert and manipulate the images.
I fully agree with your point that it would be better if the camera manufacturers fully opened up their file formats, and I fail to see how keeping them closed provides them an actual competetive advantage. However, so long as there is no constraint against converting RAW images to another lossless format I'm not sure that this is a battle in which the camera companies can be accused of trying to pull a fast one on consumers; I think it's merely a case where they need to be educated about the further benefits of opening up their formats (ie open source developers can build free tools, etc).
Re:Digital == Loss of freedom (Score:2)
RAW format seems the best starting format for achieving best results in image manipulation (at least that was the message of an earlier
So the following comparison would not be unreasonable in a review:
-For cameras whose RAW format is publicly available, start image processi
Re:Digital == Loss of freedom (Score:2)
-For cameras with undocumented RAW formats, convert to something like
Admittedly, I'm not a photographer or a graphic artist, but I'm a little confused as to how those are really any different. Chances are your image manipulation is done in Photoshop/GIMP/etc. If you use a Photoshop plugin, doesn't the plugin simply convert the RAW format internally? I assume Photoshop has some kind of standa
Re:Digital == Loss of freedom (Score:2)
So, they're not being forced to buy Photoshop?
10D? (Score:2)
What do you think of the 20D? It looks appealing. The new Rebel XT is tempting as well.
Re:10D? (Score:2)
I'd definitely like to own one -- more pixels, less image noise, turns on/wakes up faster, etc., etc. Of course, if money were no option I'd get the 1Ds Mark II [dpreview.com] and be shooting 16.6 million pixels. If money were no option.
Still, the 10D and its 6.3 million pixels produces shots that are good enough for magazine publication, and I like it way more than the film cameras I've owned. In another ten years we'll probably all be shooting with cameras that capture 50 million pixel
its not so much digital thats the issue... (Score:3, Insightful)
BUT the advantage or "raw" is its the closest you can get to what actually came out of the cameras CCD. because of the way CCDs work this will be about a third the size of the resulting image (assuming they are uncompressed or compressed using a lossless algorithm that gets roughtly the same compression on both).
Re:its not so much digital thats the issue... (Score:2)
Each CCD colour channel has it's own frequency response curve [webcaddy.com.au], which is more complex than a simple cubic or exponential curve. A considerable amount of calibration has to go into developing these equations for all light conditions.
If a new competitor were abl
Re:its not so much digital thats the issue... (Score:2)
The usual "you must protect your 'valuable' intellectual property" canard that lawyers and others like to push to drum up their parasitic business, completely ignoring the fact that openness oftens make better business sense.
In this case any company capable of competing in the market can trivially sniff the raw data coming off their competitor's chip with controlled lighting, a digital storage CRO and a little common sense.
To claim that hiding the the storage format is anything more than anti-competitiv
Re:Digital == Loss of freedom (Score:4, Insightful)
Just to be clear, RAW is like the undeveloped exposed negative. After "developing" it to a TIFF16 or whatever format you want to have. You might think that RAW is equivalent to the undeveloped negative, but it really isn't.
Besides, there is always DCRAW which allows you to "develop" your RAW files in an OSS fasion.
Furthermore the reason RAW formats vary between makers is because it is raw data from the CCD/CMOS. So it's not strange at all that different manufacturers use different formats.
I do agree with you though that we need open standards as far as RAW is concerned. I don't agree that the film world is any better though.
Re:Digital == Loss of freedom (Score:3, Informative)
Also, it isn't particuarly impossible to make your own film. Sure, getting the emulsion nic
Re:Digital == Loss of freedom (Score:2)
Re:Digital == Loss of freedom (Score:2)
On the other hand, making your own digital camera isn't nearly as hard as making your own color film. There's a lot less reasearch and trial &
Re:Digital == Loss of freedom (Score:2)
Today you don't know how the film works, or the digital camera, or the timing and fuel mix control systems of your car. This is perfectly fine, since how it works *is* known, and there are people
Re:Digital == Loss of freedom (Score:1)
What we really need is for it to be enshrined in law, in bold type if necessary, that a person is automatically privy to any secret embodied in any article they physically ow
Re:Digital == Loss of freedom (Score:2)
With a film negative you're able to develop your own images as long as the required chemicals aren't a secret, and as long as it's allowed to sell them to you, and as long as you've got the required skills.
With a image-file you're able to do the same thing as long as it's not a secret how to decode the image, as lon
Re:Digital == Loss of freedom (Score:2, Insightful)
Re:Digital == Loss of freedom (Score:2)
As everyone else is pointing out, I also don't understand why you think physical devices are somehow better off in this regard. You leave no caveat for data standardization in either the physical or digital realm, and standardization is the only thing that gives you any such data security.
It's not data, but look
Re:Digital != Sky Is Falling (Score:2)
So shoot in JPEG. Seriously, I don't get the complaint here. If JPEG isn't good enough for you and RAW comes with some restrictions you find unpalatable and that prevent you from doing good work as a photographer, then it sounds like digital cameras aren't for you. Am I wrong? Why does everything
What's been said before (Score:4, Informative)
RAW format (Score:5, Insightful)
Thanks Canon, you just made me finally feel confident about buying Taiwanese.
Re:RAW format (Score:3, Insightful)
They aren't hurting their presence in the professional space - those folks still are going to buy the camera for its camera features. That provides an opportunity to sneak in other stuff that the camera co
Re:RAW format (Score:2)
Every camera can't *by definition* have the same RAW format. Every camera has different electronics.
Picking a common "RAW" format is no different that picking any other non-"RAW" image format. Might as well ask them all to just store uncompressed images as TIFF files or PNG with the additional metadata. But its not RAW at that point.
Re:RAW format (Score:3, Insightful)
Actually, that's incorrect. The Longhorn interface is binary-only (no source code or format information is communicated to Microsoft or to the OS). Basically, the manufacturer (or third-party developer) writes a driver with an API that makes processed RGB data available to the OS. This is the same basic mode of
Re:RAW format (Score:2)
RAW files were never intended for archival or interchange. The only reason they exist is to take the time and expense associated with "developing" the CCD output to a real image file format, and move it off of the camera and onto the workstation. A 2GHz desktop CPU is going to be much better at converting the data than whatever embedded microprocessor can fit into a camera form factor.
I'm sure the AP's photographers take their shots in a raw format, but the images don't go out on the wire until they've b
My Samsung saves JPG (Score:1)
P.S. I am used of cancon just sending their software development manuals (at least in the past for their printers), apparently some attitude changed.
So does basically every camera (Score:5, Informative)
why? (Score:2)
why does the article link directly to some sort of blog?
Re:why? (Score:2, Informative)
Re:why? (Score:1, Insightful)
"Blogs" are the new informercial. Take something said somewhere else, post it on "your blog". Get a bunch of other accounts and link to it, and presto lots of page hits for your ads.
Then of course, you can get it posted to slashdot (for free, I'm sure), and rake in the Rolandbucks.
I wish google had a "blogs:no" option when searching.
Re:why? (Score:2, Funny)
Re:why? (Score:1)
Re:why? (Score:5, Informative)
this has to be processed to convert it to a form that we would recognise as an image file. This can happen either on the camera or on a PC.
However This conversion process may well not be fully reversable (due to rounding errors) and bloats the data considerablly (CCDs generally make a red green OR blue value at each location image files generally have red green AND blue at each location so turning CCD output into an image file always involves interpolation) so from an archivists point of view its best to keep the raw data unfortunately that raw data is often in a closed format.
Re:why? (Score:1)
http://www.luminous-landscape.com/tutorials/under
Re:why? (Score:2, Interesting)
Re:why? (Score:1)
How Open is the Repository? (Score:4, Interesting)
See:
http://www.vudeja.com/04/09/mailing-list [vudeja.com]
http://www.esthet.org/blog/archives/001294.html [esthet.org]
http://www.wirefarm.com/archives/004186.html [wirefarm.com]
http://www.easterwood.org/hmmn/archives/001111.ht
http://openraw.org/about/ [openraw.org]
Don't be surprised if this site just up and disappears one day, taking all of the data with it.
Re:How Open is the Repository? (Score:1)
Wow! Thanks for the heads up!
Re:How Open is the Repository? (Score:2)
"My concern with OpenRAW is that Juergen Specht abused one stewardship -- the Japan Photography Mailing list -- by uniaterally deleting it. Who's to say he won't do it again?" [openraw.org] (plus your links)
I would have to bet that
Re:How Open is the Repository? (Score:2)
Thank you for your support! You could have used HTML to make the links work.
But I ask you, what the bigger risk? That I delete the mailing list I created, maintain and finance or that Nikon, Canon or all the other camera makers stop supporting some older cameras, leaving you alone with your collection of abandoned RAW files, even you paid for the camera?
And posted
Re:How Open is the Repository? (Score:2)
So far, it's still there. Very strange things going on though such as the number of people voting (21) and the number of stars (1 out of 5). I'm suspicious.
Re:How Open is the Repository? (Score:1)
You're quite right - this is a very real risk.
What we really need is some kind of tool for easily making copies of websites like this and all of the data & source code they contain.
You know, a tool for getting complete copies of websites. Of course it would need a short and catchy name, maybe something like Wget would fit the bill.
In fact, this is such an original and paradigm-shifting idea that I think I
What horseshit (Score:4, Insightful)
But can you blame them? Really, think about this for a second - people (scumbag fucks who should hang from lampposts, call them what you will) from Rambus sat in standards groups for years and then turned around and secretly patented the standard and then had the balls to demand royalties. You saw more or less the same bullshit with
I think it is (sort of) understandable that companies would be hesistant to work together to develop a standard way of doing something - especially in a cutthroat business such as photography.
And by the way, using Canon is a fairly shitty example, Nikon is far worse when it comes to the RAW format (ok, its not really a format) bullshit that flows through the world of pro photography.
That all said, this smacks more of the petty bickering that is involved in cameras more than than anything else (See Also, "Complete lack of lens interchangability" et al), but as always, we (or those who buy $600+ cameras) get fucked.
Don't get me started on how "using the DMCA to "protect" the super complex almost but not quite encrypted raw format". I don't need a stroke at this age. . .
Re:What horseshit (Score:3, Interesting)
The manufacturers are just opposed to working together to create some sort of standard.
Adobe made an open format called digital negative [adobe.com]... The camera manufacturers need to start adopting it.
Re:What horseshit (Score:3, Informative)
Re:What horseshit (Score:2)
The point here is
Re:What horseshit (Score:2)
There is also a risk that the camera manufacturers just dump all meta data into a "private" area for no real good reason. Apparently meta data is often obfuscated in RAW files, this includes things like white balance and such things. Hardly something that is very specific to the
Re:What horseshit (Score:2)
Re:What horseshit (Score:2)
Re:What horseshit (Score:2)
I personally think we should be using a format that is braindead simple on the camera end. Forget having the camera decide that one pixel has this brightness or color, but do it yourself, on a computer - not in the camera.
Each pixel (well, actually, we would want to use sub-pixels instead of viewing 3 sub-pixels (each with a different primary color) as a single pixel) would report that it received so much light while the picture was
Erm... (Score:1)
Please tell me this, this is critical.. (Score:3, Interesting)
From Canon, as they refused to cooperate with openRAW and ended their letter with a slap in the face: "If our equipment or software does not meet your needs, you are entirely welcome to seek other suppliers".
And this is *exactly* what I'll do from now on and for the foreseeble future; I will *not* entrust the future accessiblity of my visual data to such a company and its formats, and I will not render myself under their mercy given their manifest chauvinism. Does anyone know what suppliers are cooperating with openRAW? Those will get *all* my business.
Thanks
Re:Please tell me this, this is critical.. (Score:2)
Re:Please tell me this, this is critical.. (Score:2)
Re:Please tell me this, this is critical.. (Score:1)
Re:Please tell me this, this is critical.. (Score:4, Interesting)
This is true, and unfortunately Canon can afford to take this position. In the DSLR market -- the *serious* digital photography market -- Canon has through various reports a 50-70% market share. Their only serious competitor is Nikon who controls anywhere from 30-50% depending upon who you listen to, and the rest make up a very small percentage. Kodak just announced a complete retirement from the DSLR market, Sigma cameras are doing horribly, and although Pentax and Minolta have decent offerings their market penetration is relatively weak. Canon can throw around threats since Nikon is WORSE in their disregard for RAW, actively encrypting (weakly) the white balance data. Nikon knows the encryption is a joke, but its enough to have legal teeth via the DCMA and thus Adobe won't translate it.
Personally I'm more concerned with the retirement of RAW formats than the current vendor specificity. When you by a Canon EOS system or a Nikon F-mount you're buying into a closed, proprietary hardware system. Extending it to the software realm is crappy, but not surprising. Microsoft is best positioned to bust this wide open, and its in Adobe's best interests to open RAW or see the success of DNG. My guess is once the balance of power starts shifting heavily in favour of Canon or Nikon (towards virtual monopoly) the lesser company will open up their RAW format to be more accomodating.
Re:Please tell me this, this is critical.. (Score:2)
ok (Score:2)
Re:Please tell me this, this is critical.. (Score:1)
And this is *exactly* what I'll do from now on and for the foreseeble future; I will *not* entrust the future accessiblity of my visual data to such a company and its formats, and I will not render myself under their mercy given their manifest chauvinism. Does anyone know what suppliers are cooperating with openRAW? Those will get *all* my business.
You can not just change the supplier, because everyone does the same thing and after a while you'll be obliged to return to Canon and ask them for pardon. T
Re:Please tell me this, this is critical.. (Score:2)
Basically, there point is that they feel they have a good product, and if you're not willing to trust them, go find somebody else to do business with. You $10,000 isn't really worth it to them to (potentially) provide proprietary data to their competitors.
Canon and Nikon are quite good, actually. (Score:2)
Edmund
Need for a broader approach? (Score:5, Insightful)
Something powerful enough to organise boycott that would cause *pain* to the offending company. Something that a congresscritter would be afraid to piss off. EFF comes close, except that it a) has a broader scope and b) sadly is not powerful enough.
Too bad that the existing consumer organisations are focused on making money from their "consumer reports" and the general population doesn't care (the frog is half-boiled and still comfortable).
Re:Need for a broader approach? (Score:2)
They would become powerful enough if they received more donations.
If you agree, show it not by replying and saying so, nor by modding me up, but by DONATING TODAY!
Re:Need for a broader approach? (Score:2)
Other conditions could be:
You co
going canon fanboy in here but (Score:3, Informative)
i suspect this is just canon usa marketing dicks playing bs politics for their own sake. so far theyve given out a lot better specs for most of their printers than most companies, and few printer mfg's will even bother to put out cups drivers for their lines.
not releasing their RAW format seems amazingly petty, but sounds exactly like all those fat, middle-aged sales execs who thought it wasn't worth it developing open-sourced linux drivers, cause they could get more commision charging each customer for the drivers themselves. we released them anyway, but a lot of those types make VP and do stupid shit like this to try to throw their cock around.
Re:going canon fanboy in here but (Score:2)
Re:going canon fanboy in here but (Score:2)
Re:going canon fanboy in here but (Score:2)
I'll take that as sarcasm. If not...please ignore the following comments.
Both Epson and HP have provided drivers for printing under Unix-like systems. HP, specifically, has gone out of thier way to be helpful and contribute what they have to CUPS. The Gimp-print folks could use that at a minimum while contacting HP's reps for the CUPS drivers for more det
Re:going canon fanboy in here but (Score:2)
Just keep... (Score:3, Informative)
Re:Just keep... (Score:3, Informative)
storing raw digital images is stupid (Score:2)
Raw image may theoretically contain a tiny bit more information under some circumstances. But you have a cost/benefit tradeoff: store and manage terabytes of raw images indefinitely vs. just achieving the same quality by using higher quality imagers together with standard image formats. Both store the same amount of information in the long run, but the latter is the be
Re:storing raw digital images is stupid (Score:4, Insightful)
You can not tweak certain settings as easily once the image is convert to another format, even a lossless one like tiff. Best example is white balance.
Re:storing raw digital images is stupid (Score:2)
White balance is just as easily adjusted in TIFF as it is in a RAW format as is most everything else. It's simply a matter of what tools are available. The only thing you lose is the opportunity to do the demosiac over again.
you need to know what you are doing (Score:3, Informative)
Indeed, you are. That's because JPEG doesn't have the depth and gamut to represent digital images captured by modern cameras. If you use a more modern cooked, open format (e.g., TIFF, JPEG2000) at the right depth and at a lossless or high quality setting, then you lose nothing.
Later you may want to re-process the picture with superior software (it does get better over time).
And you c
LOUD NOISES! (Score:1)
Re:LOUD NOISES! (Score:1)
WTF is 'RAW' ? I know what raw meat is. I know what a 'raw deal' might be. But neither of those seem likely in the context of this story.
In this context... (Score:1)
that's just stupid (Score:2)
You do not need manufacturer-specific formats to do this. There are a bunch of formats you can use that store the data in a vendor-independent form and still let you recover the original data.
The most important thing about such formats is that they need sufficient depth (16 bits per channel), they need a choice of los
Camera Companies Really Don't Care... (Score:1)
Sure the pros use it, but they are already locked into a system so they just complain (or don't think long term).
i use JPEG... (Score:2)
(and my camera doesnt support RAW/Tiff or something else)
Is the RAW format really that better (for someone who just want to make pictures)?
If i'd do it professionally (and require the best quality), i'd use raw, but i dont see a reason why i should drop jpeg for raw.
Re:i use JPEG... (Score:1)
The problems come when you save the same image multiple times. Each time you save a JPEG image it's compressed a bit further, with a loss of more information. Eventually, you can be left with a fuzzy mess. It takes a couple of times for it to become noticeable, but it happens. For the vast majority o
Summary of some key points: (Score:4, Informative)
RAW doesn't really refer to any single file format. RAW refers to pulling the unprocessed (raw) sensor data out of a digital camera. The actual layout of the bits varies from brand to brand, and often from model to model.
Why do photographers want access to the raw data anyway?
Many professional/prosumer photographers like to archive the version of their work that contains as much of the originally captured information as possible. In the professional film world, this meant processed slides (for consumers, this meant processed negatives). In the digital world, the RAW file contains all the data captured by the camera, before some data is lost by compression and other data is added through interpolation.
Can't they just pull a lossless image out of the camera and be happy?
No. The very act of converting the raw data into an image involves lossful processing of the data. Out of gamut color data is discarded, and CCD color data is interpolated to fill surrounding pixels.
There is no real alternative.. (Score:2, Insightful)
Final resting place? (Score:2)
A final resting place, eh? What is OpenRAW, a symlink to /dev/null?
This article should probably say: A place for people to search for RAW file documentations, not a final resting place... Come on guys, be a bit more imaginative!
RIP, RAW...
Re:Can anyone say... (Score:1, Funny)
Re:Can anyone say... (Score:4, Funny)
Re:Can anyone say... (Score:1)
Re:Gaaah! (Score:2)