HP Restores Creased Photos With Flatbed Scanners 125
An anonymous reader writes "Scientists at HP have developed a technique to detect creases in photographs using standard, unmodified flatbed scanners. Once correctly scanned into a computer, software can determine where the photograph's defect is, and artificially correct it to remove any trace of a crease or fold. The result is a spotless JPEG scan from a creased photo, with absolutely no modified hardware and no technical know-how required on the part of the user." They're using multiple light sources to do this, in a way that reminds me of last year's description of 3D image creation using an ordinary digital camera.
Nice (Score:5, Funny)
A fold-less centerfold :)
Re:Nice (Score:4, Funny)
It makes my blood run cold.
Re: (Score:3, Interesting)
Re: (Score:3, Funny)
Re:Nice (Score:5, Funny)
Re: (Score:1)
If you might be so bold.
Re: (Score:2)
DOH!
Re: (Score:1)
Chorus {Repeat 3x} (Score:2)
...and it suddenly dawns on everyone exactly why Archon V2.0 failed in his childhood dream to become a lyricist...
It's okay, we're getting to the part of the thread that doesn't have any words:
"Naah-naah-na-na-na-na, Nah-nah-nah-nah-nah-na-na-na-na-na-naaa...."
Re: (Score:1)
Why? So it can be RickUNRolled?
Re: (Score:1, Informative)
My Angel is a crease-less centerfold
Re: (Score:1)
Re: (Score:1)
Re: (Score:1)
A fold-less centerfold :)
Does it remove staples as well?
Re: (Score:2)
I'm reminded of a scene from Critters where a shape-shifting bounty hunter changes form to match a centerfold photo.
It's a perfect reproduction, including a giant staple in her navel. Sounds to me like they already had this wonderful technology - look maw, no folds!
Wait, wait (Score:5, Funny)
Re:Wait, wait (Score:5, Informative)
Won't this ruin my collection of photographs of creased paper?
Actually, no, it won't. Since the method uses different light sources to build a partial 3D model of the actual shape of the crease, your mere photographic creases won't be detected. You can breathe a sigh of relief.
Re: (Score:2)
Won't this make my hobby of scanning folded pieces of paper harder?
Re: (Score:2)
funniest thing I ahve read on /. in a long time.
Re: (Score:2)
!unmodified (Score:3, Interesting)
In the article it says that they use an unmodified scanner, but later on they claim to control the lights of the scanner individually... how is this not modifing the hardware?
Re: (Score:2)
Modification implies a hardware change. Using lights individually is simply a new way to use something. Does not imply a hardware change.
Re: (Score:2, Informative)
Yeah, but I'm guessing there was no reason for the scanners to come with individual controls for each light before this technology
Re: (Score:3, Insightful)
Re: (Score:2)
Contrast control, avoiding light pollution in the sensors when scanning an undersized object, lamp longevity, improved support for scanning coarse film grain photographs, glare reduction on shiny objects...
I could think of a few.
Re: (Score:3, Informative)
From a different FA: [newscientist.com]
Re: (Score:1)
Most flatbed scanners use two separate light bulbs to accurately capture all the colour in a photo. By controlling these independently of each other, two slightly different images (each taken from different directions as the bulbs move under the photo) can be captured of the same photograph. From these, rudimentary 3D information can be generated.
great.... (Score:2)
Not really (Score:5, Insightful)
I was hoping they were using that 3D information to do something interesting to actually restore the image. They're not.
They're basically using rudimentary 3D information that they can get out of the scanner to determine that a crease exists. They then remove it with a simple infill algorithm, which is as basic as it gets (although it often works ok), and which you can find in most image editing software. It's no coincidence that the example image they use has a crease going over mostly similarly colored and low-detail areas.
So what they're doing is not an improvement to restoration, it's just an improvement to defect detection. Basically, it saves you having to tell the software where the defect to be fixed is, the fixing is the same quality as it's always been.
Re: (Score:3, Interesting)
Re: (Score:2)
Just use the Google method, of course there is the little problem of it being patented.
Re: (Score:2)
Re: (Score:2)
Re: (Score:2)
So what they're doing is not an improvement to restoration, it's just an improvement to defect detection.
That's still helpful, isn't it? It seems to me that part of the problem with any algorithm to automatically fix photos is that you have to make sure the software knows the difference between a defect and a detail. If it detects what it thinks is a crease or a scratch, but it's really part of the image, it might edit out something you don't want it to.
If the crease destroyed image info . . . (Score:2)
Re: (Score:2)
Other uses for 3D info (Score:5, Insightful)
The rudimentary 3D info can be used for improving all sorts of scans.
How about...
- Flattening a scan of a book (by the spine)
- Focusing an area that's raised (products like Focus magic [focusmagic.com] assume a section is all out of focus at the same level, whereas a map of the amount of lost focus is possible here).
- Using the above, scanning non-flat items.
- Scanning nearly-flat 3d surfaces.
Add a lens that can vary focus (based on the light differential) and you'd have a good 3D scanner for one side of a mostly-flat item, and a flatbed scanner that wouldn't lose focus on slightly-raised papers.
Re: (Score:1)
The application that comes to mind first for me is using this technique to capture realistic bump maps for use in 3d graphics.
Book valley detection (Score:5, Insightful)
Re: (Score:3, Interesting)
Xerox did this already a few years back. And Google does it for their book scanning by projecting a laser grid and determining the 3d surface curvature of the book.
Re: (Score:1)
Re: (Score:2)
Can't? We not?
The scanner itself uses a linear sensor that travels down one axis. Is there any compelling reason why the grid couldn't be projected similarly, one slice at a time, as the scanner moves?
Cuz, I mean: If the scanner can't see the whole grid at the same time, then there's no reason for it to all be present at the same time.
Re: (Score:1, Interesting)
Atiz makes consumer (simple, cheap) and professional (more options, expensive) software to do this, and they also sell the hardware (though you can just use a scanner or camera+tripod).
It actually works pretty well. The only caveat is that you must frame the photos to meet their specifications (e.g. need a solid background border around the book being photographed). It is also pretty slow to process several hundred pages...
http://snapter.atiz.com
http://www.atiz.com/
Re:Book valley detection (Score:4, Informative)
Just package that which Google has patented...
http://hurstassociates.blogspot.com/2009/05/article-patent-reveals-googles-book.html [blogspot.com]
Re: (Score:2)
But, but, but... that would ruin my collection of photos of the valleys of female cleavage and buttocks!
Re: (Score:2)
Why female?
Re: (Score:2)
Ummmm... because I'm not?
Old Idea Rediscovered by HP (Score:2)
Applied Science Fiction was the first company to successfully market this as a 'dust and scratches' solution.
Same idea, taken to a new level. Now, I hope HP's management is smart enough to get out of the way and bring this to market. It should definitely sell a few more scanners.
Lawsuit! I smell lawsuit! (Score:1)
Quoting a certain Francis Ford Coppola flick -- "I love the smell of (lawsuits) in the morning. You know, one time we had a (HP sued), (logging untold number of billable hours.) When it was all over, I (finally looked) up (the pate
Uses of multiple light sources (Score:5, Informative)
Multiple light sources offer some interesting options. A few years ago, someone modified a digital camera (I think a Canon PowerShot) to have four flash sources instead of the usual one. The camera would take four pictures in quick succession, one with each flash. This allowed better edge detection.
It was useful for applications like taking a picture of complex, dirty machinery (as under a car hood) and locating the edges, even where everything was roughly the same shade. It also helped when photographing very shiny objects, where the reflection from the flash was a problem. With each reflection from each flash unit in a different place, all reflections could be removed.
It was too specialized to become mainstream, though. That seems to be the fate of 3D from 2D systems. Good ones have been built [canoma.com], but most have been either discontinued or turned into very expensive products for specialized use.
Re: (Score:2, Interesting)
There will soon be much less need for 3D from 2D hacks, because there's a new technology coming that produces 3D pictures directly: Time-of-flight cameras [wikipedia.org]. Today they are really expensive but they're going to become much cheaper very soon. This is what XBox's Project Natal is based on.
Re: (Score:1)
Our particular aim was automating detection and classification of small bombs in natural scenes. Th
This is all so ironic (Score:3, Funny)
since it will restore the upskirt I took of Carly Fiorina that I accidentally creased.
Re: (Score:1, Funny)
I don't think that's a crease - women naturally have that.
Re: (Score:1)
That gives me an interesting thought. Will this be able to remove simple wrinkles in people's skin?
I.e. you scan a picture of your grandmother, and all her wrinkles disappear?
Re: (Score:1)
Re: (Score:3, Funny)
Re: accidentally creased (Score:2)
Aw, c'mon, admit it: the crease was deliberate because you were trying to spare your eyes and sanity!
Other restoration applications? (Score:2)
I don't have any creased photos that I need to restore, but I've got boxes of matte finish prints that are a pain to scan. I wonder if a similar technique couldn't be used to automatically remove the scanning artifacts (little regularly-spaced crescent moon shapes) from those.
Turn it (Score:1)
And exactly who gets this new feature...? (Score:2)
Do you suppose HP will be nice consumer-friendly guys and update their PrecisionScan software for previous scanner models? Nope: they'll roll this feature into software that'll only work with new scanners they wanna sell you. So, even though it doesn't REQUIRE new hardware, you can bet they'll figure out how to restrict it so that you still have to buy new hardware in order to use it.
Re: (Score:2)
Were you not paying attention? It isn't "part of a product line". It isn't tied to specific hardware at all. It's applicable to virtually any/every scanner. How exactly do you conclude that it's "part of a product line"? I never said nor even implied that HP should give it away: people would gladly pay to buy software with this new technology FOR THEIR EXISTING SCANNERS. Those people would include me.
I used the word "restrict" because I conclude that's exactly what HP is going to do with it. HP won't
And our local hotel ... (Score:2)
.. would like to patent the concept of removing the creases from a newspaper by ironing it under a dry towel.
Seriously? JPEG? (Score:1)
I'm not sure if artifacts and compression are much better than just leaving the crease in the image...
Re: (Score:2)
Yeah, I was wondering about that too. Really, there is no good excuse to not be using PNG these days.
Re: (Score:2)
Re: (Score:2)
PNG is lossless but compressed, whereas JPG is lossy and compressed. Apparently these devices arn't already using RAW, PSD, or DNG but rather opting for JPG. If you're going to use a more "common" format like that, it should at least be something that's not nearly so shitty.
Re: (Score:2)
PNG is lossless but compressed
So is TIFF, plus it has more features than PNG. So, why would I use PNG over TIFF?
If you're going to use a more "common" format like that, it should at least be something that's not nearly so shitty.
What do you mean by "these devices"? A scanner doesn't deliver a JPEG to the computer - it delivers raw data. It's up to the software to save the file in whatever format it supports. And I don't believe I've ever come across scanning software that doesn't support formats other than JPEG, they usually support TIFF and BMP at the very least.
Anyway, JPEG isn't so bad. The compression ratio is excellent, and at higher quality sett
[yawn] (Score:2)
Re: (Score:2)
Re: [yawn] - followed by even more yawning ... (Score:2)
Re: (Score:2)
Doesn't restore photographs (Score:2, Flamebait)
As a practitioner of traditional photography, I'm annoyed to no end by people who talk as if the concepts of "photograph" and "image" were one and the same. Photographs are unique physical objects that have mass. Speaking as if photographs are
Re: (Score:3, Interesting)
As a practitioner of traditional photography, I'm annoyed to no end by people who talk as if the concepts of "photograph" and "image" were one and the same. Photographs are unique physical objects that have mass. Speaking as if photographs are digital images is like speaking as if symphonies are .mp3 files.
That's stupid. A traditional print is made from a negative or slide, so by your purist philosophy, restoring the print isn't actually restoring "the photograph." Digital images are photographs and vice versa. What matters is the image, not the medium it is presented on.
Your idea of the photograph would be considered silly and outdated by the photographers of 50 years ago.
Re: (Score:2)
""A traditional print is made from a
Re: (Score:2)
...if an object itself carries an image that was literally drawn with light, that object is a photograph.
But why does a photograph have to be an object? Where in the definition and practical use of the term is this specified?
Furthermore, why does an object have to be physical? There is such a thing as a digital object.
Digital images are not photographs any more than drawings or paintings or reflections in mirrors or many other kinds of images are photographs.
Nonsense. An image in a mirror or a telescope is not a photograph, because it is not fixed, or recorded. A digital photograph is a photograph, because it is a fixed or recorded image. Put a digital sensor on that telescope, and you can make a photograph.
Is an article published in an online journ
Re: (Score:2)
The GP has a point; in a technical discussion, it makes sense to draw a distinction between the image and the medium it's recorded on.
That's why we use the terms "print" and "negative" for the medium it is carried on. The term "photograph" refers to any image that is the result of a photographic process. It does not refer to the medium used to view it.
The article talks about 'restoring' the image of a creased photo, not restoring a creased photo.
Substitute the word "print" for "photo" and you have a correct answer.
Re: (Score:3, Insightful)
P.S:
I probably shouldn't have used the term "purist philosophy" to describe your attitude towards photography in my previous post. Because it is neither pure or philosophy. A more apt description would be "nostalgic shortsightedness" or "ludditism."
The word "photography" at its root, means painting, drawing or writing with light. And "light" is really the key theme, the other root of the word describing "capturing" the light more than anything else. A digital image displayed on a screen that is never printe
Re: (Score:2)
Re: (Score:2)
Digital imaging is superior to photographic imaging in countless ways that I shouldn't have to mention; that's why photography is obsolete and digital is taking over everything commercially.
Photography is obsolete? Since when? Digital imaging is photography. Photography is more relevant than ever.
Doesn't change the fact that a digital image is not a photograph. You can print a digital image out photographically and obtain a photograph, but that doesn't make the digital image a photograph.
Where the hell do you get this idea from that a photograph has to be printed on paper? Digital imaging is a photographic process. Nothing about the definition requires the light-sensitive medium to be chemical.
You can can take a lens and some light-sensitive material and obtain a photograph of the Grand Canyon photographically; that does not make the Grand Canyon a "photograph".
What the hell? When did anyone ever say that taking a photograph of an object makes the object itself a photograph?
Your assertion that photographs and images are the same thing is groundless and nonsensical.
No, your assertion that a digital image is not a photograph is groundless and n
Re: (Score:2)
No you don't understand the difference between a photograph and an image, because your comprehension of the English language is flawed.
Re: (Score:2)
They most definitely are not, or would you not call a drawing an image?
Yes. A drawing is a subset of the term "image." A photograph and a drawing are both images. A photograph is an image created by photographic processes (i.e - response to light).
Is drawing on a computer with a Wacom tablet somehow not drawing because it doesn't involve pencil and paper?
A photograph is an object that *carries* an image; a medium.
No, a photograph is the image, or at least a version of it. Even if you insist on it being an object, there's no reason it has to be a physical object. A digital object performs the task just as well.
he's merely drawing a semantic difference between a photograph and an image on one hand, and chemical and digital photography on the other.
It's a semantic difference
HP engineers, here is the next man-size problem! (Score:2)
There are several tools, but they are using technique of analyzing colors and by this detecting borders on an item. It does not work with every image, more correctly it does not work with almost every image. It sometimes work if an item is, say, of even dark color on a white background.
We are always shooting the same items: bottles, boxes, can
Not automatic... (Score:2)
Quite so... (Score:3, Interesting)
From the examples shown in the .PDF [hp.com] it seems that it is once again a case of a quick fix that only works on low-res and low detail photos, preferably in single color.
And for it to work at all, you would need a 2-lamp scanner.
Which are standard, but in high-quality print studios and other places that would do this kind of retouching by hand anyway in order to preserve or achieve better quality of the final product.
Re:Quite so... (Score:5, Insightful)
From the examples shown in the .PDF [hp.com] it seems that it is once again a case of a quick fix that only works on low-res and low detail photos, preferably in single color.
That doesn't seem like a terribly bad thing to me. If you were a professional looking for extremely high-quality results, then yes, you're going to want to spend a lot of time screwing around with things manually on each photo. Even if it's a largely automatic procedure, you'll probably still want to tweak the parameters a little for each photo, including things like brightness, contrast, and hue.
However, there's another real-world application for this sort of thing: someone like my grandmother scanning lots of old pictures that may have been folded, crumpled, or otherwise damaged. Even if it's not giving the highest quality results, if the results are at all better than not processing the photo, then it's probably fine. Without automatic quick fixes, people might either scan it and leave the damage, or decide not to scan it at all. Giving even barely passable results is an improvement.
Re: (Score:2)
However, there's another real-world application for this sort of thing: someone like my grandmother scanning lots of old pictures that may have been folded, crumpled, or otherwise damaged. Even if it's not giving the highest quality results, if the results are at all better than not processing the photo, then it's probably fine. Without automatic quick fixes, people might either scan it and leave the damage, or decide not to scan it at all. Giving even barely passable results is an improvement.
First off, I would NEVER advise senior citizens and other people born decades before the invention of the term DTP and/or computers becoming a common household item, to do ANYTHING with photos other than store them in albums.
Unless they have at least some elementary professional experience in dealing with photography I would most certainly advise them to contact a professional or their teenage grandson to do any digital task involving family or other memories in photographic format for them.
Not only do the
Re: (Score:2)
First off, I would NEVER advise senior citizens and other people born decades before the invention of the term DTP and/or computers becoming a common household item, to do ANYTHING with photos other than store them in albums.
Well both my mother and grandmother scan family photos sometimes. They do it both for storage/archival purposes (but the archive is only for personal/family use), but also so they can email them around and things like that. They're not computer geniuses, but they're smart enough to use a scanner and even do some basic adjustments in Photoshop once they're digital. They're not going to contact a professional photographer just to scan some family photos.
Right now, if they scan something with some kind of
Re: (Score:2)
They're not going to contact a professional photographer just to scan some family photos.
That is why I said "contact a professional or their teenage grandson".
scanner being sold 5 years from now
And that is why I said "at this point".
But I have a feeling that 5 years from now something like "crease-fix" will be laughable.
Although, I doubt that it will be this particular way of implementation. Multiple lamps can only make scanners more expensive.
Maybe something along the lines of doing multiple scans while rotating the photo to get the similar effect?
Re: (Score:2)
They're not going to contact a professional photographer just to scan some family photos.
That is why I said "contact a professional or their teenage grandson".
But my point is that they scan things by themselves right now, already. They don't have any teenage sons or grandsons left, either.
But I have a feeling that 5 years from now something like "crease-fix" will be laughable. Although, I doubt that it will be this particular way of implementation. Multiple lamps can only make scanners more expensive. Maybe something along the lines of doing multiple scans while rotating the photo to get the similar effect?
Rotating the picture seems too complicated, and too much work. How much more expensive would two lamps be? What, you have to add another lightbulb? It might not even need to be bright in order to allow the computer to determine depth. Maybe a small LED mounted somewhere would do the job.
I don't know if this particular approach to this particular problem will be used in any
Re: (Score:2)
Actually...
After reading through the PDF, I've found that they did that exact thing in one method - manually rotating images to get multiple angle scans of the same source.
That method actually gives better results, as it covers the "perfectly aligned defects" better.
On the other hand - they ARE in fact already putting a second lamp in some cheap(ish) scanners in order to increase the scanner's gamut - but the procedure does require multiple passes, first with one lamp then with the other.
"Just a small LED"
Re: (Score:2)
My interpretation is different from that:
EVERY bitmap image in the PDF is low-res and lousy in exactly the same way. This is an indicator of what DPI settings were used within Adobe Acrobat when creating the PDF, and not in any way telling of the quality of the original example photos.
Re: (Score:2)
Observe the bitmaps closely and you will see the places where they were "fixed".
The fact that it is not visible right away in the low-res photos shown in the PDF, directly indicates that said corrections would be more visible had the photos been of higher resolution.
Also, examples show the following:
- Girls: crease over single color surfaces.
- Man leaning on a tree: black and white photo turned sepia.
- Woman portrait: crease over single color surface.
- Torn photo of a boy: black and white photo turned sepia
Re: (Score:2)
Do you expect perfection? Cuz, I mean: We're a long way from CSI's enhance button.
Re: (Score:2)
Expect perfection? I DEMAND IT!!!
Re: (Score:3, Informative)
Which are standard, but in high-quality print studios and other places that would do this kind of retouching by hand anyway in order to preserve or achieve better quality of the final product.
Actually, most images are restored using digital techniques these days, because it can achieve better results than doing it by hand. You'd only do it by hand if you were talking about something like a historical artifact or unique artwork.
Let me guess... a member of the Literary club? (Score:2)
Which would explain the literal approach to the term "by hand"?*
Pray tell - how would one use a scanner (mentioned in the sentence above the one you quoted) in the "restoration by hand" that you envision?
As a work surface that you can put your brushes and chemicals on?
Correction - The Chudnovsky Brothers: Prior Art? (Score:1)
Make that the Unicorn tapestries [newyorker.com]
Repatently,
KT
Re: (Score:1)
reconstructed the warped the Unicorn tapestries [youtube.com] circa 2003.
Patently Yours, Kilgore Trout
We've been leafrolled!
Re: (Score:2, Funny)