Cell Phone with Camera = Scanner 237
An anonymous reader writes "TechJapan has posted a translation of an Impress Watch Article regarding a new technology developed by NEC and the Nara Institute of Science and Technology, that lets people use their cellular phones with cameras as scanners. It says all you have to do is move your phone over the surface of the piece of paper while recording a movie, and the technology (some sort of software I presume) will construct a high resolution image from the individual frames of the video.
Here is the original (Japanese) NEC press release." I'd love to see before and afters to see how well this works.
that's great but... (Score:5, Funny)
Re:that's great but... (Score:5, Insightful)
Re:that's great but... (Score:3, Informative)
Lots of friends have camera phones. I have a camera for taking pictures. Unlike these phones, it captures more than 1 megapixel. When I need to take pictures, I carry it with me.
Re:that's great but... (Score:2)
Re:that's great but... (Score:3, Informative)
--trb
Re:that's great but... (Score:5, Funny)
Re:that's great but... (Score:2)
I know, I don't know what they're talking about, though. I routinely go 2-3 days without charging and with moderate use; my phone hasn't run out of juice yet.
cellphones are almost all available for free, depending on the plan
So are ours, but we also typically get locked into a 1-2 year plan when we buy phones. In my case, I lost my phone 6 months into the plan and didn't have a warranty on it, so I had to replace it. All the prices you see on the Veri [verizonwireless.com]
You don't understand Japan (Score:3, Insightful)
Re:that's great but... (Score:5, Insightful)
I seriously doubt that you are *overpaying* for features.
Compare the situation to PC hard drives: You can get a 120GB HD for something like $80. That's like $0.67/GB. By that logic, if you only wanted a new 10GB HD, you should be able to get one for $7, right? But you can't. There's about a $30-35 minimum outlay for a harddrive. Once manufacturers have the basics in place, adding extra/bigger platters in almost *free.*
Near about the same thing with phones. You can probably get a barebones, does nothing but make calls and store numbers cell phone for about $75. But since all the electronic components are already there, they can easily add in a gazillion sotware features for very little $$ and charge $100 for it, which they vast majority of people will pay for.
Re:that's great but... (Score:2)
Okay--that's not how designers are thinking. The problem with phone design is that most people's hands are within a certian range of sizes. The same is (mostly) true with the size of people's heads. A phone just has to be comfortable for its use, and while there are
The significant word is AND (Score:2)
So you want it to remember phone numbers. How about some function so that you can add a small note to each entry? Like who that person is? How about an alternative number if they can't be reached on that one?
Soon you have a complete agenda. All its function perfectly reasonable to the people that use t
Re:that's great but... (Score:2)
it has come to the point where you pay a bit less because you don't want extra features and the manufacturer intentionally limits the functionality already in the device(this has been partly the case in videos, tv's and other devices for _years_. the functionality is in there because of manufacturing reasons but you didn't pay to activate it. like the cruise speed controls in modern cars, the functional
Re:that's great but... (Score:2)
Re:that's great but... (Score:2)
Unfortunatly, it's very hard to test how good the radio is in the store, and no manufacturer seems to advertise the radio features at all. What good a 320x240 full color screen and web browsing capabilities if the signal strength goes to 0 when you walk inside?
Re:that's great but... (Score:2)
Unfortunately, nobody offers a phone that I want. Certainly nothing better than the phone I bought 5 years ago.
It may be a niche market, but I'm a customer actively looking to spend money, but nobody wants to sell to me.
And I wonder when... (Score:2, Funny)
Re:And I wonder when... (Score:5, Funny)
Re:And I wonder when... (Score:3, Funny)
Scanner - Camera = Cell Phone?
I can make calls from my scanner, unless I have a camera.
Ocr? (Score:4, Insightful)
Re:Ocr? (Score:5, Insightful)
Re:Ocr? (Score:5, Insightful)
Re:Ocr? (Score:4, Informative)
I'm not kidding - there are Japanese OCR apps, but the accuracy is way below English OCR unless you're using a really good page image.
Re:Ocr? (Score:3, Interesting)
This has other uses... I've thought about it before. Like shooting panoramas. Stick the camera in the air... push the button and rotate.
Voila.. panorama!
Re:Ocr? (Score:5, Interesting)
In Japanese there are fewer symbols per word, many more symbols to choose from, and symbols that contain much more detail.
So I would think OCR in Japanese would be many times more difficult than OCR in english.
Finally, you now have a phone that is only useful for scanning Japanese. If it acted like a real scanner then it would be useful for any language.
Dan East
Re:Ocr? (Score:2)
Re:Ocr? (Score:3, Interesting)
You basically have to figure out where each lo-res picture goes and place it into the hi-res document. If you are careful, you can place several overlapping pictures with sub-(lo-res)-pixel accuracy, letting you increase the resolution even more. You use the fact that you have high accuracy in the time domain to h
Old tech (Score:5, Insightful)
This is probably just a combination of that technology (which never took off here) and the cell phone feature craze.
Re:Old tech (Score:3, Informative)
However, c-pen takes this one step further and does OCR on it internally resulting in text only output.
I know they have tried to sell in their technology to mobile phone manufacturers, seeing great opportunities in the built-in cameras, though I suspect NEC could do it in software anyway and C-pen since has had better success with bluetoot [anoto.com]
Here's the text of the article (Score:4, Informative)
NEC and the Nara Institute of Science and Technology have devloped technology which uses movie recordings to produce high quality images, on par with those of a scanner. This technology will be aimed atcellular phones and video cameras.
The technique involves recording a part of the subject to a movie, while moving the camera; the "Mosaicing Technology" analyzes the moving image and estimates the three-dimensional position of the subject, and under the supervision of the "Ultra Resolution Technology," the joining points of the image are deleted, thereby optimizing it so that even low resolution cameras can produce scanner like output. In other words, even cellular phones and video cameras can produce high quality images.
Up until now, there were certain cameras that contained equipment to turn low quality images into high quality ones, but this technology marks the first time that this sort of technique can be accomplished with existing equipment. For example, a high quality image can be produced of an A4 size sheet of paper from video cameras currently on the market.
Inspired by:
http://k-tai.impress.co.jp/cda/article/news_
News Release:
http://www.nec.co.jp/press/ja/0402/2303
Re:Here's the text of the article (Score:5, Interesting)
Re:Here's the text of the article (Score:2)
Re:Here's the text of the article (Score:2)
Re:Here's the text of the article (Score:2)
For the still case, look into the medical imaging litterature: under image registration.
Re:Here's the text of the article (Score:3, Informative)
Re:Here's the text of the article (Score:3, Informative)
Re:Here's the text of the article (Score:3, Interesting)
Until it becomes part of one of the iApps on a Mac I doubt it will be at all intuitive to use - so it wont be!
My dream application of this kind of thing? Pan around with a video camera semi randomly within a scene for an arbitrary period of time and have a bit of software capture this and 3D model the scene so you can walk about in there with very high resolutions. Any blind spots could later be refined with new video
Re:Here's the text of the article (Score:2)
Re:Here's the text of the article (Score:4, Interesting)
My brain compensated this by applying a continous eye movment (nystagmus). This allow my brain to get several low resolution moving pictures and be able to compute the missing sharpness and details.
Many born visually impaired have this nystagmus as some compensation.
I'am glad this become a mathematically and scientifically analyzed process. This is great it get some practical use. This remind me of the pictur analysis and filtering applyed to Hubble when it was known is main mirror could not focus correctly.
Re:Here's the text of the article (Score:2)
Another possibility -- if you *know* that you're going to be using the camera for video capture, and cost isn't an issue, you can put high-quality accelerometers and other angle and position-locating devices into the thing.
In related news (Score:5, Funny)
Vinyl (Score:2, Funny)
Re:Vinyl (Score:2, Informative)
One way or the other it's coming. (Score:5, Interesting)
And this is where things get interesting because fair use permits compies of material in the library for research. But if enough students scan journals at high resolution and then organize and exchange them through the Net, there will be an enormous levelling of the academic playing field. That is a time I look forward to with eager anticipation.
Re:One way or the other it's coming. (Score:2)
You need no account to search or request help. Much of the material is online, and they'll already scan and send you articles.
See Iliad at http://www.library.tufts.edu
Re:One way or the other it's coming. (Score:2, Insightful)
The article talks about having a single OS ala MS. To see what the cell phone companies are actually doing, see this article [com.com]. As you can see, they want to impose even more DRM on the consumers. And once the DRM has been implemented in the single chip phones, there is virtually nothing you can do about it. One factor is that due to the closed nature of these systems, the cell compa
Virtual Wide Angle Lenses? (Score:5, Interesting)
Stitching multiple images automatically is nothing new but is CPU intensive. So Moore's law will take care of that.
Wouldn't it be fun to watch? (Score:2, Funny)
Problem before? (Score:3, Informative)
Old news (Score:3, Funny)
Security Alert! (Score:5, Interesting)
Take care!
Erick
Re:Security Alert! (Score:2)
--trb
Re:Security Alert! (Score:2)
personal privacy too. (Score:2)
Although countries other than the US generally don't have the same hang-ups about nudity, it would be interesting to know what policies they have regarding cell phone usage and personal privacy.
How is "over the surface" defined? (Score:2, Interesting)
Re:How is "over the surface" defined? (Score:2)
You *did* RTFA, right?
Re:How is "over the surface" defined? (Score:2)
However, I think you're still thinking in terms of making a nice image from stitching together several images. That's not what's going on here.
They're taking several views of the same thing and using them to synthesize a better image of the actual subject. Out of focus, poor resolution, poor contrast - these are factors which the software corrects for.
See, the point is that the cell phone camera doesn't capture the image. The software essentially "creates" the image, based
VideoBrush Whiteboard (Score:4, Interesting)
This software is from the mid to late 90s and unfortunately not available anymore. iPIX purchased the company and discontinued all of its products. There are a few links to buy it but they say it's unavailable and I haven't ever been able to find it on file sharing.
Another interesting program they had is VideoBrush Panorama. It is can only stich vertical and horizontal pans (don't even try zig-zag). It's pretty cool to be able to get panoramas from video pans, and the software is very easy to use. There is no need for a tripod. You can get an evaluation copy here [www.bdp.it]. This [66.98.132.48] and a resource editor might come in handy if you want to use it.
More tools for digital shoplifting? (Score:2, Insightful)
Old handheld scanners... (Score:3, Informative)
I can see why people might want to do this (panoramic photos suddenly springs to mind...), and if I hadn't been surprised by the uptake in camera phones, I might be jumping on the Slashdot bandwagon of "Who'll use it? I want a phone that only makes phone calls! I hate cell phones!!", but camera phones have *seriously* caught on, certainly here in the UK.
Re:Old handheld scanners... (Score:2)
Re:Old handheld scanners... (Score:2)
DoD Security Problems? (Score:3, Interesting)
Imagine if they freaked out over 1Mega Pix cameras because they could take FUZZY pictures of classified docs - This kind of technology will send the DoD over the edge. As it is right now Cell Phones with cameras are prohibited in all classified environments (at least byt the NAVY that I know of).
A Cell Phone with this kind ouf tech could be banned from the ENTIRE base/post/shipyard etc. One of the things that the drill into your brain in the service is that over time a bunch of little bits of unclassigied data can be made into a very informative report that borders on the classified.
Just my 3MegaPix Worth
Re:DoD Security Problems? (Score:2)
It has been a question of mine for a long time what was going to happen when the staffing recognizes a person with a photographic memory. They can essentially reconstruct the same material the photocamera can with time.
The problem is that GSM/CDMA signals should be blocked from all secure locations since they can be used for other
Re:DoD Security Problems? (Score:2)
There is software to achieve much of this. You'd just need to stream video elsewhere.
Frankly, I think it's reasonable to require all personnel in secure areas to leave their cell phones at a holding area, and provide them with special secure internal-use-only phone-type devices while they are within the facility. Cell phones have an increasing range of security issues.
Re:DoD Security Problems? (Score:2)
you'd suppose theyd have made up some rules on regarding them already.
Super-resolution (Score:2)
This is almost certainly using a technique usually called called super-resolution. The basic idea is:
You can read about some of the underlying ideas here [cmu.edu] and here [mit.edu]. It's a pretty cool area of research.
Re:Super-resolution (Score:2)
The CMU work seems similar, but aimed only at facial reconstruction (I only skimmed it, so I don't know whether they use a NN -- would seem reasonable).
The point of the camera sweep approach is that you combine several lores pix to algorithmically extract *higher* spatial resolution than either of the input pix. No guessing.
Re:Super-resolution (Score:2)
How it probably works (Score:2, Interesting)
for each image
fit an affine transform to the last
[this should work easily because
1) the paper is planar
2) the paper and it's background are hopefully different - with nice edges in between
3) the lighting conditions are the same (depending on how you hold the phone)
4) the paper is not moving
each of these tranforms can be applied cumulatively to the future images, though error is reduced by mapping everything to the center imag
Hmm + partial transl of original (Score:2)
(To me this looks like what was documented in Graphica Obscura - projective warping [sgi.com] of multiple photos - by SGI researcher Paul Haeberli. Actually his site has lots of info (I haven't seen code
Re:Hmm + partial transl of original (Score:2)
This is not new (Score:2, Interesting)
I also think this is used on Mars by the MOC team to produce 0.5m resolution images from 1.5m source data.
You can do this with a normal digicam btw, download registax 2 for example. Just take consecutive images of the same static subject, and combine them.
Well, like I said on the latest poll... (Score:2)
(come to think of it, I don't own a scanner either =/)
This is your chance! (Score:2)
Look at Steve Mann's Video Orbits (Score:3, Informative)
You can even get the code from sourceforge [sourceforge.net], although now he seems more interested in his studies into what he calls "Comparametric Toolkit [sourceforge.net]", which seems to mix Video Orbits with software based on the Wyckoff principle [wearcam.org] (how to get high dynamic range pictures from one underexposed pic and one overexposed pic, for those who don't RTFL).
I suppose the amount of processing power in those phonecams must be insane, or maybe the algorithm they use is more generic, but it is good to know all this Moore's Law horsepower applied towards useful stuff, not just Laracroftish games (ducks).
Finally, it is worth of note that, although Mann's software is now GPL (I don't recall it being Free, or even released, last time I checked three years ago), at least one of the algoritms is under US Patent5,706,416 [uspto.gov], which of course is not nice, unless he plans to license it free of charge for GPL software.
Thanks for the good post and question (Score:2)
I notice that Mann's work appears to deal with flat scenes-mobile camera, or stationary camera-arbitrary scene.
Do you know what state-of-the-art in 3d model building is? Is there effective work on arbitrary camera, arbitrary scene?
I know that CMU has a bunch of work that can pull off some of this, but I think that it may be special-cased (i.e. determining the location of the camera using other methods) and may have sensors other than vision (like laser range finders and the like
Re:Look at Steve Mann's Video Orbits (Score:2)
Why a movie? (Score:2)
Works well, and it is cheaper then photocopies.
I think it would be cool to be able to combine images like this.
But I'm not an imaging expert.
I would also like to build 3d models from several photos, not that anyone cares, but I think it would be neat.
In Other News... (Score:3, Funny)
*ducks*
Maybe it is just me? (Score:2, Interesting)
Re:Maybe it is just me? (Score:2)
Can it really simulate a virtual copy stand? (Score:2)
If I just handheld the camera over the page and pushed the button, the page curl prevented the page from being evenly in focus. The lighting was so uneven--even on pages that looked
Is this technology employed by space telescopes? (Score:2)
HP Capshare (Score:2, Informative)
I can't believe nobody's mentioned the HP CapShare.
Link [businessweek.com]
Picture [businessweek.com]
I was doing some consulting for a lawyer in 1999, and he showed me some 'new' HP scanner he just got for some outrageous price. He told me they didn't even have it in the stores/catalogs. It was a very 'James Bond' device, you could swipe it over a large page, and the image was automatically stitched together. You could store/view pages on the scanner, or send them to an HP printer or a laptop via IR. Very cool.
eBay [ebay.com] has a couple of the
So now we know how the tricorder will involve (Score:5, Funny)
That still left the question how the tricorder came into being. Did someone sit down one day and say to himself, "I am going to build myself a tricorder?" That just doesn't seem very likely to me.
But now I finally figured that out too. The tricorder will evolve from the mobile phone! Every year you can see how more and more sensor functionality is added, while the physical size of the phone is getting smaller and smaller. First they could just acquire audio signals. Then came video signals. Soon it will be able to monitor your heartrate, body temperature, and various other vital signs, and maybe even automatically call 911 if you get into trouble. Sensors for electricity, magnetism, seismic waves, spectral analysis, alien energy, and other things will invariably follow, driven as they are by our lust for gadgets, useless functionality, and the latest and greatest. Meanwhile rest assured that ever-increasing software capabilities will provide the ability to make rudimentary medical diagnosis, do chemical analysis, and contain drivers for every alien Bluetooth-enabled device in a thousand lightyears.
While we are at it, you can rest assured that the very moment someone develops a universal translator, it will be embedded in a mobile phone.
So there we have it: the tricorder in a small, handy package. There are only two downsides that I can see: if we are to believe Star Trek, it will at some point lose its communication functionality (Kirk was always using a separate communicator), and based on current trends the battery life may not exceed 2-3 minutes...
Re:So now we know how the tricorder will *evolve* (Score:2)
No examples? (Score:2)
ALE does this and is GPL (Score:3, Interesting)
ALE [dyndns.org] is an open source tool that does this nicely. It is normally intended for turning a large number of images of the same thing into one higher quality image, but when you use the --follow and --extend flags. it can turn a sequence of images from a video into a single larger image.
To quote from their site: ALE is a free software program that renders high-fidelity images of real scenes by aligning and combining many similar images from a camera or scanner. The correct similarity between images is roughly that achieved by a somewhat unsteady hand holding a camera.
Something similar exists for Apple's iSight (Score:3, Interesting)
http://www.chiltonwebb.com/iStill/ [chiltonwebb.com]
Japanese Cell Phones with OCR (Score:2, Interesting)
Iron Eagle (Score:2)
old technology (Score:2)
More scifi come to life (Score:2)
They used to scan those over an object all the time. Ever since that show first came out I've wanted one.
Leave it to the Japanese... (Score:2)
In related news... (Score:3, Funny)
Already been done! (Score:3, Informative)
It's called "Video Orbits," I guess. Originally, it was made to make panoramic stills from video. But it can also do the same thing mentioned in the article, sort of scanner like.
Here's the writeup [wearcam.org] and
you can download it over here [sourceforge.net].
I played with it a bit using the movie function of my digital camera, transfering to computer, then using
mplayer -vo png movie.mov && mogrify -format pnm *png && estcement.pl *pnm
(make sure the binaries and scripts are in your path)
You can play with the $steps= line in estpairwise.pl to change the settings. also, i like to take out the -display in estpairwise.pl, in order to speed things up, otherwise it draws each image on screen as it tries to match them up.
will produce cemented.pnm.
This works both as the article talks about, like a scanner, but it also makes kickass hires panoramic shots from crappy 320x240 video.
Note: turn off automatic brightness/ auto white balance when taking your video, or it make look a little funny.
no idea if any of this stuff works under windows. but it works like a charm under linux.
Re:presumptious (Score:2, Funny)
It just makes a Pres out of U and Me.
No, wait.....
Re:Cannon (Score:4, Insightful)
In theory, you could take a 320x240 movie of the *whole page* at once, moving around, and when the movie got sufficiently long the software would reconstruct a high-res image of the whole page, as in 300 dpi or some such scanner-type resolution.
I realize that this is Slashdot, but you might try RTFA. You won't lose karma for that, I promise.
Re:They'd better have a good lens on the phone... (Score:2)
Re:They'd better have a good lens on the phone... (Score:2)