Computer Vision Tech Grabs Humans In Real-Time 3D 110
Tinkle writes "Toshiba's R&D Labs in Cambridge, UK have developed a system capable of real-time 3D modeling of the human face and body — using a simple set of three different colored lights. Simple it may be, but the results are impressive. Commercial applications for computer vision technology look set to be huge — according professor Roberto Cipolla. On the horizon: cheap and easy digitized everyday objects for ecommerce, plus gesture-based interfaces — a la Natal — and in-car safety systems. Ultimately even driver-less cars. 'This is going to be the decade of computer vision,' predicts Cipolla."
Re:Colors (Score:4, Informative)
You'd need a custom CCD that's sensitive to each of those frequencies, as well as method of storing the image preserving the intensities of each component. And if you want a color full-motion 3D model, that CCD would need to be sensitive to six frequencies--the 3D sampling set and RGB--all at once. To fit all those different sensors will enlarge your CCD, else you'll lose resolution.
Re:The obligatory response: (Score:4, Informative)
This is how the Martians see us.
Overrated? You're making me feel old, and I wasn't even born yet.
It's a reference to the RGB eyes of the Martians in the 1953 movie version of The War of the Worlds. The tri-segmented eyes in the movie emitted red, green, and blue light, illuminating the subject, allowing the cyclopian Martians to see in 3D, just like how a cyclopian camera can derive 3D information using this method now. Otherwise, as depicted with Futurama's Leela, a cyclops would have no depth perception.
Of course, the amount of depth perception would depend on the spread of the lights, so even the Martians' sense of depth would be limited, but not non-existent.
Re:Obvious applications in rapid prototyping. (Score:3, Informative)
The whole point of this, would be so that the lights could appear white to the human eye (And hence can double for normal lighting in a well designed room), while still providing the segmented colors necessary for this technique to work.
The positions you need to put the colored lights in for the math to work properly are not the same positions one uses to properly light a subject being recorded. You'll produce an environment where the subject is overly lit and you'll have to resort to virtual lighting to properly illuminate the 3D model in post. And if you're going to have to do it in post, why bother with the expensive strobing and high-speed videography?
This will be used in a controlled mocap-like environment, but without the ping-pong balls and spandex. That alone is enough of a technical advancement that your talent won't mind the colored lights. They won't even need to apply makeup. Hairstyling though looks to still be an issue. You may need skullcaps and CG hair for awhile yet.