Stories
Slash Boxes
Comments
typodupeerror delete not in

Comments: 170 +-   Ideas For the Next Generation In Human-Computer Interfaces on Sunday March 08 2009, @01:26PM

Posted by timothy on Sunday March 08 2009, @01:26PM
from the literally-exploding dept.
inputdev
gui
software
technology
Singularity Hub writes "For decades our options for interacting with the digital world have been limited to keyboards, mice, and joysticks. Now with a new generation of exciting new interfaces in the pipeline our interaction with the digital world will be forever changed. Singularity Hub looks at some amazing demonstrations, mostly videos, that showcase new ways of interacting with the digital world." Along similar lines, reader shakuni points out a facial expression-driven user interface reported on News.com for operating, say, an iPhone, explaining "This device is tiny and fits into the ear and measures movements inside the ear due to changes in facial expression and then uses that as input triggers. So [tongue out] starts or stops your iPod Touch; [Wink] rewinds to the last song; and [smile] replays the same song."
story

Related Stories

This discussion has been archived. No new comments can be posted.
The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.
 Full
 Abbreviated
 Hidden
More
Loading... please wait.
  • Ah-Choo! (Score:4, Funny)

    by Something Witty Here (906670) on Sunday March 08 2009, @01:33PM (#27113617)

    And when you sneeze, it reboots!

  • voice control (Score:5, Insightful)

    by Keruo (771880) on Sunday March 08 2009, @01:34PM (#27113623)

    When windows 95 arrived, I played around with its voice recognition.
    I wasnt quite impressed with it, since the only command I got working properly was "fuck" which caused the machine to reboot.

    Although voice control has interesting potential, its not optimal for most situations. (think open cubicle office)

    • If the voice recognition works without the voice...

      I think there was an experiment about that? Like probing the nerve that control the vocal cord, and the last time I read is it could recognize 4-5 distinct states after training. Yes, it's even so far from today's voice recognition, but only by then I will consider actively using it. Otherwise I think I will lost my voice in a few days, not to mention any privacy issue it associates.

    • Re: (Score:3, Insightful)

      Well yeah, but think about it: your brain can differentiante between your boss calling you a useless waste of oxygen from inside his office and the giggles from your coworkers on the outside.

      The aim for technology is, of course, that a microphone can do the same.

      And it makes sense that Windows would understand "Fuck", being the word that it hears the most.
      • Re:voice control (Score:4, Insightful)

        by MBGMorden (803437) on Sunday March 08 2009, @02:59PM (#27114119)

        I don't think that's the only hurdle to overcome. In a lot of cases, I just don't think voice control is very useful beyond a novelty. I played with it a number of years ago. After a bit of training, it was recognizing my commands pretty well. Thing is, it was tedious as hell to do things with voice control. I spent 10x longer doing things simply for the novelty to doing it using voice commands.

        Seriously: for people who have ever done tech support this should be obvious: even with a human - whose reasoning skills are superior to the best voice recognition system out there, if I am standing there telling them what to do in order to perform an action on the computer, it takes all of 1 minutes before I'm asking them "You know, how about let me sit there for a second and I'll take care of it." (a nicer version of the "MOVE!" part from Jimmy Fallon's Nick Burns - The Company Computer Guy skit from SNL). Most of us can simply do things much faster with our hands than we can explain them.

        Now, if we could truly step into the realm of Star Trek and have virtual AI running the computer - then it might have some application (ie, "Computer - pull up a list of hotels in Miami on Labor Day weekend"). Otherwise, simply as a replacement input device, no matter how good it gets at recognizing commands I just don't see the use.

        • Re:voice control (Score:5, Interesting)

          by ShieldW0lf (601553) on Sunday March 08 2009, @03:47PM (#27114385) Journal
          I don't think that's the only hurdle to overcome. In a lot of cases, I just don't think voice control is very useful beyond a novelty. I played with it a number of years ago. After a bit of training, it was recognizing my commands pretty well. Thing is, it was tedious as hell to do things with voice control. I spent 10x longer doing things simply for the novelty to doing it using voice commands.

          I feel the same way about it. But my brother swears by it... he can have his hands full of scientific equipment and still issue commands to his computer which is interfacing with the tools he's using.

          I could see this sort of tech being really useful for those who wish to access reference materials while their hands are full too... be it doctors who have their hands covered in blood switching to a different monitor or mechanics who have their hands covered in grease switching to a different schematic.

          Personally, some days I'd give my left nut for a good heads up display and a glove with an integrated chording keyboard and touch pad. If I could do my work lying on my back instead of sitting in this chair, I probably wouldn't have to go to the chiropractor.
          • Re:voice control (Score:4, Interesting)

            by evilad (87480) on Sunday March 08 2009, @09:38PM (#27117101)

            Try a stand-up workstation. I improvised one out of some metro shelving and it did wonders for my back.

            For extra points and core-strength exercises, stand on a balance cushion while using it.

    • Back when Mac OS 9 had kind-of-sort-of voice control, you could launch programs by putting them in a specific folder. I made an alias for "Unreal" -- which took up 190 MB of RAM and took about 3 minutes to load on my PM 7500. Whenever someone would come over my dorm room to use my computer, I made a point of mentioning very loudly how something was "UNREAL!" -- and then they got to sit there while 'Unreal' loaded, very, very slowly.

    • by Hatta (162192) on Sunday March 08 2009, @02:32PM (#27113951) Journal

      I wasnt quite impressed with it, since the only command I got working properly was "fuck" which caused the machine to reboot.

      Are you sure you have the causation straight on that one? When I used Windows 95, it was the other way around.

    • Re: (Score:3, Insightful)

      Current generations of voice control are quite good and usable. It always seemed that voice control was central to human interface with computers in scifi visions of the future. Star trek and such, nobody ever interacts with the computers aside from asking them to do something. Other visions of the future always had voice control to turn up or down the temperature of a room and do other such things.

      That kind of thing is now entirely doable and entirely affordable with only nominal hardware. The a
    • which caused the machine to reboot.

      But with Windows 95, what didn't? ;)

      I think I could have duplicated that effect without even a microphone. (Though whether the "fuck" would be the cause or effect of the reboot is another matter.)

      • I blamed Win95's poor vice control for making me smoke, but when I talked to lawyers about a class action suit, they said I was just blowing smoke up their ass.

  • by Bovius (1243040) on Sunday March 08 2009, @01:34PM (#27113633)

    Seems like there are some other practical interface options for the iPod.

    * Snoring: stop playing music
    * Gagging: remove song from playlist
    * Startled jump, clenched jaw and frantic grasping at earbuds: reduce volume

  • by Tokerat (150341) on Sunday March 08 2009, @01:36PM (#27113639) Journal

    I can see useful applications for this, but I hope there is a switch I have to depress while I make the gesture, plus a "hold" switch so I can lock gestures on or off at all times. For example, if I catch my wife cheating and I look stunned, I don't want that to accidentally to push the "panic" button on my car alarm so my nosy neighbor starts poking around during the ensuing drama. That would certainly be a small and silly example of this technology making life more difficult instead of better.

    ...not that I'd ever be able to get a wife (let alone a girlfriend), but at least I made a good car analogy ;-)

    • Well, if you do get a wife, let me know, because if you consider finding her sleeping around to be a small and silly example, I am definitely going to want to 'meet' her. ;)
    • Re: (Score:2, Insightful)

      by Anonymous Coward

      A facial expression driven interface is an absurd idea for the vast majority of users. People's hands are wired to move and manipulate objects. That is why our hands are so effective as "human output devices". Our facial expressions are tied to our emotions. Even if we can get around the weirdness of detaching smiles from happiness and winks from flirtation and so on, there's still the problem that doing that kind of stuff physically feels awkward if it has no emotional content behind it.

    • "...not that I'd ever be able to get a wife (let alone a girlfriend), but at least I made a good car analogy ;-)"

      With your sense of humor, it would be a pity if you don't :)

  • "This device is tiny and fits into the ear and measures movements inside the ear due to changes in facial expression and then uses that as input triggers. So [tongue out] starts or stops your iPod Touch; [Wink] rewinds to the last song; and [smile] replays the same song."

    Sneeze a few times, and you just sent an email to your boss calling him a fat ignorant pig

    Get the hiccups, and your car repeated accelerates and brakes, causing multiple accidents..

    And the world ends when the president, grimacing whil

  • by PPH (736903) on Sunday March 08 2009, @01:40PM (#27113669)
    I still think that people using BlueTooth headsets look like they're off their meds, walking down the street, talking to themselves. This'll open up whole new Vistas of crazy-looking people. Is he having a seizure or just skipping through his iPod's playlist?
    • . . . will probably make folks look worse than a botched Botox job. I guess the device will come with a warning and legal disclaimer: "If you can no longer hold your eyelid open, discontinue the winking process."

      • Re: (Score:2, Informative)

        The people walking down the street talking via bluetooth seem odd to you because they prefer the conversation with a distant person to dealing with you. If your need for attention weren't so acute this wouldn't bother you at all.

        That is quite an assumption.

        Perhaps it is because you can't tell if they are talking or a person or to themselves unless you see the headset. You know, crazy people talk to themselves. And other people tend to stay away from them, since they are relatively unpredictable.

        • Re: (Score:3, Informative)

          Recently I noticed just how much the Bluetooth headset has changed the way we perceive people.
          I rode a tram, and heard a girl near me giggle. She was looking outside, speaking softly, giggling from time to time. Naturally, I'd assumed she was talking to someone via Bluetooth.
          Boy, was I wrong. I don't know what was making her giggle, and who she was talking to, but there was no mobile phone or any of its possible accessories in sight.

          The mere fact her being crazy was not the first thing that crossed my min

        • The people walking down the street talking via bluetooth seem odd to you because they prefer the conversation with a distant person to dealing with you. If your need for attention weren't so acute this wouldn't bother you at all.

          That is quite an assumption.

          Perhaps it is because you can't tell if they are talking or a person or to themselves unless you see the headset. You know, crazy people talk to themselves. And other people tend to stay away from them, since they are relatively unpredictable.

          Sorry

      • Re: (Score:3, Interesting)

        The people walking down the street talking via bluetooth seem odd to you because they prefer the conversation with a distant person to dealing with you. If your need for attention weren't so acute this wouldn't bother you at all.

        No, they look odd because they look like they are talking to themselves or an invisible friend. This "poke your tongue out" iPod interface would be even worse. Ever seen tardive dyskinesia [youtube.com]? That's what people are going to look like trying to select the right playlist on their
  • I want the Cylon water interface (for my toaster, obviously), but this is the closest thing I can find:

    http://www.technovelgy.com/ct/Science-Fiction-News.asp?NewsNum=1650 [technovelgy.com]

  • There is a simple reason for that, it requires learning.

    I've given this some thought, and there are several basic problems that need to be overcome with the current computer/human interface:

    1 - It is not intuitive, no matter how much we as a society now accept as normal for computers

    2 - computers require a special lexicon to communicate with.

    3 - computers do not fix themselves: if you have a maid/servant it's ok if they are ill for a couple of days, but if you have to be the doctor too, it doesn't work well

    • > if you have a maid/servant it's ok if they are ill for a couple of days,

      Good example! That ought to represent about .000002% of all slashdotters.

  • by Joce640k (829181) on Sunday March 08 2009, @01:54PM (#27113745) Homepage

    We'll all have to sit infuriatingly still if we want to listen to some music.

  • So [tongue out] starts or stops your iPod Touch

    Wouldn't that be an iPod lick?

    It would also make listening to KISS and singing along as Gene pretty much impossible.

  • Control via thought patterns.

    They already have animals controlling robot arms with their thoughts.

    When you think of say a "pink fried tapir" it will produce a distinct thought pattern.

    1) Get a "super PDA" sort of stuff hooked up to look for your thought patterns.
    2) Think up a really unique thought pattern to get the computer to "start listening"
    3) Think up a really unique thought pattern to get the computer to "stop listening"
    4) Think up various distinct thought patterns and link them with various PDA actio
  • Just got back from CeBIT, tried out an eye tracking device made by Tobii [tobii.com]. I guess the technology has been around for a while now (the girl at the stand said they've been in business since 2003 I think) but I've never had a chance to try it out myself. Very, very impressive.

    Basically you control the mouse pointer with just your eyes. The calibration is dead simple, you just need to look at two corners of your screen and that's it. The accuracy of the device amazed me completely. The sentiment is perhaps best

  • And it gets ever harder to tell people who are crazy from those who are using modern technology...

    Talking to themself? They might be crazy... or maybe they have a really well-hidden cellphone. Weird facial expressions that don't appear to relate to the environment? Crazy... or thinking about philosophy, or one of these.

    Now we need to get close enough to see if they smell funny ... and some geeks smell funny anyhow. :(

  • by rAiNsT0rm (877553) on Sunday March 08 2009, @02:53PM (#27114085) Homepage

    Everyone is close but just missing the boat in my opinion. Touch is the way to go but NOT directly on the display screen. A second screen (similar to the dual screened OLPC concept, or a Nintendo DS) that can be customized by each app or else function as a standard pointer/multi-touch input. It has to be essentially a full-on touchscreen display with full color and solid refresh rate.

    This would spur all kinds of new interactions, games, and input.

          • Re: (Score:3, Interesting)

            Haptic feedback is actually what you are contending, and it is coming and very possible. I have seen one implementation that easily has as much travel as the current Macbook/Apple keyboards.

            Basically you can still have a regular keyboard but you would also have a Wacom like tablet that is a programmable screen for input as well, and on laptops there would be no keyboard or touchpad, just a second large screen field with proper haptic feedback.

            It will be a major paradigm shift, and there will be many (possib

  • Blue sky (Score:4, Insightful)

    by YourExperiment (1081089) on Sunday March 08 2009, @03:09PM (#27114183)

    While it's great that all this research into potential future interfaces is being done, a lot of them are terribly impractical. I just wish we could get the simple things right with our present day interfaces.

    How about a jog wheel / thumb wheel that actually allowed different speeds of movement (i.e. true analog) instead of being just a disguised rocker switch? How about a mouse wheel that didn't force me to move slowly through documents a line at a time, but instead had the same capability for fast and slow movement as the mouse sensor itself?

    These are things that would actually be useful now, and are simple to implement with current technology. Perhaps companies could get these right today, in addition to investing in all this blue sky research.

  • by Anonymous Coward on Sunday March 08 2009, @03:57PM (#27114457)

    And no mention of graphics tablets, which have been available from retailers as long as the mouse. I admit these weren't too popular until the Wacom units were combined with Photoshop in the 90s, but people did buy and try the Koala pads. MIDI has been a significant input device group too. Touchpads are also left out. Stylus interfaces like Newton and Palm... geeze, the list goes on.

    Singularity Hub doesn't sound like much of an authority. Thanks for the heads-up Timothy, but a self-submitted shallow adver-blog like that is what makes for accusations of slashvertisement. Better to have specific interface news posts run on, well, Slashdot.

    (No mention of the Powerglove? I mean where's the love?)

  • by stoicio (710327) on Sunday March 08 2009, @04:02PM (#27114493) Homepage Journal

    I prefer tried and true ergonomic interfaces. For this reason I suggest
    levers and foot pedals. All lever interfaces should have a grip lock
    to keep them from moving by themselves.

    There should also be two large dials to allow for precision X/Y
    axis movement of the cursor.

    Random numbers should be generated with a large wheel that has a rubber
    stop and pins. Simply spin the big wheel for a random number.

    There should be cranks on the side and top of the monitor to allow
    the view to be scrolled.

  • Why Go Backwards? (Score:4, Interesting)

    by gilgongo (57446) on Sunday March 08 2009, @04:29PM (#27114703) Homepage Journal

    Disclaimer: I am a UI designer, and it's been the way I've earned my living for the past eight years.

    All the "revolutionary" UIs that we've seen like Siftables and perceptive pixels appear to make a major assumption that I don't accept: that dispensing with the virtualisation of data and our interaction with it is automatically good.

    Bringing data and its manipulation "into our world" (as the Siftables guy puts it) seems to me to be a completely retrograde step. One of the reasons why we have computers in the first place is because our world and our physiology is in fact VERY BAD at manipulating large numbers of objects, or pouring paint from one place to another to create the right colour. Keyboards and mice, command lines and pipes, even folders and sub-folders (maybe), are several orders of magnitude better and more flexible at controlling the entropy that we need to control in order to get stuff done. We spent the last 10,000 years working that out - why the hell are we trying to re-discover our inefficiencies?

    I suspect the reason for this is because designing improvements to current UI is in fact very, very hard indeed. Of course, there is another reason: self-promotion by academics hoping to be given jobs heading up large corporate R&D departments for ten times their MIT salaries. But I'll let that pass.

    Basically, anyone who things humans have a future in significant problem-solving through the manipulation of real-world objects either doesn't understand the past, or is so used to the efficiencies that current human-computer UI models bring that they have ceased to understand them. The key to this understanding is an extreme abstraction of the real world, not its re-creation.

    • I have toyed with voice commands, some. And I did not like it. Still don't.
      If it's not something I can do silently, while talking to someone and without looking rediculous, I'm not using it.

      Now, a lighter version of those VR gloves that were touted as the future of human-computer interaction, where there would be a few sensors near my fingertips, I could live with. Even typing would work, though it would look silly.
      I do not want to keep turning this wink/smile/nod "feature" on and off all the time. If I h

      • You know those appendages with opposable thumbs that are usually used for tool manipulation?

        ... so you use your "appendages with opposable thumbs" to "manipulate" your "tool."

        Let me guess - you're posting this on slashdot because you've nick-named your "tool" as "CowboyNeal".

    • Do you really want to talk to a computer the way you would talk to a person?

      While there may be some potential in technologies like Ubiquity, I still prefer simple Unix-style commands for stuff I do often. And which i do not have to say out loud.

      The computer already occupies my eyes. Better interaction means occupying less, not more of my resources.

I don't get no respect.