Want to read Slashdot from your mobile device? Point it at m.slashdot.org and keep reading!

 



Forgot your password?
typodupeerror
×
Input Devices Robotics Hardware Science

fMRI Lets Israeli Student Control Robot In France With His Mind 92

MrSeb writes "An Israeli student has become the first person to meld his mind and movements with a robot surrogate, or avatar. Situated inside an fMRI scanner in Israel, Tirosh Shapira has controlled a humanoid robot some 2000 kilometers (1250 miles) away, at the Béziers Technology Institute in France, using just his mind. The system must be trained so that a particular "thought" (fMRI blood flow pattern) equates to a certain command. In this case, when Shapira thinks about moving forward or backward, the robot moves forward or backward; when Shapira thinks about moving one of his hands, the robot surrogate turns in that direction. To complete the loop, the robot has a camera on its head, with the image being displayed in front of Shapira. Speaking to New Scientist, it sounds like Shapira really became one with the robot: 'It was mind-blowing. I really felt like I was there, moving around,' he says. 'At one point the connection failed. One of the researchers picked the robot up to see what the problem was and I was like, "Oi, put me down!"'"
This discussion has been archived. No new comments can be posted.

fMRI Lets Israeli Student Control Robot In France With His Mind

Comments Filter:
  • Thought that was always just the Aussies. Huh.

    The story is interesting, although somehow not that exciting as this kind of advancement is...necessary and expected.

    When we can actually upload data to our brains and have thoughts translated to a phonetic language...then we will have something that will move mankind forward generations.

  • what's next (Score:2, Interesting)

    by ozduo ( 2043408 )
    mind melding with your partners sex toy
    • by EdIII ( 1114411 )

      mind melding with your partners sex toy

      Don't worry about the moderation. 10 years from now it will be meta-modded +5 Psychic.

  • Next Step (Score:5, Interesting)

    by Phrogman ( 80473 ) on Saturday July 07, 2012 @07:14PM (#40578749)

    is to combine this technology with remotely piloted drones, spy-copters, and eventually combat robots. Then I can imagine a military formation formed up to receive orders, being told they were going to war, and then told to go to it - and no one needs to move :P

    • Re:Next Step (Score:5, Interesting)

      by Anonymous Coward on Saturday July 07, 2012 @08:28PM (#40579107)

      If such technology existed, why would that be better than a keyboard and mouse or a gamecontroller as an interface? And using my extensive experience in an environment where they have been used for "combative" purposes I ask: why is a huge latency desirable? And how is a human better than an aimbot?

      Human lives are cheaper than advanced combat robots (with or without AI). The notion that no sacrifice in blood has to be made in war might be alluring to democratic politicians and their constituencies, but the sooner democracies in the world stop initiating wars the better the world will be off. Thus I am happy to say that due to economics drone armies will not conquer the world*, either under the pretext of humane intervention or blatant imperialism.**

      * Conquest is long lived occupation (with repression) not mere military victory. The technological saturation point of destruction has already been reached, no further advancement is required.
      ** If you read between the lines of this comment a "Fuck the USA" can be spotted.

    • by Anonymous Coward

      I imagine some AI needs to be developed anyway, latency and all that.

    • Re:Next Step (Score:5, Insightful)

      by superwiz ( 655733 ) on Saturday July 07, 2012 @09:08PM (#40579267) Journal
      The only reason you think of a military formation is that modern society is so far removed from necessary physical interactions with nature. Why military? This could be farmers controlling robots which gather crops.... computer connections are cheaper than transporting people in actual physical space.
      • by Anonymous Coward

        The only reason you think of a military formation is that modern society is so far removed from necessary physical interactions with nature.

        And your solution is to have even farmers interact with the earth only remotely?
        No, the reason to think of the military is because the military benefits most from removing its people from where the action is.

        • And your solution is to have even farmers interact with the earth only remotely?

          Obviously. If people would like to interact with nature, they would. It's not like we are choosing to do what we hate. The only reason we romanticize nature is because we are so removed from it. In reality, survival is struggle against nature. The only reason we are able to forget that is because we have gotten so good at it.

    • The first money maker will be a Dutch sex-bot, remotely operated by a hooker from Amsterdam.
  • Interesting (Score:5, Interesting)

    by jd ( 1658 ) <imipak@ y a hoo.com> on Saturday July 07, 2012 @07:45PM (#40578909) Homepage Journal

    Most of the comments so far seem to confuse EEG-based interfaces with fMRI-based ones, or local with telerobotics, but no great surprise there. The politics is sad, but again only to be expected.

    We still can't do true mind-control of robots (there's no way to read minds yet, we can only say "pattern X equals action Y", which is not the same thing) but this is an interesting development to say the least. Think in terms of medicine. Robotic interfaces in surgery are typically data gloves or joystick, plus goggles, but muscles have poor granularity of control, data gloves and joysticks reduce this further, and goggles are incredibly low-res. If they get to the point where surgeons are limited only by the precision of their mind, you're looking at a major revolution.

    • Re:Interesting (Score:5, Insightful)

      by Baloroth ( 2370816 ) on Saturday July 07, 2012 @08:05PM (#40579009)

      The bigger issue, it seems to be, is feedback. Sure, you can train the machine to "read" certain patterns with attempts to move the arm, and potentially create very advanced interfaces, but the interface is purely one-way: there is no way to tell the human he has "touched" something. Cameras work to some extent to provide visual feedback, but more advanced and more delicate control requires something beyond just that. We need to find a way to provide neural feedback to replicate the sense of touch, at the very least. Sight can be provided easily (without requiring a neural interface), as can hearing, and smell is largely unneeded, but for an arm, touch feedback is essential.

      • Re:Interesting (Score:5, Interesting)

        by jd ( 1658 ) <imipak@ y a hoo.com> on Saturday July 07, 2012 @08:52PM (#40579203) Homepage Journal

        Agreed. Force-feedback is a start, albeit a crude one, but it's not enough. It might be possible to electrically stimulate individual pressure nerves to give a sense of touch, since nerves are electrical by nature, but you're talking an amazing number of electrodes to get any detail and some major technological problems to get it to stimulate the right nerves.

        For something that is compressible/expandable to some degree along only certain directions, you can simulate that with pneumatics. It's essentially the same as force-feedback (you apply pressure in one direction, something applies force in the opposite direction) but instead of having one or two motors, you can have a crude surface where each point applies different feedback. Mechanical devices of this kind aren't complex, require no new technology to be invented, and would be in the price range of a decent facility - I assume you don't hear of them because there's simply no scientific or industrial application outside of perhaps telerobotic pottery-making and there's not really a huge market for that, and the increase in the number of variables that could be fed back to the user is still going to be extremely small - an increase from 2 to 12 sounds reasonable - but the cost would be substantially more than 6x that of a joystick. The cost/benefit isn't there.

      • Re:Interesting (Score:5, Informative)

        by superwiz ( 655733 ) on Saturday July 07, 2012 @09:10PM (#40579277) Journal
        This interface doesn't read the neural impulses. It does the detection by determining which parts of the brain receive more blood.
    • (there's no way to read minds yet, we can only say "pattern X equals action Y",

      But isn't this what you are doing when you learn how to do something physical like play a guitar or pianno, or tennis, etc? Your mind equates how you move your fingers or body to a result or external action on your environment and you say to yourself, that's good or that's bad and you store the information. So now you know that if your fingers do X, you get Y note from the instrument, or you hit the ball. As far as I can tell, a

    • Temporal resolution (Score:4, Interesting)

      by Harvey Manfrenjenson ( 1610637 ) on Sunday July 08, 2012 @12:45PM (#40582927)

      I don't think an fMRI interface is going to be very useful for controlling robots, because of the issue of temporal resolution. I think you can only acquire an fMRI image once every couple of seconds (at most). The above poster referred to the "granularity" issue with data gloves and joysticks, but it's a thousandfold worse with fMRI and probably always will be.

      A better choice might be magnetoencephalography (MEG). Nearly instantaneous "image" acquisition, and as a side benefit, there are no health risks to the user (fMRI bombards you with intense magnetic fields and no one really knows if that's safe).

  • by caseih ( 160668 ) on Saturday July 07, 2012 @08:01PM (#40578995)

    Ask any good backhoe operator about how he operates the machine and you'll find he doesn't think about the mechanics of his arms and feet interacting with the control levers. His brain abstracts all that and treats the hoe as an extension of his body. Once you've been trained how to move the controls, you stop thinking about it. You just dig.

    A similar feeling could be generated simply by video goggles and a joystick. In fact when I fly my airplane using a video downlink, it feels like "I'm there." Seeing yourself on the ground is a bit weird! I can look down at something, turn the plane to look at something all without really thinking about what my hands need to do, since they've been trained and my brain just does that automatically in response to what I want to do. This is true of normal RC airplane flying as well. People often ask me how I can remember to move my fingers in the opposite direction as the plane is flying towards me but the truth is I don't think about it at all very much. I just move the airplane where I want it to be.

    The exciting goal of thought control, though, is obviously to enable people who don't have the use of limbs or fingers to control and interact with robotics, such as an artificial limb, as if it is part of the body. And as the test subject can attest, that's pretty much what happens with training. Now if they can just get the sensor equipment to weight less than a few tons and not draw metal objects towards it...

  • by Anonymous Coward

    Nearly there till hot blue alien sex.....come on you where all thinking it....

  • Passport (Score:4, Interesting)

    by jamesh ( 87723 ) on Saturday July 07, 2012 @08:12PM (#40579035)

    If you are in Israel with a physical (but virtual) presence device in France, do you need a passport?

    • More importantly, should all French robots now be searched in the streets, in case they are mind-controlled by middle-eastern terrorists?
      • Re: (Score:1, Flamebait)

        by superwiz ( 655733 )
        Yes, yes. We get it. You both are not antisemitic. You are anti-israeli. Or better, you "disagree with some policies of the Israeli government." Really, we do believe you. No need to get defensive and start a flame war about it.
        • I am Jewish (by origin, not by their shitheaded religion), and I think, government of Israel is a bunch of racist, ethnocentric theocrats that deserve nothing better than a kick in the nuts.

          • There is nothing uncommon about being jewish and being antisemitic. In fact, it's one of the oldest stories in the Western history. So "I am jewish" does not in any way whatsoever prove that you are not antisemitic. I am not saying that you are antisemitic. But I am saying that what offer as the proof that you are not does not rise up.
            • Actually no, it's not possible to be Jewish and antisemitic. There are certain Jews who treat any attacks against themselves as antisemitism, and they should just shut up because it's stupid.

              • Actually no, it's not possible to be Jewish and antisemitic.

                That's a laugh. Of course, it is. It's very, very common, in fact.

    • If you are in Israel with a physical (but virtual) presence device in France, do you need a passport?

      Yes, in the same way that when I access slashdot from the UK I need a fucking American visa and have to anally probe myself for explosives.

  • by colinrichardday ( 768814 ) <colin.day.6@hotmail.com> on Saturday July 07, 2012 @08:16PM (#40579053)

    Shouldn't that be brain instead of mind?

    • Re: (Score:2, Interesting)

      by Anonymous Coward

      No. Using the word 'mind' simply indicates that the brain activity which controls the robot is conscious. So it specifies rather than confuses.

      • I might be conscious, but is the brain activity conscious? Or did you mean that the brain activity was the result of a conscious decision?

  • Oy! Mind meld, my recto-tectal tract! Functional assertions not withstanding, MRI derived blood flow and oxygen usage patterns are not algorithmically equatable with thought...

    Existing MRI scanners are overwhelming auditory assault systems, and I can (in my sf-enthusiast imagination) conceive of no better way of limiting military drone pilot endurance than to link one to a state of the art MRI scanner. As if current Raptor trailer sessions probably don't produce enough "Hellfire" stress, in theory...

    Of c

  • "An Israeli student has become the first person to meld his mind and movements with a robot surrogate, or avatar.

    LaForge will be happy to hear this.

  • Now you have real school kids controlling real robots in real life with their real minds.
  • by guttentag ( 313541 ) on Saturday July 07, 2012 @10:04PM (#40579495) Journal
    For a moment I thought this was going to be an article about how doctors can now get a clear picture of your brain by analyzing your Facebook profile, reducing the need for a traditional MRI, but somehow costing more.
  • by hcs_$reboot ( 1536101 ) on Saturday July 07, 2012 @11:19PM (#40579825)
    I'm much less impressed by the 2k distance than the ability to control a device from the mind. The robot could be close to the student or - even better - on him [iron-man like], the achievement would be just as great.
  • by PPH ( 736903 ) on Saturday July 07, 2012 @11:41PM (#40579957)

    ... you must think in French.

    • Rawhide: Dr. Banzai is using a laser to vaporize a pineal tumor without damaging the parthogenital plate. A subcutaneous microphone will allow the patient to transmit verbal instructions to his own brain.
      Observer: Like, "raise my left arm"?
      Rawhide: Or "throw the harpoon." People are gonna come from all over. This boy's an Eskimo.
  • by PolygamousRanchKid ( 1290638 ) on Sunday July 08, 2012 @03:51AM (#40580745)

    . . . how about a robot controlling a human with its mind . . . ? Now that would be definitely more interesting, and would foster more vivacious cocktail party talk.

  • Surrogates [imdb.com] covered the side-effects of such a development.

The use of money is all the advantage there is to having money. -- B. Franklin

Working...