New Chip Offers Artificial Intelligence On A USB Stick (pcmag.com) 81
An anonymous reader writes: "Pretty much any device with a USB port will be able to use advanced neural networks," reports PC Magazine, announcing the new Fathom Neural Compute Stick from chip-maker (and Google supplier) Movidius. "Once it's plugged into a Linux-powered device, it will enable that device to perform neural network functions like language comprehension, image recognition, and pattern detection," and without even using an external power supply.
Device manufacturers could now move AI-level processing from the cloud down to end users, PC Magazine reports, with one New York computer science professor saying the technology means that now "every robot, big and small, can now have state-of-the-art vision capabilities."
The article argues that this standalone, ultra-low power neural network could start the creation of a whole new category of next-generation consumer technologies.
Device manufacturers could now move AI-level processing from the cloud down to end users, PC Magazine reports, with one New York computer science professor saying the technology means that now "every robot, big and small, can now have state-of-the-art vision capabilities."
The article argues that this standalone, ultra-low power neural network could start the creation of a whole new category of next-generation consumer technologies.
Prototype as far as I can see (Score:3)
This is all very interesting. However, there is no indication of when the sticks will become generally available. Their website indicates that they intend to create 1000 sticks shortly for use by selected customers. It is difficult to know how real this is, actually.
Re:Prototype as far as I can see (Score:4, Insightful)
This is all very interesting. However, there is no indication of when the sticks will become generally available.
There also seems to be very little actual information about it. How much memory does it have? How many FLOPS? The product sheet says it uses 16 bit floats, which are generally good enough for NNs. But can it do FP32 and FP64 at all? The power consumption is ~1W, so I doubt if it can do much with that. The USB interface would be a major bottleneck, as you fed information in, and pulled results out. A GPU on a PCIe bus would be way faster at that ... and nearly all computers already have a GPU. I think I will continue to run my NNs on a Tesla K80 [nvidia.com].
Re: (Score:1)
Re:Prototype as far as I can see (Score:4, Insightful)
I suspect (yes, I'm guessing) that this may be somewhat less expensive than a Tesla K80.
Sure, but it is more expensive than the GPU already included in your computer, which has a marginal cost of $0 since you already have it. So why should you buy something that is far slower and less capable than something that is effectively free?
Also, you don't need to buy a Tesla K80. You can rent them by the minute from AWS.
Re: (Score:3)
It's just a mobile gpu chip with a USB interface.
Re: (Score:1)
Re: (Score:2)
Re: (Score:2)
This is all very interesting. However, there is no indication of when the sticks will become generally available. Their website indicates that they intend to create 1000 sticks shortly for use by selected customers. It is difficult to know how real this is, actually.
Wouldn't be surprised if this is a "please buy us out!" advertisement-product. I could see Apple buying them and integrating their chip into the next A-series processor to do client-side Siri among other things.
Only for Linux? (Score:3, Funny)
Bullshit (Score:5, Insightful)
We should first create AI before we start selling it on fucking USB sticks.
Re: (Score:2)
Just another IT guy who's hoping that AI isn't really here. Sorry, your fear is justified: AI will take your job away soon, if it hasn't already.
I've been hearing that argument for years. If a robot does replaces my IT job, I'm going to become the guy who repairs robots. Most people don't have a situational awareness that their job might go away someday and prepare for the possibility that they might have to do something else for a living.
Re: (Score:2)
Except that "robot repairers" - if not robot themselves - will be no more than 1/10 the jobs lost.
Correct. If I recognized that I'm being replaced by a robot and make the preparations to become a robot repairer, I'm going to be the person who gets the job. Meanwhile, the 90% who got laid off will wonder what happen, blame someone else for their problems and demand that the government fix it for them.
[...] you think you can keep your job as a sysadmin [...]
Change my current job, let the robots have it.
Enjoy capitalism.
With every career change, I make more and more money.
Re: (Score:1)
With every career change, I make more and more money.
Oh, sure. Looking at your photo in your website, I think that robots definitely won't be able to physically "replace" you. Do you also have advice for people who don't eat a whole grocery store every week?
Re: (Score:2)
Do you also have advice for people who don't eat a whole grocery store every week?
What makes you think I eat a whole grocery store? I actually eat less than most skinny people since I'm on a low carb diet (150 grams/1,500 calories per day).
Re: (Score:3)
f I recognized that I'm being replaced by a robot and make the preparations to become a robot repairer, I'm going to be the person who gets the job.
And I'll be the guy who breaks them. Job security for us both!
Re: (Score:3)
Re: (Score:2)
Get real, if an AI Robot can do you job then an AI Robot can repair the faulty robots too.
Who will repair the repair robots?
Re: (Score:3)
Who treats doctors when they get sick?
Their mothers — and robots don't have mothers.
Re: (Score:2)
"We should first create AI before we start selling it on fucking USB sticks."
It's a neural network on a stick. It's up to you too try to make it usable as an AI.
Re: (Score:2)
Re: (Score:2)
You should read the Go masters commentary on the recent match. These "AI" thingies can come up with original ideas and implement them. And their original ideas can be better than those of any human expert. (They aren't always, of course.)
What all current AIs I've heard of are weak on is layered hierarchies of goals.
Re: Bullshit (Score:3)
You can train a machine to classify cat photos. I'm not sure if I'd call that intelligence.
Scientists use the words machine learning. This device enables ML. At this time ML is by far the most useful aspect related to AI, but it's misleading to say this device enables AI. Additionally, mimicking human intelligence doesn't alway involve learned behavior.
You might disagree with my terminology, but machine leaning enables better AI. Machine learning isn't AI. There are plenty of machines that have been traine
Re: (Score:2)
Well, if you're talking about this particular device...I've no idea what it would be useful for, or why they picked a USB stick form-factor. If you're comparing Google's Go machine to something that classifies cat pictures, I don't think you understand the problem...or what the problem that was being solved is. Or if you're being dismissive of Go (i.e., "I don't like Go, therefore playing it isn't intelligent."), then perhaps you don't understand what was being done or why.
I'm trying to read your comment
Re: (Score:1)
Re: (Score:1)
This is precisely the type of HARDWARE that AI SOFTWARE needs to reach maximum performance. They are making this technology more accessible, which means more developers have the tools they need to start working in the AI field. How is this a bad thing?
Re: (Score:2)
Don't worry someone will come from the future and destroy them, to prevent a war that hasn't yet taken place.
Re: (Score:2)
We should first create AI before we start selling it on fucking USB sticks.
We have created AI. What we haven't done (yet) is create human level general purpose AI. But you don't need GP-AI to do things like object recognition, basic natural language processing, machine learning, etc. All of that is still artificial intelligence.
Re: (Score:2)
Re: (Score:2)
Perhaps you should go back to school, as I told you already several times: both are AI
It is not you who decides what AI is. It is the people actually working in AI
It took decades of research to figure how a computer can recognize objects, that was once a hard AI problem.
Language and image processing/recognition is done by a subset of aI called "cognitive systems".
Sorry binary number, you know absolutely nothing about AI.
DOA if the API isn't well documented (Score:1)
I can see a niche market for such a thing(aerial robotics, marketing research, statistics data collection for some other purpose such as at a kiosk) but the question is: is it less effort to integrate than rolling your own with other frameworks? Unless there is a severe power budget or weight limitation of the application(IE aerial drones), the notion of "plug and play" is dependent on how much the device does, and how easy it makes it to add the capabilities it doesn't.
Re: (Score:1)
That question is absurd. A straight linux nerd? Please.
Re: (Score:2)
Wasted potential... (Score:3)
Re: (Score:2)
I'm sure the AI would speak better English than you. Idiot.
An idiot is someone who isn't open to correction. I'm always open to correction. Since you're not offering correction but an insult, I must presume you're the idiot.
No external power supply? (Score:2)
and without even using an external power supply.
What are the 5 volts provided by the USB bus if not "external power"?
Re: (Score:2)
Probably not.
What's really inexplicable is that you actually took time out to write about how little you care about it. Why would anyone do that?
Re: (Score:2)
It's faster.
Re: (Score:2)
It's a mobile GPU in a USB stick. Kinda handy if you've got some device with a USB port but no GPU.
No, I couldn't think of any examples either.
Re: (Score:2)
It's for Linux. Most of don't have working GPU drivers.
Re: (Score:2)
Sure. All the deep learning libraries that support GPU computation on Linux beg to differ with you. TensorFlow doesn't run on Windows at all.
Re: (Score:2)
So it's one of these: http://www.newegg.com/USB-Disp... [newegg.com] plus bullshit?
Re: (Score:2)
Kind of like that, except without the video out.
Maybe (Score:3)
This USB stick will do a better job of editing Slashdot than the humans,
Artificial Intelligence (Score:2)
"New Chip Offers Artificial Intelligence..."
They keep using that phrase, but I do not think that phrase means what they think that phrase means.
I have to create an account to view the API? (Score:4, Insightful)
Fuck off. If you want me to have even a passing interest in this i want to see how easy it will be to use and port applications BEFORE I give you my details.
Do you want Skynet? (Score:2)
Because that's how you get Skynet. - Archer
Re: (Score:2)
The new Turbo (Score:1)
I want an "AI button" on the front of the case, just like the old Turbo button
which gave incredible improvements in performance.
Who has any spare ports available? (Score:1)
So who has any spare ports available anyways?
Most of these "sticks" I've seen are so wide that they block adjacent ports, so that means it will take up a pair (at least, all the USB ports I've seen have been a pair here, a pair there).
You have devices that need to be powered by the computer, and cannot go into a hub.
You have your high-speed devices that take up a full port.
You have printers that refuse to work properly through a hub.
By the time you're done? I'm glad that USB is hot swappable, because I'm co