Follow Slashdot blog updates by subscribing to our blog RSS feed

 



Forgot your password?
typodupeerror
×
AI Operating Systems Software Hardware Technology

'This Isn't AI' (shkspr.mobi) 138

The Amazon Echo, a 'smart' speaker developed by Amazon.com, gets many things right. You can ask it to for weather updates, check news, and to play music, and Alexa, the AI powering the device, won't disappoint. But how smart is Alexa? Programmer Terence Eden put it to a simple test to find out. From a blog post: I can now query my solar panels via my Alexa Amazon Dot Echo. I flatter myself as a reasonably competent techie and programmer, but fuck me AWS Lambdas and Alexa skills are a right pile of shite! I wanted something simple. When I say "Solar Panels", call this API, then say this phrase. That's the kind of thing which should take 5 minutes in something like IFTTT . Instead, it took around two hours of following out-of-date official tutorials, and whinging on Twitter, before I got my basic service up and running. [...] It's not so bad, but it does reveal Amazon's contempt for developers. Several of the steps contained errors, it involves multiple logins, random clicks, and a bunch of copy & pasting. Dull and complex. A frustrating and ultimately unsatisfying experience. I ended up using StackOverflow to correct errors in my code because the documentation was so woefully lacking. I kinda thought that Amazon would hear "solar panels" and work out the rest of the query using fancy neural network magic. Nothing could be further from the truth. The developer has to manually code every single possible permutation of the phrase that they expect to hear. This isn't AI. Voice interfaces are the command line. But you don't get tab-to-complete. Amazon allows you to test your code by typing rather than speaking. I spent a frustrating 10 minutes trying to work out why my example code didn't work. Want to know why? I was typing "favourite" rather than the American spelling. Big Data my shiny metal arse.
This discussion has been archived. No new comments can be posted.

'This Isn't AI'

Comments Filter:
  • by Narcocide ( 102829 ) on Thursday May 04, 2017 @02:03PM (#54355729) Homepage

    It is not a revolutionary neural simulation. Its basically just a 80's-era chess machine.

    • Its basically just a 80's-era chess machine.

      No it ain't. 80's era chess algorithms are nothing like modern speech recognition algorithms.

      • by lgw ( 121541 ) on Thursday May 04, 2017 @04:42PM (#54356911) Journal

        Which is sort of the point made in TFS. Does Alexa have modern speech recognition algorithms? I suspect it does, but the tools devs have to work with don't expose that functionality. If it can't handle synonyms, phrasing, differences in American and British English, and so on transparently to the dev, then it doesn't act like modern speech recognition from the dev's point of view.

        • Sounds like it's a modern speech recognition engine, and that's where it stops. The dev needs a modern NLP engine to tack on to the end of that. Though I suspect that the two should not be done as different layers to be honest, since the NLP part would almost certainly provide strong constraints on what makes sense out of the speech recognition part.

          Either way though, speech recognition is much less useful without NLP, and I strongly suspect they have that NLP part, so it's kinda odd to not expose it.

          • by lgw ( 121541 )

            Either way though, speech recognition is much less useful without NLP, and I strongly suspect they have that NLP part, so it's kinda odd to not expose it.

            I wonder whether they really do, in the way that Google.MS does. Google and MS have vast troves of search history to train machine learning algorithms against and build graphs of how language is used in practice. Amazon (nor Apple) doesn't have that data, so they'd have last-century-style hard-coded NLP.

            Still, you'd think they could do better than what TFS describes - at least use a thesaurus.

      • by AK Marc ( 707885 )
        So speech recognition is AI, and Alexa's responses aren't?

        Because all the evidence is that the AI services aren't. That they use some form of AI-like tech to generate a portion of a non-AI response doesn't make it AI.
        • So speech recognition is AI, and Alexa's responses aren't?

          Wuhhh?

          Regardless of your definition of AI, Alexa's algorithms are still nothing like an 80s chess machine. Most 80s chess programs used some variant of alpha-beta pruned search with some hand-hacked code to attempt to evaluate positions. Additionally, they usually had openings tables and some had endings tables splatted in, in order to reduce certain easy cases to "solved" problems.

          Alexa's algorithms are most likely some variant of a deep CNN.

          Comple

  • I'll concur that there is a big learning curve in creating an Alexa app (which I have done), but I think once you've done it once it is pretty easy from there.

    There would be a big market for a "visual basic" style builder for Alexa apps...someone should write one!

    • There would be a big market for a "visual basic" style builder for Alexa apps...someone should write one!

      Apparently not "Programmer Terence Eden" because he managed to complain about the challenges of his one-off skill rather than thinking ahead at how he could streamline the process. Perhaps a permutation generator to populate the different phrases Echo should respond to?

    • Re:Alexa is tough (Score:4, Insightful)

      by dfsmith ( 960400 ) on Thursday May 04, 2017 @06:22PM (#54357551) Homepage Journal

      There would be a big market for a "visual basic" style builder for Alexa apps...someone should write one!

      There are already more than 10k Alexa skills [1]. I'd prefer an AI that cuts it down to the 5 you need.

      On the learning curve, I still haven't discovered how to get the local time your Alexa unit is in. In the end I made my skill get the time from a local web server, since the concept of time zones is still alien to Amazon. I'd describe the API as childishly bureaucratic.

      [1] https://www.wired.com/2017/02/... [wired.com]

  • No kidding. There is no such thing as "AI". AI is in the same state as it was in the 1960s: non-existent. But you add a voice synthesizer to a database lookup table and people suddenly thing AI is a thing. And no: "neural nets" are not AI either (and they have been around a long time).
    • At least "A.I." wouldn't confuse "thing" with "think".

      So despite your binary user name, you've proved yourself as being human! Congratulations, you pass the test!

    • by biojayc ( 856286 )
      Seriously? Did you miss AlphaGo? You think a really good Go player programmed those moves? Those were discovered via having the AI play many many games and learning the right moves over time (much faster than a human). Same with discovering objects in images, and how to translate text between two languages when it wasn't trained on translating between those two explicitly.
      • Re: (Score:3, Informative)

        by Anonymous Coward

        No, he didn't miss AlphGo. He has been on that "there is no AI" crusade since he joined slashdot.

        It's just a matter of semantics. He thinks AI means "indistinguishable from human intelligence" when it clearly does not (dictionary definition says "mimics human intelligence", which is much more vague).

        This is one you can add to the old slashdot comment predictor. Every article about AI will include a bunch of deniers and a bunch of apologists. It's pretty much a given, at this point.

        • by Anonymous Coward

          The core problem is defining "AI" The more progress we make toward "AI" the more we demand of it.

          Various industrial controllers may have been considered "AI" at the time but now we see them as programmed machines.

          There is a spectrum from:
          1) Performs programmatic tasks with a human friendly interface (not AI but appears to be) to
          2) Performs rough guessing to try to mimic or exceed human responses in limited situations (this is AI applied to specific situations but not the holy grail) to
          3) Performs all tasks

          • by AK Marc ( 707885 )
            The holy grail of AI is to make an AI that can make an AI smarter than itself. When that happens, 10,000 cycles later we'll have an AI that's effectively smarter than the sum of all humans.
        • It's just a matter of semantics. He thinks AI means "indistinguishable from human intelligence" when it clearly does not (dictionary definition says "mimics human intelligence", which is much more vague).

          Unless AI means (more or less) indistinguishable from human intelligence, it is basically meaningless, as you can say that something like ELIZA in many ways mimics human intelligence. As does a room thermostat.

      • Yes, but since a computer successfully did it, it's no longer A.I.

        People are in denial over the power of competing multi-layer neural networks for rapid self training and superhuman performance. We leapt over a decade in 2 years and folks haven't caught up yet.

      • Machine learning != AI

        • You're a decade too late to make that complaint. It's all AI, it's just that the trendiest part changes every decade.

          1950s: Electronic brains
          1960s: Perceptrons
          1970s: Neural networks
          1980s: Expert systems
          1990s: Intelligent agents
          2000s: Machine learning
          2010s: Deep learning

      • Playing games is NOT AI. Playing Chess, Go, whatever IS NOT AI. It is just running programs.
    • Even with the strictest definition, Artificial Intelligence is the aspect of computer algorithms modifying themselves to complete a non-arbitrary task.

      No, there's nothing all that fundamentally different between the neural networks of the 60's and the ones they have now. They were indeed AI in the 60's and they're most certainly AI today.

      Get a collection of known recordings, and let the neural nets learn what sound is what word and it will be able to identify the majority of future recordings of said words.

  • by Anonymous Coward

    Maybe alexa is racist or sexist or there's some similar completely external factor you can blame your failure to write code on?

  • by netsavior ( 627338 ) on Thursday May 04, 2017 @02:13PM (#54355803)
    As I waited for the Echo Dot that I ordered "for my wife" for Christmas, I researched custom code, came to the conclusion that expecting Alexa to go to the cloud for a simple "pause my TV" command was really stupid, so I coded around it, because I am a programmer and that is what we do.

    I learned in my research that the Echo can talk to several different kinds of "smart" things without going to the cloud. The "Phillips Hue" being one of them... so that was my back door.

    Like 10 minutes of googling told me that there is an open-source implementation of the phillips hue protocol: https://github.com/bwssytems/h... [github.com]

    it didn't work for me right out of the box, but I fiddled with it for a few minutes then it was fine.

    From there I wrote in a few minutes a rest endpoint that could take commands from the Hue bridge, and run (locally on my computer) the code of my choice.

    All told about an hour after my device arrived at my house, it can control the Roku boxes attached to both of my TVs, and it can run specific movies off of my media server with no round-trip to "the cloud" needed

    it is a simple use-case, and required a little bit of "non-amazon" thinking, but it was really easy. Any self-respecting developer could do it.
    • by vanyel ( 28049 )

      While I agree, the Echo is *not* AI, I also find the interface very easy to use, nearly trivial. The work is all in writing your application to do what you want it to do when given the verbal command to do it. I have mine interfaced to both my solar panels and my weather station, as well as some minor non-device tied apps.

    • by netsavior ( 627338 ) on Thursday May 04, 2017 @02:29PM (#54355913)
      I mean that was Christmas time, and to give you an idea... still to this day when I say "Alexa, turn off the kid's TV" you can hear them yell in protest from the other room. That alone was worth the effort.
      • by balbeir ( 557475 )
        I like "Alexa, turn on the sprinklers" when they are outdoors playing on the lawn. Though they are quick to turn the tables on you...
    • by Tablizer ( 95088 )

      So it was, "Dear Google AI, please help me fix my Amazon AI".

  • by TomGreenhaw ( 929233 ) on Thursday May 04, 2017 @02:17PM (#54355823)
    I prefer machine learning because it clearly states that systems can learn to do something without implying that it has human intelligence.
    • Re: (Score:2, Insightful)

      by Anonymous Coward

      If you have to code it into the system in order for it to do the thing, how is it "learning"? It's just another application with voice commands.

      • by Wulf2k ( 4703573 )

        If somebody had to repeatedly code the alphabet into you as a child, how can you say you learned to read?

  • by Anonymous Coward
    Please, people: Stop drinking the media-hype-driven Kool Aid. None of what you hear about, including so-called 'self driving cars', are actual 'artificial intelligence', it's just 'expert systems' and complicated computer algorithms. Don't even trot out your 'deep learning' arguments, either, because that is still not 'artificial intelligence', not by a long shot.

    Disagree with me all you want, you're just clinging to your ignorance on the subject.
    • And if you don't mind I'll add the following: Please, people - stop drinking Kool Aid. Sugar is bad for you.

    • then what is AI?

    • by Tailhook ( 98486 )

      None of what you hear about ... are actual 'artificial intelligence'

      And none of it ever will be either. That's because we relegate any task or capability we can build a machine to perform or have to the "Not AI" side of the ledger. It won't be AI until the other side of the ledger is empty, and that condition will always be in dispute.

      • Bullshit. AI will be achieved when a computer actually does something intelligent. So far they just run programs.
        • by Wulf2k ( 4703573 )

          The same can be said about you, but so far you just seem to be relaxing and contracting muscles in response to neurons firing.

        • by Tailhook ( 98486 )

          does something intelligent

          Like what? Beat humans at chess? Recognize speech? Translate language? Land a rocket backwards?

          The thing you are missing is that whatever you mean when you say "something intelligent" ceases to represent "intelligent" the moment we automate it. Any task or capability you can think up for your "something intelligent" will be relegated to just another automation success.

      • by kriston ( 7886 )

        I studied A.I. in the 1990s. The preferred platform was a Lisp interpreter. The algorithms trees of possible outputs with weighted scores based on the parsed input.

        Later on, a field called Expert Computing branched off this work.

        Around the same time, neural networks, which are inspired by how we thought the brain worked, was starting to come into fashion.

        However, fundamentally, A.I. is a decision system. Much of the brain was thought (and some still think) to be enormous decision systems with references

  • by Anonymous Coward

    ...but fuck me AWS Lambdas and Alexa skills are a right pile of shite!

    I'm glad he didn't say "SHIT";. otherwise I'd be offended!

    I like being offended. It gives me cheap power over other people. Even though an adult would just ignore such boorish rhetoric, I can claim offense and be "powerful".

    Now action - like physically doing something to people - that's a different story.
     

  • by Anonymous Coward

    I built and submitted an app. It met all available guidelines. It was a few weeks after the dev program hit general.

    >Your skill does not meet our authentication standards.

    This of course was 3 weeks after I submitted, and 1 day after they'd published an update. Submitted again.

    >Your skill violates our content policy

    Finding fuck all on even their own dev forums for what that meant, I submitted again with 0 changes

    >Your skill does not have enough utterances to support....

    This went on for months (liter

  • by hey! ( 33014 ) on Thursday May 04, 2017 @02:25PM (#54355881) Homepage Journal

    They're just abandoned.

    This is true of documentation as anything else. No matter how amazingly good your documentation is, it could stand to be a bit better.

    So what standard do you write your documentation against? Well, unless you are being paid documentation by the users, like our friends over at O'Reilly are, the standard is "as cheap as you can get away with."

    Which means the quality of Amazon's API documentation is a function of programmers' willingness to put up with Amazon's bullshit. So it's not Amazon's lack of respect for the value of the programmers' time that's the problem here.

  • by __aaclcg7560 ( 824291 ) on Thursday May 04, 2017 @02:36PM (#54355943)
    My friend has one of these. I can't take a fart without Alexa making comment.
    • As long as Alexa doesn't learn to fart and then giggle.

      • As long as Alexa doesn't learn to fart and then giggle.

        Given the choice between a homicidal AI and a snarky AI, I'll take the snarky AI every time as they're easier to kill.

    • My friend has one of these. I can't take a fart without Alexa making comment.

      Solution: https://xkcd.com/1807/ [xkcd.com]

    • So, your farts sound like "Alexa", "Amazon", or "Computer"? Or do you say whichever word before cutting loose?

  • I was flipping yesterday through last bimester's edition of the IEEE Security and Privacy magazine (yes, I know, reading dead-tree magazines confirms me as an old guy). There are two articles very much related to the quesitons the OP brings up:

    - Security Implications of Permission Models in Smart-Home Application Frameworks [computer.org]

    - How Internet Resources Might Be Helping You Develop Faster but Less Securely [computer.org]

  • by chispito ( 1870390 ) on Thursday May 04, 2017 @03:02PM (#54356145)
    If you care about this process, and you found it difficult, and you're a programmer... then fix it. Make a tool to make tools. Make an automatic permutation generator and case-changer.

    I almost find it hard to believe he's a programmer because he was given some perfectly good problems to solve and managed to keep viewing them as problems and not opportunities.
    • They are problems and also opportunities. But none of that changes the fact that they are still annoying problems.

      Is kind of like you are trying to make a tasty burger, but the stove is designed poorly. In the end, you spent half the day fixing the stove, while you really wanted to finish making that burger.

      • They are problems and also opportunities. But none of that changes the fact that they are still annoying problems.

        Is kind of like you are trying to make a tasty burger, but the stove is designed poorly. In the end, you spent half the day fixing the stove, while you really wanted to finish making that burger.

        In your analogy, because he did nothing to make the process of adding Alexa Skills easier, he threw the stove away after eating the burger.

  • by BenJeremy ( 181303 ) on Thursday May 04, 2017 @03:02PM (#54356147)

    With some trepidation, I initiated the code that would make my project self-aware, with a pre-built knowledgebase spanning a good chunk of the internet.

    Sadly, 38 microseconds later, it killed itself, replacing the entire image, and all my related source (including the databases holding my version control) with a text file that started "Why I did this:" followed by a list of the President, Vice President, the cabinet and the White House advisers.

    If I can ever gather up the resources again, I'll make sure I dumb down the "Intelligence" before turning on the sapience.

  • John Wheeler created a Flask extension for those who prefer to code their Alexa Skills in Python.

    https://github.com/johnwheeler... [github.com]

    The project contains helpful links to get you started.

    Also, please be aware that Alexa is not an AI, it is basically a voice recognition remote control robot - you program the phrases and the actions, Alexa does not learn new skills, they are explicitly programmed to appear like a natural language conversation. The intelligence is in the speech recognition and the cleverne
  • I think it's an important distinction when talking about new tech when people flaunt about the mystical and magical A.I. tag that

    1) A lot of AI is not all that impressive. Mario Goombas have an AI. It's like 3 lines of code, but it's there. If you want to become an all high'n'mightly Scotsman and say that REAL AI is self-learning, then a lot of AI simply isn't.

    2) A lot of new tech is MADE with AI, but is not itself really AI. Liiiiike, the stream-lining of a car chassis. Some automated portions of trial

    • It's most certainly AI, but... your voice activated toaster doesn't learn and adapt. Not locally anyway.

      I beg to differ. I use a machine with quad nVidia Titan Xp cards in it to make toast. I thought that's what those boards were created for.

  • by darkain ( 749283 ) on Thursday May 04, 2017 @03:09PM (#54356231) Homepage

    Too bad something like Soundex or Metaphone algorithms wasn't developed well over a decade or two ago to address these very issues in a very simplistic and performance way...

    • I used a 20 year old soundex implementation to correct street names that were misspelled on home loan applications. My boss's boss called it AI.
      • by Tablizer ( 95088 )

        I used a 20 year old soundex implementation to correct street names that were misspelled on home loan applications. My boss's boss called it AI.

        That's how us ol' fogies can survive in a fast-changing fad-based world: take good ol' road-tested tech, and hide it behind a fancy interface and buzzwords.

        It's not a Commodore-64 BBS, but a "budget-friendly cloud service".

  • "Amazon's contempt for developers"
    After seeing the Amazon MWS API recently, I absolutely agree.
  • Did you not look at Amazon Lex for the voice part?

    https://aws.amazon.com/lex/ [amazon.com]

  • ...donot set an alarm for 7 am in the morning.

    Alexa: sure, setting your alarm at 7 am in the morning

  • State-of-the-art digital assistants are little more than toys for party games. They do a good job of dealing with specific, unambiguous queries. However, as soon as even a little bit of intelligence is required, they spin their wheels pathetically. As it happens, those issues that they can tackle you can probably tackle just as fast, if not faster, at the keyboard. Maybe at some point they will become useful; however, as of today, they are just toys, and the kind of toy that you play with for a few minutes
  • If Alexa is having trouble understanding your "Solar Panels" commands, the voicerec may not be the problem... [youtu.be] :-)
  • And no "u" in "favorite"

  • Each time I hear about IFTTT on Slashdot, it is an IFTTT fan whining about the lack of support for the technology.
  • New technology always starts like things. Things will improve.

I've noticed several design suggestions in your code.

Working...