AI Taught How To Play Ms. Pac-Man 167
trogador writes with the news that researchers are working to teach AIs how to play games as an exercise in reinforced learning. Software constructs have been taught to play games like chess and checkers since the 50s, but the Department of Information Systems at Eotvos University in Hungary is working to adapt that thinking to more modern titles. Besides Ms. Pac-Man, game like Tetris and Baldur's Gate assist these programs in mapping different behaviors onto their artificial test subjects. "Szita and Lorincz chose Ms. Pac-Man for their study because the game enabled them to test a variety of teaching methods. In the original Pac-Man, released in 1979, players must eat dots, avoid being eaten by four ghosts, and score big points by eating flashing ghosts. Therefore, a player's movements depend heavily on the movements of ghosts. However, the ghosts' routes are deterministic, enabling players to find patterns and predict future movements. In Ms. Pac-Man, on the other hand, the ghosts' routes are randomized, so that players can't figure out an optimal action sequence in advance."
Re:"AI"s tend to be overhyped (Score:4, Informative)
That being said, it is relatively easy to apply these techniques to games such as Ms. Pacman. Much harder problems have already been solved using RL algorithms. What seems missing in the article (though I don't know if this is also the case in the actual research) is comparisons with other RL methods than their own. Though their approach sounds promising and it's nice that they beat some human players, this is not uncommon in games for RL.
Re:"AI"s tend to be overhyped (Score:2, Informative)
So what the technique used in this paper is doing exactly what you would consider "real" AI. Full disclosure, I am a Master's student who has done a good amount of work in RL, and I have not read the paper, so what I describe above is not going to be exactly right, but is probably the general idea.
Re:The difference between Pac-Man and Ms Pac-Man (Score:2, Informative)
Re:"AI"s tend to be overhyped (Score:5, Informative)