For "Special Topics for Engineering," November 7, 2018.

1. Games, AI, and Research
Pujana P
Pujana.P@gmail.com

2. WHO AM I?
Pujana Paliyawan
Doctoral in Advanced Information
Science and Engineering
Ritsumeikan University, Japan
Thesis: Universal Middleware for Motion Gaming
Master of Science in Information Technology
King Mongkut’s University of Technology Thonburi (KMUTT), Thailand
Thesis: Office Workers Syndrome Monitoring Using Kinect
Bachelor of Business Administration in
Business Information Systems
Assumption University of Thailand (AU)
Senior Project: Online Shooting Game Development
(ICE)
Right Punch Press Heavy Punch
Motion Keyboard event In-game Action

3. What can we do with Games?

4. Games and AI
Artificial Intelligence and Games (2018)
Georgios N. Yannakakis and Julian Togelius
“Games have long been seen as the perfect test-bed for artificial
intelligence (AI) methods, and are also becoming an increasingly important
application area.”

5. Why AI researchers like video games?
“Artificial intelligence (AI), the ability of a digital computer or
computer-controlled robot to perform tasks commonly
associated with intelligent beings.”
What is AI?
Artificial intelligence (Book by Jack Copeland), Originally published: 1993
What is Intelligence?

6. Which one looks more intelligent?
Cocktail
Maker vs.
Fingerprint
Scanner

7. Human needs intelligence to play game
The Turk

8. Why AI researchers like video games?
Clear Goals & Rules
• Rewards & Penalties setting
Intelligence is needed to play games
(most)
• Good & Bad Actions

9. Good and Bad Actions
Rewards and Punishments  a heart of Reinforcement Learning
Recommender System
System
• Buy / Not Buy
• Rating
Games
Chess Piece Relative Value
(More details)

10. Why AI researchers like video games?
Clear Goals & Rules
• Rewards & Penalties setting
Intelligence is needed to play games
(most)
• Good & Bad Actions
Complexity
All games deal with contingency plans
Real-time
Existence of Opponents
Dynamic Environment
Limited Processing Time Budget

11. Games, AI, and Research

12. WHAT HUMAN DO WITH GAME?
• Play
• Study
• Design, Develop
Create / Build Contents
https://vimeo.com/147101231
AI for game testing, NPC
Procedural Content Generation (PCG)
Reinforcement Learning Algorithm

13. AI Research
• Bot / NPC
Research on Games

14. 0:449:00
Game AI: Strength(More details)

15. Game AI: Believability
AI bots that are more believable and human-like than human players
Artificial Intelligence and Games (2018)
Unreal Tournament bots passed the Turing test (2012)
Google Duplex (2018)
「ミスを犯す人間らしいゲームAIの研究 (Studies of
human-like game AI making mistakes) 」 by Mr.
Ito of UEC (電通大)
(More details)

16. Game AI: Adaptability
(Fun) Flow Theory Maloney AE, Mellecker R, Buday R, Gao Z, Hinkley T, Esparza L, Alexander S. Fun, flow, and fitness: opinions for
making more effective active videogames. Games for health journal. 2015 Feb 1;4(1):53-7.
• Promote Fun
• Prevent Boredom Anxiety
• Keep players continue playing the
game
(More details)

17. AI Research
• Bot / NPC
• Strength : For Victory !
• Believability : Human-like AI
• Adaptability : Dynamic Difficulty Adjustment
Research on Games
• Behavior Detection
• Toxicity detection / Trolling Behavior Detection

18. Toxic Behavior / Trolling in Games
Teleporter Trolling!
Overwatch
Symmetra/ ซิมเมทรา (Overwatch)
(More details)

19. Toxic Behavior / Trolling in Games
• Blizzard is monitoring YouTube videos to
curb toxic Overwatch behavior
https://www.gamasutra.com/view/news/313785/Blizzard_is_monitoring_YouTube_
videos_to_curb_toxic_Overwatch_behavior.php
• To prevent toxicity, design games with
community management in mind
https://www.gamasutra.com/view/news/315930/To_prevent_toxicity_design_game
s_with_community_management_in_mind.php
• Märtens M, Shen S, Iosup A, Kuipers F. Toxicity
detection in multiplayer online games. In
Network and Systems Support for Games (NetGames),
2015 International Workshop on 2015 Dec 3 (pp. 1-6).
IEEE.
Some Works
(More details)

20. Toxic Behavior / Trolling
in Other Application
Test Your Best Insults Against Google's New Anti-Troll AI (2017)
https://www.popularmechanics.com/technology/a25379/perspective-ai-google-comment-filter/
perspectiveapi.com
Google’s Perspective
(More details)

21. AI Research
• Bot / NPC
• Strength : For Victory !
• Believability : Human-like AI
• Adaptability : Dynamic Difficulty Adjustment
Research on Games
• Behavior Detection
• Toxicity detection / Trolling Behavior Detection
• Procedural Content Generation (PCG)

22. (More details) PCG in Games

23. pixel-sprite-generator
PCG in Games(More details)

24. deep-photo-styletransfer
PCG in other applications
Cornellians explores
visually what can be done
in the category of AI style
transfer

25. AI Research
• Bot / NPC
• Strength : For Victory !
• Believability : Human-like AI
• Adaptability : Dynamic Difficulty Adjustment
Research on Games
• Behavior Detection
• Toxicity detection / Trolling Behavior Detection
• Content Generation
• Audience Participation Games

26. Twitch Plays Pokémon
Audience Participation Games
https://www.twitch.tv/twitchplayspokemon
https://www.twitch.tv/videos/43378997
(More details)

27. AI Research
• Bot / NPC
• Strength : For Victory !
• Believability : Human-like AI
• Adaptability : Dynamic Difficulty Adjustment
Research on Games
• Behavior Detection
• Toxicity detection / Trolling Behavior Detection
Games for Health
• Physical
• Emotion
• Social
• Content Generation
• Audience Participation Games

28. Games for Health:
Physical
Rehab Game
https://news.usc.edu/48534/a-gem-of-a-game-for-amputees/
Exergame
ZOMBIES, RUN!
(More details)

29. 29
Games for Health:
Emotion
Nevermind can sense a
player’s facial expressions for
signs of emotional distress.
Nevermind uses biofeedback
to make the game more
surreal and challenging when
players feel scared or nervous.
(More details)

30. Games for Health:
Social
Walking Campaign (2017)
• a complete certificate
• Lottery prizes such as
travel tickets.
• etc.
Course (10 days)
• 5 persons completed goal 200 km course
• 3 people to complete goal 120 km course
600 yen × 3 people
600 yen × 5 people
Population 120,000
700 Participants
(More details)

31. Games for Health:
Social
REFERENCES
Improving Relationships between
Parents and Children in Shopping
Malls by Using a Digital Treasure
Hunting Game
Iga N, Wakao A, Matsumura K, Lopez-Gulliver R, Noma H. Improving Relationships
between Parents and Children in Shopping Malls by Using a Digital Treasure Hunting
Game. InExtended Abstracts Publication of the Annual Symposium on Computer-Human
Interaction in Play 2017 Oct 15 (pp. 261-267). ACM.
(More details)

32. Game AI Competition

33. CIG CONFERENCE

34. • AIBIRDS Angry Birds AI Competition
• Angry Birds AI Competition, http://aibirds.org/
• M. Stephenson, J. Renz, X. Ge and P. Zhang: The 2017 AIBIRDS Competition, arXiv:1803.05156
arXiv:1803.05156v1 (2018)
• AIBIRDS Level Generation Competition
• AIBIRDS Level Generatioin Competition, https://aibirds.org/other-events/level-generation-
competition.html
• M. Stephenson, J. Renz, X. Ge, L. N. Ferreira, J. Togelius and P. Zhang: The 2017 AIBIRDS Level
Generation Competition, in IEEE Transactions on Games.doi: 10.1109/TG.2018.2854896 (2018)
•
Angry Bird

35. FightingICE

36. FightingICE
http://www.ice.ci.ritsumei.ac.jp/~ftgaic/

37. http://www.ice.ci.ritsumei.ac.jp/~ftgaic/index-2a.html

38. The 3 stages

39. TO STUDY
3 main AIs
• Random
• Copy
• Machete