The number of applications of deep neural networks has multiplied in the last couple of years. Neural nets has enabled significant breakthroughs in everything from computer vision, voice generation, voice recognition, translation, and self-driving cars. Neural nets will also be an powerful enabler for future game development. This presentation will give an overview of the potential of neural nets in game development, as well as provide an in depth look at how we can use neural nets combined with reinforcement learning for new types of game AI.

1. Deep Learning
for
Game Development
Magnus Nordin
Technical Director, EA SEED

4. Future Worlds
Deep LearningVirtual Humans
Prototypes

5. f( ) = cat

6. f( ) =
f( ) =
”A person flying a kite
on a beach”
”A coffee, please.”

7. f( ) =”A coffee, please.”
f( ) =

8. f( ) =This bird is red and brown in
color, with a stubby beak
f( ) =This flower is pink, white,
and yellow in color, and
has petals that are striped
StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networks, Zhang et al, 2016

9. f( ) =

10. Reinforcement Learning
for
Game AI

11. 1987 2015

12. Reinforcement Learning
Observations/Rewards
Agent
Environment
Goal
Actions
Learning by doing

13. Bad Balls
Our hero
Eat! +1 point
Avoid! -5 points

17. EA Trailer

21. Single-Action vs Multi-Action

22. Objective area
The agent
Health
The opposition
Supplies

23. 50M steps of training

25. 100M steps of training

28. Generalization

30. Challenges
Observation (vision vs state)
Combining with classical game AI
Giving designers control
Goals
Imitation
Execution (GPUs are typically busy with graphics ☺)

31. Machine Learning Gaming Use Cases

33. Physics
Physics Forests: Real-time Fluid Simulation using Machine Learning, Ladicky et al., 2015, www.physicsforests.com

34. GAN geometry
Interactive Example Based Terrain Authoring with Conditional Adversarial Networks, Guérin et al, 2017

35. Representation Learning and Adversarial Generation of 3D Point Clouds, Achlioptas et al., 2017

36. • Needs to be Full of Life (Spore connection?)

37. Emergence of Locomotion Behaviours in Rich Environments, Heess et al., 2017

38. El último vals
A Neural Parametric Singing Synthesizer, Blaauw & Bonada, 2017

39. Audio-Driven Facial Animation by Joint End-to-End Learning of Pose and Emotion, Karras et al., 2017, NVIDIA

40. The Future

42. Geek & Sundry, D&Diesel

43. [clip]
• Live role playing

44. MMORPG

45. MMO(RPG)s
• Not much RPG [pic of WoW raid]
• hence ”MMOs”

46. True Role Playing

48. f( ) =
f( ) =

49. Sopranos © HBO 2006

50. Games will change more in
the next 5 years than they
have in the last 45 years
Magnus Nordin
Technical Director, EA SEED