Runner Games
Playing a class of Game using CNN
Focus on Runner Games
Jimut Bahan Pal1
1Department of Computer Science
Ramakrishna Mission Vivekananda Educational and Research Institute
A presentation for Communicative English course
Runner Games
Table of Contents
1 Introduction
2 Selection of a wrong game!
3 Why pong failed?
4 Discovering a new Class of Runner Games
5 Results for the Dino game
6 Conclusion
7 Acknowledgements
8 References
Runner Games
Introduction
Table of Contents
1 Introduction
2 Selection of a wrong game!
3 Why pong failed?
4 Discovering a new Class of Runner Games
5 Results for the Dino game
6 Conclusion
7 Acknowledgements
8 References
Runner Games
Introduction
Introduction
This was a pet project during my 2nd year on St. Xavier’s College!
Motivation
Figure: Indranil and Harrison
Runner Games
Introduction
Introduction
This was a pet project during my 2nd year on St. Xavier’s College!
Motivation
Figure: Indranil and Harrison
CNN - to analyze visual imagery, face detection, earlier
application include detection of numbers for post cards (Yann
Lee Cunn)
Runner Games
Introduction
Introduction
This was a pet project during my 2nd year on St. Xavier’s College!
Motivation
Figure: Indranil and Harrison
CNN - to analyze visual imagery, face detection, earlier
application include detection of numbers for post cards (Yann
Lee Cunn)
Cifar 10 model, 80% accuracy in 2010 on CIFAR-10 dataset
Runner Games
Introduction
Introduction
This was a pet project during my 2nd year on St. Xavier’s College!
Motivation
Figure: Indranil and Harrison
CNN - to analyze visual imagery, face detection, earlier
application include detection of numbers for post cards (Yann
Lee Cunn)
Cifar 10 model, 80% accuracy in 2010 on CIFAR-10 dataset
Can we make something innovative using simple technology?!
Runner Games
Introduction
Figure: The famous CIFAR-10 model which we used for training
Runner Games
Selection of a wrong game!
Table of Contents
1 Introduction
2 Selection of a wrong game!
3 Why pong failed?
4 Discovering a new Class of Runner Games
5 Results for the Dino game
6 Conclusion
7 Acknowledgements
8 References
Runner Games
Selection of a wrong game!
Selection of a wrong game!
The game that came to our mind - PONG!
Pong - Simplest table tennis video game from 1972 atari console.
Figure: Uprighted Cabinet of Pong
Runner Games
Selection of a wrong game!
Selection of a wrong game!
The game that came to our mind - PONG!
Pong - Simplest table tennis video game from 1972 atari console.
Figure: Our JS implementation of Pong
Runner Games
Selection of a wrong game!
Figure: Data used in training of Pong Game: Frames and corresponding
action values (0 - down and 1 - up)
Runner Games
Selection of a wrong game!
Figure: When training in Google Collaboratory Platform
Runner Games
Selection of a wrong game!
Figure: A simple hack to never stop collaboratory running
Runner Games
Selection of a wrong game!
Figure: Loss and accuracy of the Pong game trained with 2K images
Runner Games
Selection of a wrong game!
Figure: Loss and accuracy of the Pong game when trained with 30K
images
Runner Games
Why pong failed?
Table of Contents
1 Introduction
2 Selection of a wrong game!
3 Why pong failed?
4 Discovering a new Class of Runner Games
5 Results for the Dino game
6 Conclusion
7 Acknowledgements
8 References
Runner Games
Why pong failed?
Why pong failed?
Pong’s Computer counterpart is a robot not an AI, it just calculates
according to coordinates of the ball. We needed human touch!
More data more accuracy, what is wrong?
Runner Games
Why pong failed?
Why pong failed?
Pong’s Computer counterpart is a robot not an AI, it just calculates
according to coordinates of the ball. We needed human touch!
More data more accuracy, what is wrong?
We trained the model using Google’s free collaboratory
platform, which gives free GPU and is computationally
effective.
Runner Games
Why pong failed?
Why pong failed?
Pong’s Computer counterpart is a robot not an AI, it just calculates
according to coordinates of the ball. We needed human touch!
More data more accuracy, what is wrong?
We trained the model using Google’s free collaboratory
platform, which gives free GPU and is computationally
effective.
Guess the move by looking at the Pong’s picture
Runner Games
Discovering a new Class of Runner Games
Table of Contents
1 Introduction
2 Selection of a wrong game!
3 Why pong failed?
4 Discovering a new Class of Runner Games
5 Results for the Dino game
6 Conclusion
7 Acknowledgements
8 References
Runner Games
Discovering a new Class of Runner Games
Runner Games
Runner games are those kind of games which have a definite move
for every instance of the environment
Figure: Famous Dino game!
Runner Games
Discovering a new Class of Runner Games
Runner Games
Runner games are those kind of games which have a definite move
for every instance of the environment
Figure: Famous flappy bird game!
Runner Games
Discovering a new Class of Runner Games
Runner Games
Runner games are those kind of games which have a definite move
for every instance of the environment
Figure: Asphalt overdrive game
Runner Games
Discovering a new Class of Runner Games
Runner Games
Runner games are those kind of games which have a definite move
for every instance of the environment
Figure: Famous Temple run game
Runner Games
Discovering a new Class of Runner Games
Runner Games
Runner games are those kind of games which have a definite move
for every instance of the environment
Figure: The Road Rash
Runner Games
Discovering a new Class of Runner Games
Runner Games
Runner games are those kind of games which have a definite move
for every instance of the environment
Figure: A custom made game named ”Balancer”
Runner Games
Discovering a new Class of Runner Games
Figure: Data used in training of Dino Game: Frames and corresponding
action values (0 - nothing and 1 - up)
Runner Games
Results for the Dino game
Table of Contents
1 Introduction
2 Selection of a wrong game!
3 Why pong failed?
4 Discovering a new Class of Runner Games
5 Results for the Dino game
6 Conclusion
7 Acknowledgements
8 References
Runner Games
Results for the Dino game
Results for the Dino game
The results obtained are satisfactory. It performed well and runs
genuinely with 90% accuracy. From these results we can conclude
that certain class of games performs well with just a simple
technology like CNN.
Accuracy obtained from Dino game training
Runner Games
Results for the Dino game
Results for the Dino game
The results obtained are satisfactory. It performed well and runs
genuinely with 90% accuracy. From these results we can conclude
that certain class of games performs well with just a simple
technology like CNN.
Loss from the dino game training
Runner Games
Conclusion
Table of Contents
1 Introduction
2 Selection of a wrong game!
3 Why pong failed?
4 Discovering a new Class of Runner Games
5 Results for the Dino game
6 Conclusion
7 Acknowledgements
8 References
Runner Games
Conclusion
Conclusion
Modern technologies and algorithms like Reccurrent Neural
Network, Reinforcement Learning, Genetic algorithms are more
powerful than the method that was implemented. We will
implement these in the Dino game in the near future. The YOLO
works on this exact same model, i.e., extract frames from the video
and predict from those taken pictures.
Runner Games
Acknowledgements
Table of Contents
1 Introduction
2 Selection of a wrong game!
3 Why pong failed?
4 Discovering a new Class of Runner Games
5 Results for the Dino game
6 Conclusion
7 Acknowledgements
8 References
Runner Games
Acknowledgements
Acknowledgements
I acknowledge the help recieved from Tamal Maharaj, Prof.
Janardan Ghosh, Indranil Das and Harrison Kinseley for their
suggestions and discussions.
Runner Games
References
Table of Contents
1 Introduction
2 Selection of a wrong game!
3 Why pong failed?
4 Discovering a new Class of Runner Games
5 Results for the Dino game
6 Conclusion
7 Acknowledgements
8 References
Runner Games
References
References
Pal, J.B., (2019), Playing a class of games using CNN, Blog
in github pages,
https://jimut123.github.io/blogs/cnn games ai.html available
on the web, last accessed on 14-11-2019 .
Kinseley, H., (2017), Python Plays GTA V, Tutorial in
https://pythonprogramming.net/game-frames-open-cv-
python-plays-gta-v/ available on the web, last accessed on
14-11-2019 .
Runner Games
References
Thank Youjimutbahanpal@{gmail,yahoo,outlook}.com

CNN Games

  • 1.
    Runner Games Playing aclass of Game using CNN Focus on Runner Games Jimut Bahan Pal1 1Department of Computer Science Ramakrishna Mission Vivekananda Educational and Research Institute A presentation for Communicative English course
  • 2.
    Runner Games Table ofContents 1 Introduction 2 Selection of a wrong game! 3 Why pong failed? 4 Discovering a new Class of Runner Games 5 Results for the Dino game 6 Conclusion 7 Acknowledgements 8 References
  • 3.
    Runner Games Introduction Table ofContents 1 Introduction 2 Selection of a wrong game! 3 Why pong failed? 4 Discovering a new Class of Runner Games 5 Results for the Dino game 6 Conclusion 7 Acknowledgements 8 References
  • 4.
    Runner Games Introduction Introduction This wasa pet project during my 2nd year on St. Xavier’s College! Motivation Figure: Indranil and Harrison
  • 5.
    Runner Games Introduction Introduction This wasa pet project during my 2nd year on St. Xavier’s College! Motivation Figure: Indranil and Harrison CNN - to analyze visual imagery, face detection, earlier application include detection of numbers for post cards (Yann Lee Cunn)
  • 6.
    Runner Games Introduction Introduction This wasa pet project during my 2nd year on St. Xavier’s College! Motivation Figure: Indranil and Harrison CNN - to analyze visual imagery, face detection, earlier application include detection of numbers for post cards (Yann Lee Cunn) Cifar 10 model, 80% accuracy in 2010 on CIFAR-10 dataset
  • 7.
    Runner Games Introduction Introduction This wasa pet project during my 2nd year on St. Xavier’s College! Motivation Figure: Indranil and Harrison CNN - to analyze visual imagery, face detection, earlier application include detection of numbers for post cards (Yann Lee Cunn) Cifar 10 model, 80% accuracy in 2010 on CIFAR-10 dataset Can we make something innovative using simple technology?!
  • 8.
    Runner Games Introduction Figure: Thefamous CIFAR-10 model which we used for training
  • 9.
    Runner Games Selection ofa wrong game! Table of Contents 1 Introduction 2 Selection of a wrong game! 3 Why pong failed? 4 Discovering a new Class of Runner Games 5 Results for the Dino game 6 Conclusion 7 Acknowledgements 8 References
  • 10.
    Runner Games Selection ofa wrong game! Selection of a wrong game! The game that came to our mind - PONG! Pong - Simplest table tennis video game from 1972 atari console. Figure: Uprighted Cabinet of Pong
  • 11.
    Runner Games Selection ofa wrong game! Selection of a wrong game! The game that came to our mind - PONG! Pong - Simplest table tennis video game from 1972 atari console. Figure: Our JS implementation of Pong
  • 12.
    Runner Games Selection ofa wrong game! Figure: Data used in training of Pong Game: Frames and corresponding action values (0 - down and 1 - up)
  • 13.
    Runner Games Selection ofa wrong game! Figure: When training in Google Collaboratory Platform
  • 14.
    Runner Games Selection ofa wrong game! Figure: A simple hack to never stop collaboratory running
  • 15.
    Runner Games Selection ofa wrong game! Figure: Loss and accuracy of the Pong game trained with 2K images
  • 16.
    Runner Games Selection ofa wrong game! Figure: Loss and accuracy of the Pong game when trained with 30K images
  • 17.
    Runner Games Why pongfailed? Table of Contents 1 Introduction 2 Selection of a wrong game! 3 Why pong failed? 4 Discovering a new Class of Runner Games 5 Results for the Dino game 6 Conclusion 7 Acknowledgements 8 References
  • 18.
    Runner Games Why pongfailed? Why pong failed? Pong’s Computer counterpart is a robot not an AI, it just calculates according to coordinates of the ball. We needed human touch! More data more accuracy, what is wrong?
  • 19.
    Runner Games Why pongfailed? Why pong failed? Pong’s Computer counterpart is a robot not an AI, it just calculates according to coordinates of the ball. We needed human touch! More data more accuracy, what is wrong? We trained the model using Google’s free collaboratory platform, which gives free GPU and is computationally effective.
  • 20.
    Runner Games Why pongfailed? Why pong failed? Pong’s Computer counterpart is a robot not an AI, it just calculates according to coordinates of the ball. We needed human touch! More data more accuracy, what is wrong? We trained the model using Google’s free collaboratory platform, which gives free GPU and is computationally effective. Guess the move by looking at the Pong’s picture
  • 21.
    Runner Games Discovering anew Class of Runner Games Table of Contents 1 Introduction 2 Selection of a wrong game! 3 Why pong failed? 4 Discovering a new Class of Runner Games 5 Results for the Dino game 6 Conclusion 7 Acknowledgements 8 References
  • 22.
    Runner Games Discovering anew Class of Runner Games Runner Games Runner games are those kind of games which have a definite move for every instance of the environment Figure: Famous Dino game!
  • 23.
    Runner Games Discovering anew Class of Runner Games Runner Games Runner games are those kind of games which have a definite move for every instance of the environment Figure: Famous flappy bird game!
  • 24.
    Runner Games Discovering anew Class of Runner Games Runner Games Runner games are those kind of games which have a definite move for every instance of the environment Figure: Asphalt overdrive game
  • 25.
    Runner Games Discovering anew Class of Runner Games Runner Games Runner games are those kind of games which have a definite move for every instance of the environment Figure: Famous Temple run game
  • 26.
    Runner Games Discovering anew Class of Runner Games Runner Games Runner games are those kind of games which have a definite move for every instance of the environment Figure: The Road Rash
  • 27.
    Runner Games Discovering anew Class of Runner Games Runner Games Runner games are those kind of games which have a definite move for every instance of the environment Figure: A custom made game named ”Balancer”
  • 28.
    Runner Games Discovering anew Class of Runner Games Figure: Data used in training of Dino Game: Frames and corresponding action values (0 - nothing and 1 - up)
  • 29.
    Runner Games Results forthe Dino game Table of Contents 1 Introduction 2 Selection of a wrong game! 3 Why pong failed? 4 Discovering a new Class of Runner Games 5 Results for the Dino game 6 Conclusion 7 Acknowledgements 8 References
  • 30.
    Runner Games Results forthe Dino game Results for the Dino game The results obtained are satisfactory. It performed well and runs genuinely with 90% accuracy. From these results we can conclude that certain class of games performs well with just a simple technology like CNN. Accuracy obtained from Dino game training
  • 31.
    Runner Games Results forthe Dino game Results for the Dino game The results obtained are satisfactory. It performed well and runs genuinely with 90% accuracy. From these results we can conclude that certain class of games performs well with just a simple technology like CNN. Loss from the dino game training
  • 32.
    Runner Games Conclusion Table ofContents 1 Introduction 2 Selection of a wrong game! 3 Why pong failed? 4 Discovering a new Class of Runner Games 5 Results for the Dino game 6 Conclusion 7 Acknowledgements 8 References
  • 33.
    Runner Games Conclusion Conclusion Modern technologiesand algorithms like Reccurrent Neural Network, Reinforcement Learning, Genetic algorithms are more powerful than the method that was implemented. We will implement these in the Dino game in the near future. The YOLO works on this exact same model, i.e., extract frames from the video and predict from those taken pictures.
  • 34.
    Runner Games Acknowledgements Table ofContents 1 Introduction 2 Selection of a wrong game! 3 Why pong failed? 4 Discovering a new Class of Runner Games 5 Results for the Dino game 6 Conclusion 7 Acknowledgements 8 References
  • 35.
    Runner Games Acknowledgements Acknowledgements I acknowledgethe help recieved from Tamal Maharaj, Prof. Janardan Ghosh, Indranil Das and Harrison Kinseley for their suggestions and discussions.
  • 36.
    Runner Games References Table ofContents 1 Introduction 2 Selection of a wrong game! 3 Why pong failed? 4 Discovering a new Class of Runner Games 5 Results for the Dino game 6 Conclusion 7 Acknowledgements 8 References
  • 37.
    Runner Games References References Pal, J.B.,(2019), Playing a class of games using CNN, Blog in github pages, https://jimut123.github.io/blogs/cnn games ai.html available on the web, last accessed on 14-11-2019 . Kinseley, H., (2017), Python Plays GTA V, Tutorial in https://pythonprogramming.net/game-frames-open-cv- python-plays-gta-v/ available on the web, last accessed on 14-11-2019 .
  • 38.