Michael Allen gave an introduction to AWS DeepRacer. DeepRacer is a 1/18th scale race car that runs on neural networks trained using reinforcement learning. Morningstar plans to use DeepRacer to teach over 1,200 technologists about Amazon Web Services and machine learning. Morningstar has ordered 30 DeepRacer cars that will be shipped to 7 countries, where tracks will be built and basic training provided. Technologists will then compete in teams in a global competition to design car bodies and race in the re:Invent competition later this year. The benefits will include upskilling teams and enhancing collaboration across locations.
7. 7
What are we going to do with DeepRacer?
• Goal: Teach 1200+ technologists in 7 different countries about Amazon Web Services and Machine Learning
• How?
• 30+ cars on pre-order with Amazon
• Cars will be shipped to 7 different countries
• Tracks will be built in every location
• Basic training will be delivered by Morningstar and AWS
• Technologists will have the opportunity to compete (as part of a team) in a global competition
• Car body design competition
• Winner of internal competition will compete in global re:Invent competition later this year
8. 8
Benefits of DeepRacer Competition
• Teams that are not working directly with Amazon AWS will be provided
with the opportunity
• Teams will be given time to upskill and learn about important AI / Machine
learning concepts
• Will enhance team building and collaboration across geographic locations
(Chicago, Shenzhen, Mumbai, Toronto, London, New York, Seattle)
9. 9
Types of Machine Learning
Supervised
Learning
Unsupervised
Learning
Reinforcement
Learning
Machine Learning
Our Focus
• Each input is pared with a desired output value
• Machine is trained on past data
• Used for predictive analysis
• Tries to find hidden structure in
unlabeled data
• Does not predict or find anything
specific
10. 10
What is reinforcement learning?
Reinforcement learning (RL) is an area of machine learning concerned
with how agents ought to take actions in an environment so as to
maximize some notion of cumulative reward. (source Wikipedia)
11. 11
▪ Amazon SageMaker is a service that
enables a developer to build and train
machine learning models for predictive or
analytical applications in the Amazon Web
Services (AWS) public cloud
▪ AWS RoboMaker is a service that makes
it easy to create robotics applications at
scale. AWS RoboMaker extends the
Robot Operating System (ROS) framework
with cloud services. This includes AWS
machine learning services.
DeepRacer Simulation Architecture
* source: Amazon Web Services