SlideShare a Scribd company logo
1 of 25
Download to read offline
©2019 Morningstar. All Rights Reserved.
Michael Allen
Introduction to AWS DeepRacer
Developers, start your engines
2-28-2019
2
Introduction
2
• About me:
• Contact: Michael.Allen@morningstar.com / @mikeoninfosec
• Current: CIO Morningstar, OWASP Chicago Chapter Leader
• Past: CISO, security architect, software developer, founder
• I am not a machine learning expert
3
Overview
3
• What is DeepRacer?
• How we plan on using it at Morningstar
• Types of Machine Learning
• How does DeepRacer work?
• Demo
4
What is DeepRacer?
5
Fun fact – it runs solitaire!
6
diyrobocars.com
7
What are we going to do with DeepRacer?
• Goal: Teach 1200+ technologists in 7 different countries about Amazon Web Services and Machine Learning
• How?
• 30+ cars on pre-order with Amazon
• Cars will be shipped to 7 different countries
• Tracks will be built in every location
• Basic training will be delivered by Morningstar and AWS
• Technologists will have the opportunity to compete (as part of a team) in a global competition
• Car body design competition
• Winner of internal competition will compete in global re:Invent competition later this year
8
Benefits of DeepRacer Competition
• Teams that are not working directly with Amazon AWS will be provided
with the opportunity
• Teams will be given time to upskill and learn about important AI / Machine
learning concepts
• Will enhance team building and collaboration across geographic locations
(Chicago, Shenzhen, Mumbai, Toronto, London, New York, Seattle)
9
Types of Machine Learning
Supervised
Learning
Unsupervised
Learning
Reinforcement
Learning
Machine Learning
Our Focus
• Each input is pared with a desired output value
• Machine is trained on past data
• Used for predictive analysis
• Tries to find hidden structure in
unlabeled data
• Does not predict or find anything
specific
10
What is reinforcement learning?
Reinforcement learning (RL) is an area of machine learning concerned
with how agents ought to take actions in an environment so as to
maximize some notion of cumulative reward. (source Wikipedia)
11
▪ Amazon SageMaker is a service that
enables a developer to build and train
machine learning models for predictive or
analytical applications in the Amazon Web
Services (AWS) public cloud
▪ AWS RoboMaker is a service that makes
it easy to create robotics applications at
scale. AWS RoboMaker extends the
Robot Operating System (ROS) framework
with cloud services. This includes AWS
machine learning services.
DeepRacer Simulation Architecture
* source: Amazon Web Services
12
DeepRacer Console - Preview
* source: Amazon Web Services
13
Reward Function Example
* source: Amazon Web Services
14
▪ Change parameters within the
reward function to maximize the
performance of your model and
shorten your time around the track
Reward Function
15
The Track
* source: Amazon Web Services
16
The full process
* source: Amazon Web Services
17
DEMO TIME
18
What does 6 hours of training cost?
19
DeepRacer Overview: https://aws.amazon.com/deepracer/
DeepRacer Getting Started Guide: https://aws.amazon.com/deepracer/getting-started/
Great Neural Network / Deep Learning Videos: https://www.youtube.com/watch?v=aircAruvnKk
DIY Robo Car – https://diyrobocars.com/
Careers@Morningstar: https://www.morningstar.com/careers
Helpful Links
20
Thank you!
Michael.Allen@Morningstar.com
Questions?
21
22
23
24
©2019 Morningstar. All Rights Reserved.

More Related Content

What's hot

What's hot (20)

Build accurate training datasets with Amazon SageMaker Ground Truth - AIM301 ...
Build accurate training datasets with Amazon SageMaker Ground Truth - AIM301 ...Build accurate training datasets with Amazon SageMaker Ground Truth - AIM301 ...
Build accurate training datasets with Amazon SageMaker Ground Truth - AIM301 ...
 
AWS IoT services - Extract value for industrial applications - SVC205 - Santa...
AWS IoT services - Extract value for industrial applications - SVC205 - Santa...AWS IoT services - Extract value for industrial applications - SVC205 - Santa...
AWS IoT services - Extract value for industrial applications - SVC205 - Santa...
 
AWS 如何加速國際化發展
AWS 如何加速國際化發展AWS 如何加速國際化發展
AWS 如何加速國際化發展
 
Customizing AWS DeepRacer Action Space
Customizing AWS DeepRacer Action SpaceCustomizing AWS DeepRacer Action Space
Customizing AWS DeepRacer Action Space
 
Build sophisticated forecasting & recommendation models - AIM204 - Santa Clar...
Build sophisticated forecasting & recommendation models - AIM204 - Santa Clar...Build sophisticated forecasting & recommendation models - AIM204 - Santa Clar...
Build sophisticated forecasting & recommendation models - AIM204 - Santa Clar...
 
Castles in Castles - Secure Operational Scale - AWS Summit Sydney
Castles in Castles - Secure Operational Scale - AWS Summit SydneyCastles in Castles - Secure Operational Scale - AWS Summit Sydney
Castles in Castles - Secure Operational Scale - AWS Summit Sydney
 
How to truly delegate within an account with permission boundaries - SEC301 -...
How to truly delegate within an account with permission boundaries - SEC301 -...How to truly delegate within an account with permission boundaries - SEC301 -...
How to truly delegate within an account with permission boundaries - SEC301 -...
 
Demystifying Machine Learning On AWS - AWS Summit Sydney 2018
Demystifying Machine Learning On AWS - AWS Summit Sydney 2018Demystifying Machine Learning On AWS - AWS Summit Sydney 2018
Demystifying Machine Learning On AWS - AWS Summit Sydney 2018
 
Aws certification training course1
Aws certification training course1Aws certification training course1
Aws certification training course1
 
Bank of Alexa - Personalized Banking Experience via Voice
Bank of Alexa - Personalized Banking Experience via VoiceBank of Alexa - Personalized Banking Experience via Voice
Bank of Alexa - Personalized Banking Experience via Voice
 
Aws training in bhubaneswar
Aws training in bhubaneswarAws training in bhubaneswar
Aws training in bhubaneswar
 
AWS Summit Singapore 2019 | Delivering a Million Stories Across Asia - insigh...
AWS Summit Singapore 2019 | Delivering a Million Stories Across Asia - insigh...AWS Summit Singapore 2019 | Delivering a Million Stories Across Asia - insigh...
AWS Summit Singapore 2019 | Delivering a Million Stories Across Asia - insigh...
 
Migration to AWS: The foundation for enterprise transformation - SVC210 - New...
Migration to AWS: The foundation for enterprise transformation - SVC210 - New...Migration to AWS: The foundation for enterprise transformation - SVC210 - New...
Migration to AWS: The foundation for enterprise transformation - SVC210 - New...
 
Best Friends Animal Society saves puppies (and data) with N2WS & AWS - SVC211...
Best Friends Animal Society saves puppies (and data) with N2WS & AWS - SVC211...Best Friends Animal Society saves puppies (and data) with N2WS & AWS - SVC211...
Best Friends Animal Society saves puppies (and data) with N2WS & AWS - SVC211...
 
[AWS Techshift] Innovation and AI/ML Sagemaker Build-in 머신러닝 모델 활용 및 Marketpl...
[AWS Techshift] Innovation and AI/ML Sagemaker Build-in 머신러닝 모델 활용 및 Marketpl...[AWS Techshift] Innovation and AI/ML Sagemaker Build-in 머신러닝 모델 활용 및 Marketpl...
[AWS Techshift] Innovation and AI/ML Sagemaker Build-in 머신러닝 모델 활용 및 Marketpl...
 
Machine Learning in Practice
Machine Learning in PracticeMachine Learning in Practice
Machine Learning in Practice
 
Favorire l'innovazione passando da applicazioni monolitiche ad architetture m...
Favorire l'innovazione passando da applicazioni monolitiche ad architetture m...Favorire l'innovazione passando da applicazioni monolitiche ad architetture m...
Favorire l'innovazione passando da applicazioni monolitiche ad architetture m...
 
Web designing course in hyderabadd
Web designing course in hyderabaddWeb designing course in hyderabadd
Web designing course in hyderabadd
 
Using Mobile to Engage Your Audience
Using Mobile to Engage Your AudienceUsing Mobile to Engage Your Audience
Using Mobile to Engage Your Audience
 
APN-live-hk-opening
APN-live-hk-openingAPN-live-hk-opening
APN-live-hk-opening
 

Similar to Michael Allen's AWS user group talk ""Developers, Start Your Engines - Hands on with AWS DeepRacer"

Track 2 Session 5_ 利用 SageMaker 深度學習容器化在廣告推播之應用
Track 2 Session 5_ 利用 SageMaker 深度學習容器化在廣告推播之應用Track 2 Session 5_ 利用 SageMaker 深度學習容器化在廣告推播之應用
Track 2 Session 5_ 利用 SageMaker 深度學習容器化在廣告推播之應用
Amazon Web Services
 
Using AI To Place VMs On Hypervisors
Using AI To Place VMs On HypervisorsUsing AI To Place VMs On Hypervisors
Using AI To Place VMs On Hypervisors
ShapeBlue
 

Similar to Michael Allen's AWS user group talk ""Developers, Start Your Engines - Hands on with AWS DeepRacer" (20)

Canada DevOps Summit 2020 Presentation Nov_03_2020
Canada DevOps Summit 2020 Presentation Nov_03_2020Canada DevOps Summit 2020 Presentation Nov_03_2020
Canada DevOps Summit 2020 Presentation Nov_03_2020
 
AWS Stockholm Meetup June 2019 - Cybercom DeepRacer story
AWS Stockholm Meetup June 2019 - Cybercom DeepRacer storyAWS Stockholm Meetup June 2019 - Cybercom DeepRacer story
AWS Stockholm Meetup June 2019 - Cybercom DeepRacer story
 
Track 2 Session 5_ 利用 SageMaker 深度學習容器化在廣告推播之應用
Track 2 Session 5_ 利用 SageMaker 深度學習容器化在廣告推播之應用Track 2 Session 5_ 利用 SageMaker 深度學習容器化在廣告推播之應用
Track 2 Session 5_ 利用 SageMaker 深度學習容器化在廣告推播之應用
 
AI & AWS DeepComposer
AI & AWS DeepComposerAI & AWS DeepComposer
AI & AWS DeepComposer
 
Introduction to Sagemaker
Introduction to SagemakerIntroduction to Sagemaker
Introduction to Sagemaker
 
AWS Finland Meetup June 2019 - DeepRacer story
AWS Finland Meetup June 2019 - DeepRacer storyAWS Finland Meetup June 2019 - DeepRacer story
AWS Finland Meetup June 2019 - DeepRacer story
 
Final year internship presentation
Final year internship presentationFinal year internship presentation
Final year internship presentation
 
Breaking Up the Monolith While Migrating to AWS (GPSTEC320) - AWS re:Invent 2018
Breaking Up the Monolith While Migrating to AWS (GPSTEC320) - AWS re:Invent 2018Breaking Up the Monolith While Migrating to AWS (GPSTEC320) - AWS re:Invent 2018
Breaking Up the Monolith While Migrating to AWS (GPSTEC320) - AWS re:Invent 2018
 
AIM102-S_Cognizant_CognizantCognitive
AIM102-S_Cognizant_CognizantCognitiveAIM102-S_Cognizant_CognizantCognitive
AIM102-S_Cognizant_CognizantCognitive
 
Supercharge your Machine Learning Solutions with Amazon SageMaker
Supercharge your Machine Learning Solutions with Amazon SageMakerSupercharge your Machine Learning Solutions with Amazon SageMaker
Supercharge your Machine Learning Solutions with Amazon SageMaker
 
Introduction to Google App Engine
Introduction to Google App EngineIntroduction to Google App Engine
Introduction to Google App Engine
 
Using AI To Place VMs On Hypervisors
Using AI To Place VMs On HypervisorsUsing AI To Place VMs On Hypervisors
Using AI To Place VMs On Hypervisors
 
Introducing Amazon SageMaker
Introducing Amazon SageMakerIntroducing Amazon SageMaker
Introducing Amazon SageMaker
 
GAIBT Cleveland - Personalizer.pptx
GAIBT Cleveland - Personalizer.pptxGAIBT Cleveland - Personalizer.pptx
GAIBT Cleveland - Personalizer.pptx
 
Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...
Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...
Build Intelligent Conversational Agents with Amazon Neptune and Amazon SageMa...
 
Resume
ResumeResume
Resume
 
CI or FS Poly Cleared Job Fair Handbook | September 8
CI or FS Poly Cleared Job Fair Handbook | September 8CI or FS Poly Cleared Job Fair Handbook | September 8
CI or FS Poly Cleared Job Fair Handbook | September 8
 
ML Workflows with Amazon SageMaker and AWS Step Functions (API325) - AWS re:I...
ML Workflows with Amazon SageMaker and AWS Step Functions (API325) - AWS re:I...ML Workflows with Amazon SageMaker and AWS Step Functions (API325) - AWS re:I...
ML Workflows with Amazon SageMaker and AWS Step Functions (API325) - AWS re:I...
 
Exploring Cloud Computing with Amazon Web Services (AWS)
Exploring Cloud Computing with Amazon Web Services (AWS)Exploring Cloud Computing with Amazon Web Services (AWS)
Exploring Cloud Computing with Amazon Web Services (AWS)
 
201908 Overview of Automated ML
201908 Overview of Automated ML201908 Overview of Automated ML
201908 Overview of Automated ML
 

More from AWS Chicago

More from AWS Chicago (20)

AWS reInvent 2023 recaps from Chicago AWS user group
AWS reInvent 2023 recaps from Chicago AWS user groupAWS reInvent 2023 recaps from Chicago AWS user group
AWS reInvent 2023 recaps from Chicago AWS user group
 
Chicago AWS Solutions Architect Mehdy Haghy recaps the new AI/ML releases and...
Chicago AWS Solutions Architect Mehdy Haghy recaps the new AI/ML releases and...Chicago AWS Solutions Architect Mehdy Haghy recaps the new AI/ML releases and...
Chicago AWS Solutions Architect Mehdy Haghy recaps the new AI/ML releases and...
 
WilliamCollins_Road-to-Transit-Gateway.pptx
WilliamCollins_Road-to-Transit-Gateway.pptxWilliamCollins_Road-to-Transit-Gateway.pptx
WilliamCollins_Road-to-Transit-Gateway.pptx
 
Suresh Poopandi_Generative AI On AWS-MidWestCommunityDay-Final.pdf
Suresh Poopandi_Generative AI On AWS-MidWestCommunityDay-Final.pdfSuresh Poopandi_Generative AI On AWS-MidWestCommunityDay-Final.pdf
Suresh Poopandi_Generative AI On AWS-MidWestCommunityDay-Final.pdf
 
Streamlined Entitlements with AWS Lake Formation - Anusha Dwivedula
Streamlined Entitlements with AWS Lake Formation - Anusha DwivedulaStreamlined Entitlements with AWS Lake Formation - Anusha Dwivedula
Streamlined Entitlements with AWS Lake Formation - Anusha Dwivedula
 
Steve Seaney_AWS Control Tower - 2023 Midwest Community Day - Final.pptx
Steve Seaney_AWS Control Tower - 2023 Midwest Community Day - Final.pptxSteve Seaney_AWS Control Tower - 2023 Midwest Community Day - Final.pptx
Steve Seaney_AWS Control Tower - 2023 Midwest Community Day - Final.pptx
 
Saurabh_Shanbhag - Building_SaaS_on_AWS.pptx
Saurabh_Shanbhag - Building_SaaS_on_AWS.pptxSaurabh_Shanbhag - Building_SaaS_on_AWS.pptx
Saurabh_Shanbhag - Building_SaaS_on_AWS.pptx
 
Sanket_Nasre_Simplify Modernization.pdf
Sanket_Nasre_Simplify Modernization.pdfSanket_Nasre_Simplify Modernization.pdf
Sanket_Nasre_Simplify Modernization.pdf
 
Ross Stuart_Using ML to Solve Lifes Problems.pptx
Ross Stuart_Using ML to Solve Lifes Problems.pptxRoss Stuart_Using ML to Solve Lifes Problems.pptx
Ross Stuart_Using ML to Solve Lifes Problems.pptx
 
robsable_Enhancing DevOps Practices with CloudWatch APM FINAL.pdf
robsable_Enhancing DevOps Practices with CloudWatch APM FINAL.pdfrobsable_Enhancing DevOps Practices with CloudWatch APM FINAL.pdf
robsable_Enhancing DevOps Practices with CloudWatch APM FINAL.pdf
 
Sanket_Nasre_Simplify Modernization.pdf
Sanket_Nasre_Simplify Modernization.pdfSanket_Nasre_Simplify Modernization.pdf
Sanket_Nasre_Simplify Modernization.pdf
 
Mohamed Wali_AWS Security Reference Architecture.pptx
Mohamed Wali_AWS Security Reference Architecture.pptxMohamed Wali_AWS Security Reference Architecture.pptx
Mohamed Wali_AWS Security Reference Architecture.pptx
 
Nick-Walter-HOB_Migrating_Dinosaurs.pptx
Nick-Walter-HOB_Migrating_Dinosaurs.pptxNick-Walter-HOB_Migrating_Dinosaurs.pptx
Nick-Walter-HOB_Migrating_Dinosaurs.pptx
 
Pat_Davies_AWSCostOptimization_Final.pdf
Pat_Davies_AWSCostOptimization_Final.pdfPat_Davies_AWSCostOptimization_Final.pdf
Pat_Davies_AWSCostOptimization_Final.pdf
 
MARK GAMBLE_ASC For Really Remote Edge Computing - AWS Community Day Chicago ...
MARK GAMBLE_ASC For Really Remote Edge Computing - AWS Community Day Chicago ...MARK GAMBLE_ASC For Really Remote Edge Computing - AWS Community Day Chicago ...
MARK GAMBLE_ASC For Really Remote Edge Computing - AWS Community Day Chicago ...
 
MichaelSoule-UsingJupyterNotebooks.pptx
MichaelSoule-UsingJupyterNotebooks.pptxMichaelSoule-UsingJupyterNotebooks.pptx
MichaelSoule-UsingJupyterNotebooks.pptx
 
Michal Brygidyn_CloudHackingScenarios.pdf
Michal Brygidyn_CloudHackingScenarios.pdfMichal Brygidyn_CloudHackingScenarios.pdf
Michal Brygidyn_CloudHackingScenarios.pdf
 
Kamil Kolodziejski_Structura-AWS.pptx
Kamil Kolodziejski_Structura-AWS.pptxKamil Kolodziejski_Structura-AWS.pptx
Kamil Kolodziejski_Structura-AWS.pptx
 
John Merline AWS Certification FAQ.pptx
John Merline AWS Certification FAQ.pptxJohn Merline AWS Certification FAQ.pptx
John Merline AWS Certification FAQ.pptx
 
JuliaFMorgado_Breaking_bad_habits.pptx
JuliaFMorgado_Breaking_bad_habits.pptxJuliaFMorgado_Breaking_bad_habits.pptx
JuliaFMorgado_Breaking_bad_habits.pptx
 

Recently uploaded

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 

Michael Allen's AWS user group talk ""Developers, Start Your Engines - Hands on with AWS DeepRacer"

  • 1. ©2019 Morningstar. All Rights Reserved. Michael Allen Introduction to AWS DeepRacer Developers, start your engines 2-28-2019
  • 2. 2 Introduction 2 • About me: • Contact: Michael.Allen@morningstar.com / @mikeoninfosec • Current: CIO Morningstar, OWASP Chicago Chapter Leader • Past: CISO, security architect, software developer, founder • I am not a machine learning expert
  • 3. 3 Overview 3 • What is DeepRacer? • How we plan on using it at Morningstar • Types of Machine Learning • How does DeepRacer work? • Demo
  • 5. 5 Fun fact – it runs solitaire!
  • 7. 7 What are we going to do with DeepRacer? • Goal: Teach 1200+ technologists in 7 different countries about Amazon Web Services and Machine Learning • How? • 30+ cars on pre-order with Amazon • Cars will be shipped to 7 different countries • Tracks will be built in every location • Basic training will be delivered by Morningstar and AWS • Technologists will have the opportunity to compete (as part of a team) in a global competition • Car body design competition • Winner of internal competition will compete in global re:Invent competition later this year
  • 8. 8 Benefits of DeepRacer Competition • Teams that are not working directly with Amazon AWS will be provided with the opportunity • Teams will be given time to upskill and learn about important AI / Machine learning concepts • Will enhance team building and collaboration across geographic locations (Chicago, Shenzhen, Mumbai, Toronto, London, New York, Seattle)
  • 9. 9 Types of Machine Learning Supervised Learning Unsupervised Learning Reinforcement Learning Machine Learning Our Focus • Each input is pared with a desired output value • Machine is trained on past data • Used for predictive analysis • Tries to find hidden structure in unlabeled data • Does not predict or find anything specific
  • 10. 10 What is reinforcement learning? Reinforcement learning (RL) is an area of machine learning concerned with how agents ought to take actions in an environment so as to maximize some notion of cumulative reward. (source Wikipedia)
  • 11. 11 ▪ Amazon SageMaker is a service that enables a developer to build and train machine learning models for predictive or analytical applications in the Amazon Web Services (AWS) public cloud ▪ AWS RoboMaker is a service that makes it easy to create robotics applications at scale. AWS RoboMaker extends the Robot Operating System (ROS) framework with cloud services. This includes AWS machine learning services. DeepRacer Simulation Architecture * source: Amazon Web Services
  • 12. 12 DeepRacer Console - Preview * source: Amazon Web Services
  • 13. 13 Reward Function Example * source: Amazon Web Services
  • 14. 14 ▪ Change parameters within the reward function to maximize the performance of your model and shorten your time around the track Reward Function
  • 15. 15 The Track * source: Amazon Web Services
  • 16. 16 The full process * source: Amazon Web Services
  • 18. 18 What does 6 hours of training cost?
  • 19. 19 DeepRacer Overview: https://aws.amazon.com/deepracer/ DeepRacer Getting Started Guide: https://aws.amazon.com/deepracer/getting-started/ Great Neural Network / Deep Learning Videos: https://www.youtube.com/watch?v=aircAruvnKk DIY Robo Car – https://diyrobocars.com/ Careers@Morningstar: https://www.morningstar.com/careers Helpful Links
  • 21. 21
  • 22. 22
  • 23. 23
  • 24. 24
  • 25. ©2019 Morningstar. All Rights Reserved.