SlideShare a Scribd company logo
Daniele Madama
@dmadama
 EV3RPI - AWS AI services with fun
AWS AI
Introducing Amazon AI
Bringing Powerful Artificial Intelligence To All Developers
AWS
Services
AWS
Services
Lex
It’s what’s
inside Alexa
Lex
It’s what’s
inside Alexa
Lex
It’s what’s
inside Alexa
Build Natural,
Conversational Interactions
In Voice & Text
Lex
It’s what’s
inside Alexa
NLU - Natural Language
Understanding
Lex
It’s what’s
inside Alexa
NLU - Natural Language
Understanding
ASR - Automatic Speech
Recognition
Lex
It’s what’s
inside Alexa
NLU - Natural Language
Understanding
ASR - Automatic Speech
Recognition
Powered By Deep Learning
Components
- Bot
- Intent
- Utterances
- Slot
- Fulfillment
Lex
- Integration with Mobile Hub
- You can use Lambda as Fulfillment
- Save, Build (Test) and Publish approach
Rekognition
Image Analysis
and Recognition
Deep learning based image recognition
service to search, verify and organize
images
Rekognition
Image Analysis
and Recognition
- Object and Scene
Detection
- Facial Analysis
- Face Comparison
- Facial Recognition
Rekognition
Image Analysis
and Recognition
- Object and Scene
Detection
- Facial Analysis
- Face Comparison
- Facial Recognition
Rekognition
Image Analysis
and Recognition
- Object and Scene
Detection
- Facial Analysis
- Face Comparison
- Facial Recognition
Similarity: 98.0%
Rekognition
Image Analysis
and Recognition
- Object and Scene
Detection
- Facial Analysis
- Face Comparison
- Facial Recognition
Polly
Lifelike Text To Speech
- 47 voices across 24
languages
- Low latency
- Free to reuse
Polly
Quality
- Natural sounding speech
A subjective measure of how close TTS output is to human speech.
- Accurate text processing
Ability of the system to interpret common text formats such as abbreviations, numerical sequences,
homographs etc.
- Today in Las Vegas, NV it's 54°F.
- "We live for the music", live from the Madison Square Garden.
- Highly intelligibile
A measure of how comprehensible speech is.
- ”Peter Piper picked a peck of pickled peppers.”
Polly
Quality
- Lexicons
Enables developers to customize the pronunciations of word or phrases
<lexeme>
<grapheme>Kaja</grapheme>
<grapheme>Kaja</grapheme>
<grapheme>Kaja</grapheme>
<phoneme>kaI.@</phoneme>
</lexeme>
- Homographs
Words written identically that have different pronunciation
- Proper Names
Polly
Quality
- Text Normalization
Disambiguation of abbreviations, acronyms, units (St. -> street/saint, KM -> kilometers)
- Foreign Words
Use of right pronunciation from a different language (C’est la vie, dèjà vu)
- Slang
Support for common used way of saying (ASAP, LOL, ROTFL)
- Prosody / Intonation contour
Prediction of changes in volume, rate, and pitch
Polly
SSML
Speech Synthesis Markup Language
is a W3C recommendation, an XML-based markup language for speech
synthesis applications
<speak>
My name is Kuklinski. It is spelled
<prosody rate=’x-slow’>
<say-as interpret-as=”characters”>Kuklinski</say-as>
</prosody>
</speak>
Architecture
Raspberry PI 3
- AWS services with Java SDK
- Bluetooth speaker
- USB Webcam for image and audio input
- Send Python scripts to EV3Dev
- Send audio but receive text to handle different
cases
EV3Dev
- Receive and exec Python scripts
- Interact with motors and sensors
- It’s only a ARM9 300MHz 64MB
- EV3Dev Debian based distro with kernel
modules for Lego Mindstorm EV3 hardware
What was hard
- javax.sound API
- Choice of mic (success)
- Play wav file (fail)
- Bluetooth pair CLI
-
- Debugging Lex
TODO
- Use AWS IoT button to start/stop audio
recording (no gui needed)
- Alexa Voice Service integration
- Avoid SSH connection between RaspberryPI and
EV3Dev (what?)
- Replace EV3 with BrickPI?
Info
https://github.com/madama/ev3rpi
EV3RPI: AI Is The New Mobile

More Related Content

Similar to EV3RPI: AI Is The New Mobile

Building Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon LexBuilding Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon Lex
Amazon Web Services
 
Building Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon LexBuilding Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon Lex
Amazon Web Services
 
Sslis
SslisSslis
Sslis
kkkseld
 
Building Serverless AI-powered Apps on AWS
Building Serverless AI-powered Apps on AWSBuilding Serverless AI-powered Apps on AWS
Building Serverless AI-powered Apps on AWS
Adrian Hornsby
 
[REPEAT 1] How to Get the Most out of TTS for Your Alexa Skill (ALX342-R1) - ...
[REPEAT 1] How to Get the Most out of TTS for Your Alexa Skill (ALX342-R1) - ...[REPEAT 1] How to Get the Most out of TTS for Your Alexa Skill (ALX342-R1) - ...
[REPEAT 1] How to Get the Most out of TTS for Your Alexa Skill (ALX342-R1) - ...
Amazon Web Services
 
Building speech enabled products with Amazon Polly & Amazon Lex
Building speech enabled products with Amazon Polly & Amazon LexBuilding speech enabled products with Amazon Polly & Amazon Lex
Building speech enabled products with Amazon Polly & Amazon Lex
Amazon Web Services
 
Kerie2006 Poster Template 01
Kerie2006 Poster Template 01Kerie2006 Poster Template 01
Kerie2006 Poster Template 01
kkkseld
 
Building Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon LexBuilding Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon Lex
Amazon Web Services
 
AI and machine learning
AI and machine learningAI and machine learning
AI and machine learning
ITU
 
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...
Adrian Hornsby
 
AWS 機器學習 I ─ 人工智慧 AI
AWS 機器學習 I ─ 人工智慧 AIAWS 機器學習 I ─ 人工智慧 AI
AWS 機器學習 I ─ 人工智慧 AI
Amazon Web Services
 
Better Accessibility with Lex, Polly, and Alexa | AWS Public Sector Summit 2017
Better Accessibility with Lex, Polly, and Alexa | AWS Public Sector Summit 2017Better Accessibility with Lex, Polly, and Alexa | AWS Public Sector Summit 2017
Better Accessibility with Lex, Polly, and Alexa | AWS Public Sector Summit 2017
Amazon Web Services
 
Hands-on with Rekognition, Polly & Lex - Pop-up Loft TLV 2017
Hands-on with Rekognition, Polly & Lex - Pop-up Loft TLV 2017Hands-on with Rekognition, Polly & Lex - Pop-up Loft TLV 2017
Hands-on with Rekognition, Polly & Lex - Pop-up Loft TLV 2017
Amazon Web Services
 
Amazon AI (March 2017)
Amazon AI (March 2017)Amazon AI (March 2017)
Amazon AI (March 2017)
Julien SIMON
 
Amazon Alexa Skills Empower my Business with Voice - AWS Summit Sydney 2018
Amazon Alexa Skills Empower my Business with Voice - AWS Summit Sydney 2018Amazon Alexa Skills Empower my Business with Voice - AWS Summit Sydney 2018
Amazon Alexa Skills Empower my Business with Voice - AWS Summit Sydney 2018
Amazon Web Services
 
Enhance customer experience with conversational interfaces
Enhance customer experience with conversational interfacesEnhance customer experience with conversational interfaces
Enhance customer experience with conversational interfaces
Amazon Web Services
 
AWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - TorontoAWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - Toronto
Amazon Web Services
 
Amazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current OfferingAmazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current Offering
Amazon Web Services
 
Computers have feelings too
Computers have feelings tooComputers have feelings too
Computers have feelings too
Paul Glavich
 
Automate for Efficiency with Amazon Transcribe & Amazon Translate
Automate for Efficiency with Amazon Transcribe & Amazon TranslateAutomate for Efficiency with Amazon Transcribe & Amazon Translate
Automate for Efficiency with Amazon Transcribe & Amazon Translate
Amazon Web Services
 

Similar to EV3RPI: AI Is The New Mobile (20)

Building Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon LexBuilding Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon Lex
 
Building Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon LexBuilding Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon Lex
 
Sslis
SslisSslis
Sslis
 
Building Serverless AI-powered Apps on AWS
Building Serverless AI-powered Apps on AWSBuilding Serverless AI-powered Apps on AWS
Building Serverless AI-powered Apps on AWS
 
[REPEAT 1] How to Get the Most out of TTS for Your Alexa Skill (ALX342-R1) - ...
[REPEAT 1] How to Get the Most out of TTS for Your Alexa Skill (ALX342-R1) - ...[REPEAT 1] How to Get the Most out of TTS for Your Alexa Skill (ALX342-R1) - ...
[REPEAT 1] How to Get the Most out of TTS for Your Alexa Skill (ALX342-R1) - ...
 
Building speech enabled products with Amazon Polly & Amazon Lex
Building speech enabled products with Amazon Polly & Amazon LexBuilding speech enabled products with Amazon Polly & Amazon Lex
Building speech enabled products with Amazon Polly & Amazon Lex
 
Kerie2006 Poster Template 01
Kerie2006 Poster Template 01Kerie2006 Poster Template 01
Kerie2006 Poster Template 01
 
Building Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon LexBuilding Speech Enabled Products with Amazon Polly & Amazon Lex
Building Speech Enabled Products with Amazon Polly & Amazon Lex
 
AI and machine learning
AI and machine learningAI and machine learning
AI and machine learning
 
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...
re:Invent re:Cap - An overview of Artificial Intelligence and Machine Learnin...
 
AWS 機器學習 I ─ 人工智慧 AI
AWS 機器學習 I ─ 人工智慧 AIAWS 機器學習 I ─ 人工智慧 AI
AWS 機器學習 I ─ 人工智慧 AI
 
Better Accessibility with Lex, Polly, and Alexa | AWS Public Sector Summit 2017
Better Accessibility with Lex, Polly, and Alexa | AWS Public Sector Summit 2017Better Accessibility with Lex, Polly, and Alexa | AWS Public Sector Summit 2017
Better Accessibility with Lex, Polly, and Alexa | AWS Public Sector Summit 2017
 
Hands-on with Rekognition, Polly & Lex - Pop-up Loft TLV 2017
Hands-on with Rekognition, Polly & Lex - Pop-up Loft TLV 2017Hands-on with Rekognition, Polly & Lex - Pop-up Loft TLV 2017
Hands-on with Rekognition, Polly & Lex - Pop-up Loft TLV 2017
 
Amazon AI (March 2017)
Amazon AI (March 2017)Amazon AI (March 2017)
Amazon AI (March 2017)
 
Amazon Alexa Skills Empower my Business with Voice - AWS Summit Sydney 2018
Amazon Alexa Skills Empower my Business with Voice - AWS Summit Sydney 2018Amazon Alexa Skills Empower my Business with Voice - AWS Summit Sydney 2018
Amazon Alexa Skills Empower my Business with Voice - AWS Summit Sydney 2018
 
Enhance customer experience with conversational interfaces
Enhance customer experience with conversational interfacesEnhance customer experience with conversational interfaces
Enhance customer experience with conversational interfaces
 
AWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - TorontoAWS Artificial Intelligence Day - Toronto
AWS Artificial Intelligence Day - Toronto
 
Amazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current OfferingAmazon Web Services - Strategy and Current Offering
Amazon Web Services - Strategy and Current Offering
 
Computers have feelings too
Computers have feelings tooComputers have feelings too
Computers have feelings too
 
Automate for Efficiency with Amazon Transcribe & Amazon Translate
Automate for Efficiency with Amazon Transcribe & Amazon TranslateAutomate for Efficiency with Amazon Transcribe & Amazon Translate
Automate for Efficiency with Amazon Transcribe & Amazon Translate
 

Recently uploaded

Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
Neo4j
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
SOFTTECHHUB
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 

Recently uploaded (20)

Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
GraphSummit Singapore | Graphing Success: Revolutionising Organisational Stru...
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
TrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy SurveyTrustArc Webinar - 2024 Global Privacy Survey
TrustArc Webinar - 2024 Global Privacy Survey
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
Goodbye Windows 11: Make Way for Nitrux Linux 3.5.0!
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 

EV3RPI: AI Is The New Mobile