Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Designing Far-Field Speech Processing Systems with Intel and Amazon Alexa Voice Service - ALX305 - re:Invent 2017

4,737 views

Published on

In this hands-on workshop, you learn how to build your first far-field voice-enabled product with the Amazon Alexa Voice Service (Amazon AVS). We provide you with the hardware and software you need to build this project based on the Intel Speech Enabling Developer Kit for Amazon Alexa. The workshop covers the basics of the cloud-based Amazon AVS, the Amazon AVS API and client architecture, and audio front-end design with microphone arrays and speech processing technologies from Intel. You also learn how to configure Amazon AVS devices for distribution in international markets. At the end of this workshop, you leave with a working voice-enabled prototype with Alexa on the Intel Speech Enabling Dev Kit.

  • ⇒ www.HelpWriting.net ⇐ is a good website if you’re looking to get your essay written for you. You can also request things like research papers or dissertations. It’s really convenient and helpful.
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD THE BOOK INTO AVAILABLE FORMAT (New Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://urlzs.com/UABbn } ......................................................................................................................... Download Full EPUB Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download Full doc Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download PDF EBOOK here { https://urlzs.com/UABbn } ......................................................................................................................... Download EPUB Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download doc Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book THE can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer THE is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBOOK .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, CookBOOK, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, EBOOK, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story THE Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money THE the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths THE Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD THE BOOK INTO AVAILABLE FORMAT (New Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://urlzs.com/UABbn } ......................................................................................................................... Download Full EPUB Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download Full doc Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download PDF EBOOK here { https://urlzs.com/UABbn } ......................................................................................................................... Download EPUB Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download doc Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book THE can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer THE is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBOOK .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, CookBOOK, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, EBOOK, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story THE Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money THE the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths THE Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • DOWNLOAD THE BOOK INTO AVAILABLE FORMAT (New Update) ......................................................................................................................... ......................................................................................................................... Download Full PDF EBOOK here { https://urlzs.com/UABbn } ......................................................................................................................... Download Full EPUB Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download Full doc Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download PDF EBOOK here { https://urlzs.com/UABbn } ......................................................................................................................... Download EPUB Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... Download doc Ebook here { https://urlzs.com/UABbn } ......................................................................................................................... ......................................................................................................................... ................................................................................................................................... eBook is an electronic version of a traditional print book THE can be read by using a personal computer or by using an eBook reader. (An eBook reader can be a software application for use on a computer such as Microsoft's free Reader application, or a book-sized computer THE is used solely as a reading device such as Nuvomedia's Rocket eBook.) Users can purchase an eBook on diskette or CD, but the most popular method of getting an eBook is to purchase a downloadable file of the eBook (or other reading material) from a Web site (such as Barnes and Noble) to be read from the user's computer or reading device. Generally, an eBook can be downloaded in five minutes or less ......................................................................................................................... .............. Browse by Genre Available eBOOK .............................................................................................................................. Art, Biography, Business, Chick Lit, Children's, Christian, Classics, Comics, Contemporary, CookBOOK, Manga, Memoir, Music, Mystery, Non Fiction, Paranormal, Philosophy, Poetry, Psychology, Religion, Romance, Science, Science Fiction, Self Help, Suspense, Spirituality, Sports, Thriller, Travel, Young Adult, Crime, EBOOK, Fantasy, Fiction, Graphic Novels, Historical Fiction, History, Horror, Humor And Comedy, ......................................................................................................................... ......................................................................................................................... .....BEST SELLER FOR EBOOK RECOMMEND............................................................. ......................................................................................................................... Blowout: Corrupted Democracy, Rogue State Russia, and the Richest, Most Destructive Industry on Earth,-- The Ride of a Lifetime: Lessons Learned from 15 Years as CEO of the Walt Disney Company,-- Call Sign Chaos: Learning to Lead,-- StrengthsFinder 2.0,-- Stillness Is the Key,-- She Said: Breaking the Sexual Harassment Story THE Helped Ignite a Movement,-- Atomic Habits: An Easy & Proven Way to Build Good Habits & Break Bad Ones,-- Everything Is Figureoutable,-- What It Takes: Lessons in the Pursuit of Excellence,-- Rich Dad Poor Dad: What the Rich Teach Their Kids About Money THE the Poor and Middle Class Do Not!,-- The Total Money Makeover: Classic Edition: A Proven Plan for Financial Fitness,-- Shut Up and Listen!: Hard Business Truths THE Will Help You Succeed, ......................................................................................................................... .........................................................................................................................
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
  • Hi there! I just wanted to share a list of sites that helped me a lot during my studies: .................................................................................................................................... www.EssayWrite.best - Write an essay .................................................................................................................................... www.LitReview.xyz - Summary of books .................................................................................................................................... www.Coursework.best - Online coursework .................................................................................................................................... www.Dissertations.me - proquest dissertations .................................................................................................................................... www.ReMovie.club - Movies reviews .................................................................................................................................... www.WebSlides.vip - Best powerpoint presentations .................................................................................................................................... www.WritePaper.info - Write a research paper .................................................................................................................................... www.EddyHelp.com - Homework help online .................................................................................................................................... www.MyResumeHelp.net - Professional resume writing service .................................................................................................................................. www.HelpWriting.net - Help with writing any papers ......................................................................................................................................... Save so as not to lose
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here

Designing Far-Field Speech Processing Systems with Intel and Amazon Alexa Voice Service - ALX305 - re:Invent 2017

  1. 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AWS re:Invent Designing Far-Field Voice Solutions with Intel N o v e m b e r 3 0 , 2 0 1 7
  2. 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Meet the team! Chris Keyser Principal Solutions Architect, Alexa Voice Service Sanjay Devireddy Software Development Engineer, Alexa Voice Service Gagan Luthra Sr. Product Marketing Manager, Alexa Voice Service Fletcher Nelson Solutions Architect, Alexa Voice Service Navneet Malpani Principal Solutions Architect, Alexa Voice Service
  3. 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. The evolution of voice interaction
  4. 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • Single microphone • Always on The evolution of voice interaction
  5. 5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • Single microphone • Always on • Push to talk • Built-in speaker The evolution of voice interaction
  6. 6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • Single microphone • Always on • Push to talk • Built-in speaker • Voice activated • Noise cancellation The evolution of voice interaction
  7. 7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • Single microphone • Always on • Push to talk • Built-in speaker • Voice activated • Noise cancellation • 360-degree mic coverage • Increased detection range The evolution of voice interaction
  8. 8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Echo: The first Alexa-enabled device “Amazon’s Echo might be the most important product in years” “Amazon Echo proves the viability of voice-based home computing.” “Amazon Alexa just conquered CES 2017. The world is next.” “Alexa is clearly the star of IFA 2017”
  9. 9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hi, Alexa… Hello!
  10. 10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Smart home control Timers and alarms Cloud-based intelligence Shopping Music News and information Custom skills Always getting smarter
  11. 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon’s Alexa-enabled products
  12. 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Vision: Alexa anywhere Home audio Thermostats Automobiles Maker boards Wearables Small appliances Smartphones Large appliancesHome security TV/video
  13. 13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Alexa-enabled products
  14. 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Directives Instructions sent from AVS to Client Events Information sent from Client to AVS Voice Hardware Audio Front End Device Software AVS Device SDK Simplifying voice interaction
  15. 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. “Alexa, Play Music” Wake Word Engine “Play” Directive Intent Recognition Result Recognition Result Text/SSML Speech Platform Skills Music Service ASR NLU TTS “Recognize” Event Streaming URL User’s Utterance Event Alexa Voice Response Directive Intent Alexa Voice Service Speech Capture via Microphone Play back through Speaker
  16. 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. How do you build Alexa into your product?
  17. 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. White box design End device Continuum of reference designs Smart speaker puck Your product
  18. 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Form factor reference design White box design End device FFRD Continuum of reference designs Smart speaker puck Your product
  19. 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. AVS-enabled module Form factor reference design White box design End device FFRD Systems integrator AVS module Continuum of reference designs Smart speaker puck Your product
  20. 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Development kit AVS-enabled module Form factor reference design White box design End device FFRD Systems integrator AVS module Continuum of reference designs Smart speaker puck Your product Intel Voice Enabling Developer Kit
  21. 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Microphone array ADC ADC ADC ADC Hardware architecture – What’s in an AVS client?
  22. 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hardware architecture – What’s in an AVS client? DSP Amp DAC Audio algorithms Microphone array ADC ADC ADC ADC
  23. 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. DSP Amp DAC Audio algorithms SoC Wi-Fi/Ethernet AVS client WWE Microphone array ADC ADC ADC ADC Audio drivers Hardware architecture – What’s in an AVS client?
  24. 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Touch activated Interaction models – introducing terms
  25. 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Hands-free voice activated Interaction models – introducing terms
  26. 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Interaction models – introducing terms Far-field voice activated
  27. 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Choosing the right audio front end Number of microphones Microphone arrangement Audio algorithms
  28. 28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Audio algorithms Wake word engine: Identifies “Alexa” wake word to start sending speech to cloud • Model size: Bigger is usually better Requires more memory on client • Cloud-based verification: AVS double-checks your client’s WWE
  29. 29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Audio algorithms Responseaccuracy Far-field Hands-free Increasing SNR Noise reduction: Remove background noise for clear speech capture. SNR = Signal to noise ratio
  30. 30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Audio algorithms Problem: Audio feedback makes it difficult to pick out speech. Voice A Voice B Voice A picked up by Voice B’s mic Voice B
  31. 31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Audio algorithms Music playing on device Speaker output picked up by device microphone Speaker output Microphone on device Voice of user Problem: Audio feedback makes it difficult to pick out speech.
  32. 32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Audio algorithms Acoustic Echo Cancellation (AEC): Use audio feedback to cancel echo and improve SNR. Music playing on device Speaker output Voice of user Microphone on device DSP Audio algorithms AEC
  33. 33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. First Last Beamforming: Locate the source of speech and pick it out of background noise. Audio algorithms
  34. 34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Audio algorithms First Last Beamforming: Locate the source of speech and pick it out of background noise.
  35. 35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Audio algorithms Beamforming: Orientation matters! 90° 90° 15° • Circular arrays work best at < 15° angle, such as on a table. • Wall or ceiling mounting may negatively affect beamforming.
  36. 36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Microphone arrangement Linear array for wall-mounted Circular array for tabletop
  37. 37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Number of microphones One mic for touch activated Two or more mics for hands-free and far-field
  38. 38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Number of microphonesResponseaccuracy Far-field – 7 mic Increasing SNR Far-field – 4 mic Hands-free – 2 mic • Two-mic dev kits perform comparably. • More mics are usually better, but result in diminishing returns. • In high SNR environments, fewer mics work adequately. • As SNR decreases, even seven-mic dev kits eventually lose accuracy.
  39. 39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • Integrate high-performance voice capture • Dev kits Include mic arrays, DSPs, SoCs • Supported by leading chipset providers Development kits for AVS
  40. 40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. INTEL 8-Mic Circular Array XMOS 4-Mic Linear Array AMAZON 7-Mic Circular Array SYNAPTICS 4-Mic Square Array CIRRUS LOGIC 2-Mic Linear Array MICROSEMI 2-Mic Linear Array CONEXANT 2-Mic Linear Array AVS Development KitsHandsfreeFar-field
  41. 41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Intel Speech Enabling Developer Kit Nithyananda Jeganathan (Siva) Product Manager , Smart Home Group Intel Corporation Intel helpers for the session: Sathish Kuttan, Roberta Zouain, Ashwin Patti, Alex Z, Yen-ning Chang, Sarah Bienvenue, Josh Cobb
  42. 42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. What’s included in the Intel Dev Kit? Intel Dual DSP w/ Inference engine board AVS Sample Client 8-Mic Array Board Raspberry Pi™ connector cable Audio Pre-Processing Algorithms, WWE, and Software Drivers Documentation, Collaterals, and Software Tools
  43. 43. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • Devkit comes w/ premium far-field audio certification from Amazon • Provides a solid foundation to build new experiences • Accelerate new product development by leveraging Intel’s expertise • Intel to assist w/ audio tuning and optimization for the product Why use Intel developer kit?
  44. 44. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Intel Developer Kit— How It Works Dual DSP w/ inference engine Mics Speakers Speech recognition algos Intel Audio IP FW Cloud appsCloud skills Intel Speech Enabling Developer Kit SW FW HW Legend Alexa voice services SPI Raspberry Pi Audio driver AVS SDK AVS Client AVS Cloud 1 2 1. User utters “Alexa” keyword, and mic arrays pickup the utterance 2. Intel’s audio far-field IP performs beamforming, noise cancellation and detects the “Alexa” keyword and sends event signal to AVS SDK 3 3. Keyword engine in AVS SDK receives the event and notifies AVS client to open the channel to driver4 4. Audio data from driver is sent to the cloud by the AVS client 5 5. Speech recognition AI algorithms convert audio to text and pass information to relevant apps for processing 6 6. Cloud apps return response that is sent back to the AVS client for playback 7 7. AVS client sends response from cloud over the speaker
  45. 45. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Intel Design Optimization – Far Field on a Chip DSP Amp DAC Audio Algorithms SoC Wifi / Ethernet AVS Client WWE Audio Drivers • Wake Word Engine on DSP for low power product design • Unique to Intel developer kit • Significant platform power savings can be realized • Low power WoV feature has been enabled on the Dual DSP
  46. 46. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • 8 Mic Circular array geometry allows for precise beamforming from all directions • Ambient noise suppression outside of the signal beam Intel Design Optimization – Beamforming Ambient Noise “Alexa” wake word What time is it in Vegas?
  47. 47. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Intel Design Optimization – Acoustic Echo Cancellation (AEC) • Processes multichannel input signal and provides multichannel output to algorithms • AEC automatically adapts to room reverberation and playback signal changes • Intel algorithms perform linear operations that does not introduce distortions • Highly optimized for Intel Wake On Voice and Amazon Alexa performance
  48. 48. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Build the Sample App on your Intel Speech Enabling Dev Kit Open your hardware box and build your devkit! Follow the instructions in your lab manual at: https://avs-dvk-workshop.github.io/ W O R K S H O P A C T I V I T Y :
  49. 49. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Thank you! D e s i g n i n g F a r - F i e l d V o i c e S o l u t i o n s w i t h I n t e l Visit the Alexa developer portal for more information: Documentation, tutorials ,webinars, and more https://developer.amazon.com/alexa AVS: Alexa Voice Service https://developer.amazon.com/avs ASK: Create custom skills for Alexa https://developer.amazon.com/ask Smart home: https://developer.amazon.com/alexa/smart- home

×