The document discusses building a proof-of-concept web application that demonstrates a "Babel fish" translation functionality using Amazon Machine Learning services like Amazon Transcribe, Amazon Translate, and Amazon Polly. The application would take in audio, automatically transcribe it to text using Transcribe, translate the text to another language with Translate, then synthesize the translated text to audio output using Polly. The session will go through setting up the environment and building the solution in phases using services like AWS Lambda, Amazon S3, and AWS CloudFormation.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Build a Babel Fish with Machine
Learning Language Services
Maciej Chmielarz
Software Development Engineer
Amazon Polly
A I M 3 1 3
Tomasz Stachlewski
Principal Solutions Architect
Amazon Web Services

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Who are we?
Tomasz StachlewskiMaciej Chmielarz
TomaszMaciej

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What to expect from the session?
• Building a proof-of-concept of a real world application
 Web app with Babel fish-like functionality
• Learning about Amazon Machine Learning (Amazon ML) services
 Amazon Transcribe
 Amazon Translate
 Amazon Polly
• Using other services to build your solution

6. “The Babel fish … is small, yellow and leech-like, and
probably the oddest thing in the Universe…. if you
stick a Babel fish in your ear you can instantly
understand anything said to you in any form of
language.”
Douglas Adams
The Hitchhiker's Guide to the Galaxy

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Transcribe
A fully managed and continuously trained automatic speech
recognition service that takes in audio and automatically generates
accurate transcripts
This is my
sample text

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Translate
A neural machine translation service that delivers fast, high-quality,
and affordable language translation
This is my
sample text
Este es mi texto
de ejemplo

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Polly
A text-to-speech service that uses advanced deep learning
technologies to synthesize speech that sounds like a human voice
Este es mi texto
de ejemplo

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Some other services that we will use today
Create and
manage
resources with
templates
Scalable
storage in
the cloud
Run your
code in
response to
events
Manage user
access and
encryption
keys
Identity
management
for your apps

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Solution design
JavaScript web application
interacting with AWS Cloud
AWS Cloud
JavaScript
app

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Solution design
• Lambda for processing
• Amazon S3 to store processed
files and trigger Lambda
functions
AWS Cloud
JavaScript
app

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Solution design
Complete workflow
AWS Cloud
JavaScript
app

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Solution design
AWS CloudFormation, Amazon
Cognito, and IAM to configure and
provide access
AWS Cloud
JavaScript
app

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Phase 0:
Environment setup
AWS Cloud
JavaScript
app
Detailed instruction:
bit.ly/babel-fish-repo

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
10 minutes

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Phase 1:
Convert audio to text
AWS Cloud
JavaScript
app
Detailed instruction:
bit.ly/babel-fish-repo

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
15 minutes

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Phase 1:
Convert audio to text
Solution: transcribe_solution.zip
Password: harvest

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Phase 2:
Translate text
AWS Cloud
JavaScript
app
Detailed instruction:
bit.ly/babel-fish-repo

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
15 minutes

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Phase 2:
Translate text
Solution: translate_solution.zip
Password: airplane

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Phase 3:
Convert text to audio
AWS Cloud
JavaScript
app
Detailed instruction:
bit.ly/babel-fish-repo

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
15 minutes

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Phase 3:
Convert text to audio
Solution: polly_solution.zip
Password: concrete

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

32. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Maciej Chmielarz
chmielar@amazon.com
Tomasz Stachlewski
stachlew@amazon.com

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.