Alexa Everywhere: A Year in Review (ALX201) - AWS re:Invent 2018

•

3 likes•4,988 views

Since its launch in 2015, Alexa has enabled new experiences across many device form factors at home, work, in the car, and on the go. With over 50,000 published skills, hundreds of new API features releases, and numerous Alexa-enabled devices, it can be hard to keep track with of the current pace. In this session, we get you up to speed on the current Voice First movement, the current Conversational AI trends, and we give demonstrations of some of the latest Alexa features and devices. Come learn about the new Alexa Skills Kit (ASK) multi-modal framework, Alexa Presentation Language (APL) for developers, Alexa skill fulfillment and consumables for customers, and some of the latest device offerings utilizing the Alexa Voice Service (AVS) and the new Alexa Gadgets Toolkit.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Alexa Everywhere: A Year in Review
Dave Isbitski
Chief Evangelist, Alexa and Echo
Amazon Alexa
thedavedev.com
A L X 2 0 1

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
What’s new?
Voice hub
Alexa Presentation Language (APL)
Alexa Voice Service (AVS)
Alexa Gadgets Toolkit
Closing

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Alexa-related breakouts (TBD)
Day of Week, Month Day
Session Title
Time – Time | Location
Day of Week, Month Day
Session Title
Time – Time | Location
Day of Week, Month Day
Session Title
Time – Time | Location

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
50,000+ skills

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Hundreds of Thousands
Developers building Alexa
experiences
50,000+
Alexa Skills
4 out of 5
Customers with Echo device in US use
Alexa Skills
Tens of Millions
Alexa-Enabled Devices
Skill Engagement Grew more, nearly 75% in 2017, more than 50% YOY

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Around the world
80 countries
Over 80 Countries

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Customers have now connected tens of millions of smart home devices to
Alexa
12,000 devices from more than 2,000 unique brands

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Alexa Voice Service

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Context
Across Turns

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Context
Across Turns
“Alexa, where is the Empire
State Building?”
“How do I get there?”

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
DEMO
Multimodal
Context
Context
Across Turns

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Multimodal
Context
Context
Across Turns

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Evolving
Device Context
Multimodal
Context
Context
Across Turns

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Personal
Context
Evolving
Device Context
Multimodal
Context
Context
Across Turns

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
D e v e l o p e r t o o l s

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Skill Testing
Tool
Flash Briefing
Skill API
MultiModalNew
Developer
Console
Video
Skill API
Smart Home
Skill API
AVS SDK
Skill
Management
API
Command
Line Interface

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
New developer console
Lists API/Sync
Smart home API
Speechcons/Whisper
Device location
Built-In library
Multimodal Skills
Smart home camera support
New devices (Echo-family and AVS)
ANZ, UK, CA, DE, FR, Japan, and India
Voice profiles
Push notifications
SMAPI/ASK CLI
Alexa Gadgets API
Lex integration
Video Skill API

Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Dave Isbitski
Chief Evangelist, Alexa
thedavedev.com

Understanding your customers is easier today than ever before. Natural language capabilities can capture a wealth of information, such as user sentiment and conversational intent. This workshop teaches you how to build an analytics pipeline that includes natural language processing (NLP) to better understand how to improve the customer experience. Attendees learn how to use AWS services, including Amazon Comprehend and Amazon Transcribe, to process and perform analysis on customer data, such as contact center call recordings.

Deep Learning Applications Using PyTorch, Featuring Facebook (AIM402-R) - AWS...

Amazon Web Services

With support for PyTorch 1.0 on Amazon SageMaker, you now have a flexible deep learning framework combined with a fully managed machine learning platform to transition seamlessly from research prototyping to production deployment. In this session, learn how to develop with PyTorch 1.0 within Amazon SageMaker using a novel generative adversarial network (GAN) tutorial. Then, hear from Facebook on how you can use the FAIRSeq modeling toolkit, which serves 6B translations daily for Facebook users, to train your own custom PyTorch models on Amazon SageMaker. Facebook also discusses the evolution of PyTorch 1.0 and features introduced to accelerate research and deployment.

Alexa for Device Makers: Create Products with Alexa Built-In Using AVS (ALX30...

Amazon Web Services

In this hands-on workshop, learn how to use Alexa Built-In to create products that you can talk to and use to access music, information, control smart-home devices, and all of Alexa's skills. We use the C++-based AVS Device SDK and a Raspberry Pi to access the cloud-based Alexa Voice Service (AVS). Leave this session with your own working prototype and the knowledge to bring your products to market.

Alexa, Ask Jarvis to Create a Serverless App for Me (SRV315) - AWS re:Invent ...

Amazon Web Services

Today, we can build and deploy a serverless application in minutes without having to write a line of code using pre-built AWS CloudFormation templates, or services such as the AWS Serverless Application Repository. But can we push the limits even more? In this workshop, we use the Serverless Application Repository combined with Amazon Alexa to create Iron Man's Jarvis look-a-like skill. You learn hands-on with Alexa, Amazon Lex, Amazon SageMaker, and the AWS Serverless Application Repository.

Build an Intelligent Multi-Modal User Agent with Voice and NLU (AIM340) - AWS...

Amazon Web Services

Sophisticated AI capabilities can help us manage the exploding number of information sources and tools required to perform our daily tasks. In this chalk talk, we describe how intelligent agents can be designed to quickly and efficiently complete tasks delegated by users. To build this intelligent agent, we combine a number of AWS services, such as Amazon Polly, Amazon Lex, Amazon Rekognition, Amazon Sumerian, and Amazon ElastiCache along with other technologies, such as CLIPS and Reinforcement Learning. Come hear us discuss the project’s architecture, implementation, and demo progress made to date.

Machine Learning for the Enterprise, ft. Sony Interactive Entertainment (ENT2...

Amazon Web Services

Machine learning is powering innovation across industries, including media & entertainment, healthcare, finance, and many more. In this session, representatives from AWS and Sony Interactive Entertainment discuss building real-world scalable enterprise solutions with machine learning using Amazon SageMaker. Join us as we talk about managing large-scale systems and processes to get more value from data at any scale, with examples from Sony and AWS.

In the novel, “The Hitchhiker's Guide to the Galaxy,” Douglas Adams described a Babel fish as a “small, yellow, and leech-like” device that you stick in your ear. In Star Trek, it is known simply as the universal language translator. Whatever you call it, there is no doubting the practical value of a device that is capable of translating any language into another. In this workshop, learn how to build a babel fish app that recognizes voice and converts it to text (speech-to-text), translates the text to a language of your choice, and converts translated text to synthesized speech (text-to-speech).

Provide Faster, Scalable Solutions to Support Research Use Cases with AWS (WP...

Amazon Web Services

The Urban Institute chose a cloud-first strategy with AWS to increase the capacity and performance of big data and high-performance computing workloads for 300+ researchers. In this chalk talk, we demonstrate how our team piloted the execution of one of our signature microsimulation models in parallel, designing a new architecture in the cloud that required minimal changes to the original model’s source code. We also show how our team worked directly with AWS to develop open source code that launches powerful Amazon Elastic MapReduce (Amazon EMR) Spark clusters with minimal setup time, and combined it with our Elastic Cloud Computing Environment to allow for a simple Spark user experience.

Build Deep Learning Applications Using Apache MXNet, Featuring Workday (AIM40...

Amazon Web Services

The Apache MXNet deep learning framework is used for developing, training, and deploying diverse AI applications, including computer vision, speech recognition, and natural language processing at scale. In this session, learn how to get started with MXNet on the Amazon SageMaker machine learning platform. Hear from Workday about how they built computer vision and natural language processing (NLP) models using MXNet to automatically extract information from paper documents, such as expense receipts and populate data records. Workday also shares its experience using Sockeye, an MXNet toolkit for quickly prototyping sequence-to-sequence NLP models.

Train Models on Amazon SageMaker Using Data Not from Amazon S3 (AIM419) - AWS...

Amazon Web Services

Everything You Wanted to Know about Developing for Voice Using Alexa (ALX306-...

Amazon Web Services

In this chalk talk, we review the common challenges developers face when building voice experiences for Alexa. We provide an overview of the history of design in technology, highlighting what we learned over the years in developing for a screen. We also establish best practices for voice-first design using the Alexa Skills Kit, which we contrast with GUI design principles. You have the opportunity to ask questions and discuss ideas among fellow skill developers. By the end of this session, expect to understand the similarities and differences between developing for voice and developing for screen-oriented mediums.

Leadership Session: Digital Advertising - Customer Learning & the Road Ahead ...

Amazon Web Services

In this session, learn how experienced leaders in digital advertising respond to the rapid evolution and sophistication of the advertising market driven by innovation and groundbreaking technology. Our customers share real-world applications they've leveraged in the cloud and how they see the media landscape changing as adoption of AI in the space becomes more widespread. Learn about existing and upcoming advancements and how they affect digital transformation in the years to come. Come away with ideas on how you can apply these learnings to your technology stack.

Three Lessons from “Escape the Room” That Apply to Making Money with Your Ale...

Amazon Web Services

Games push the boundaries of tech, enabling us to learn from them for a wide range of use cases. Join Gal Shenar, founder of Stoked Skills, in this talk about designing and implementing Alexa in-skill purchasing for “Escape the Room” and “Escape the Airplane” game skills. Learn about optimizing the user experience by soft launching with live updates and implementing a premium content in-skill purchase gate while monitoring user experience flow to increase conversion rates by using AWS Lambda.

Accelerate ML Training on Amazon SageMaker Using GPU-Based EC2 P3 Instances (...

Amazon Web Services

In this workshop, you gain hands-on experience in training deep learning neural networks with Amazon SageMaker using GPU-based EC2 P3 instances. Amazon EC2 P3 instances, powered by NVIDIA Tesla V100 GPUs, offer the highest-performing GPU-based instances in the cloud for efficient model training. We discuss and work through building convolution neural networks for solving common computer vision problems. All attendees must bring their own laptop (Windows, macOS, and Linux all supported). Tablets are not appropriate. We also recommend having the current version of Chrome or Firefox installed.

Build Human-in-the-Loop Systems with AWS Lambda and Mechanical Turk (AIM354) ...

Amazon Web Services

Build a Visual Search Engine Using Amazon SageMaker and AWS Fargate (AIM341) ...

Amazon Web Services

Detect Anomalies Using Amazon SageMaker (AIM420) - AWS re:Invent 2018

Amazon Web Services

For a wide variety of metrics—including business metrics, application metrics, and low-level software and hardware metrics—it is critical to detect abnormalities to ensure that you end up with the right data. In this chalk talk, learn about the Random Cut Forest algorithm built into Amazon SageMaker in order to detect anomalies. We dive deep into detecting anomalies and tuning data in order to find practical solutions.

Unlock the Full Potential of Your Media Assets, ft. Fox Entertainment Group (...

Amazon Web Services

Machine learning (ML) enables developers to build scalable solutions that maximizes the use of media assets through automatic metadata extraction. From automatic transcription and language translation to face detection and celebrity recognition, ML enables you to automate manual workflows and optimize the use of your video content. In this session, learn how to use services such as Amazon Rekognition, Amazon Translate, and Amazon Comprehend to build a searchable video library, automate the creation of highlight reels, and more.

Democratize Data Preparation for Analytics & Machine Learning A Hands-On Lab ...

Amazon Web Services

Machine learning (ML) outcomes are only as good as the data they are built upon. Preparing data for ML is time consuming and cumbersome; “data wrangling” for analytics can consume over 80% of project effort. ML Wrangling Assistant, based on Trifacta running on AWS, streamlines ML applications so teams can focus on the work that matters—creating accurate predictions that improve products, services, and organizational efficiency. In this lab, we cover one of two data preparation use cases. Marketing Analytics analyzes web ads by cleaning and transforming ecommerce transactions in a relational table combined to a clickstream semi-structured log file. Cross-Sell Analytics explores, structures, standardizes, and combines multiple file types (CSV, JSON, Excel) to create a single, consistent view of customers. Final outputs are the categorical features and attributes to train, test, and validate the data sets required by Amazon SageMaker to perform ML modeling.

Transform the Modern Contact Center Using Machine Learning and Analytics (AIM...

Amazon Web Services

Analyzing customer service interactions across channels provides a complete 360-degree view of customers. By capturing all interactions, you can better identify the root cause of issues and improve first-call resolution and customer satisfaction. In this session, learn how to integrate Amazon Connect and AWS machine learning services, such Amazon Lex, Amazon Transcribe, and Amazon Comprehend, to quickly process and analyze thousands of customer conversations and gain valuable insights. With speech and text analytics, you can pick up on emerging service-related trends before they get escalated or identify and address a potential widespread problem at its inception.

Hollywood's Cloud-Based Content Lakes: Modernized Media Archives (MAE203) - A...

Amazon Web Services

Content lake architecture can evolve the media workflow by providing efficiency from content security all the way to value-added services, such as machine learning and content monetization. In this session, technical leaders from 21st Century Fox, Warner Bros., and Astro Malaysia discuss the migration of their petabyte-scale video libraries (production and distribution archives) to the cloud in order to increase the customer reach and value of their media archives. Discover some of the lessons learned, the TCO analysis around various different storage tiers, the challenges and best practices from 10s of petabytes ingest, storage, and value-added compute at scale.

Robocar Rally 2018 (AIM206-R20) - AWS re:Invent 2018

Amazon Web Services

Get behind the keyboard for an immersive experience with autonomous cars at Robocar Rally 2018. In this workshop you will get hands-on-experience with machine learning and robo-racing cars. Developers with no prior machine learning or robotic experience will learn new skills and apply their knowledge in a fun and exciting way. You will join a pit crew where you will build, train, and race a robo-racing car! Start your engines, the race is on!

Build, Train, and Deploy ML Models with Amazon SageMaker (AIM410-R2) - AWS re...

Amazon Web Services

Come and help build the most accurate text classification model possible. A fully managed machine learning (ML) platform, Amazon SageMaker enables developers and data scientists to build, train, and deploy ML models using built-in or custom algorithms. In this workshop, you learn how to leverage Keras/TensorFlow deep learning frameworks to build a text classification solution using custom algorithms on Amazon SageMaker. You package custom training code in a Docker container, test it locally, and then use Amazon SageMaker to train a deep learning model. You then try to iteratively improve the model to achieve a higher level of accuracy. Finally, you deploy the model in production so different applications within the company can start leveraging this ML classification service. Please note that to actively participate in this workshop, you need an active AWS account with admin-level IAM permissions to Amazon SageMaker, Amazon Elastic Container Registry (Amazon ECR), and Amazon S3.

Build Deep Learning Applications Using TensorFlow and Amazon SageMaker (AIM42...

Amazon Web Services

Deep learning continues to push the state of the art in computer vision, language applications, and more. In this workshop, learn how to get started with the TensorFlow deep learning framework using Amazon SageMaker, a fully managed platform to build, train, and deploy machine learning models at scale. Learn how to build a model using TensorFlow by setting up a Jupyter notebook for image and object recognition. Use bring-your-own-code and bring-your-own-algorithm techniques to develop your deep learning model. Once the model is built, learn how to train and deploy it using Amazon SageMaker.

Build Deep Learning Applications Using PyTorch and Amazon SageMaker (AIM432-R...

Amazon Web Services

In this workshop, learn how to get started with the PyTorch deep learning framework using Amazon SageMaker, a fully managed platform to build, train, and deploy machine learning (ML) models at scale quickly and easily. First, we create a computer vision model using deep neural networks that helps us discover analytical information from our image dataset. Then, we use Amazon Redshift, a fully managed data warehouse, to perform analytics and find business value using the output of our ML model.

Broadcasting the World's Largest Sporting Events: AWS Media Services When It ...

Amazon Web Services

Learn how TV New Zealand and France Television broadcast the Commonwealth Games and a major cycling event using AWS Media Services. Broadcasting live events is unpredictable. Reliability, agility, and scale all play important roles in ensuring a broadcast takes place without issues. Learn how to create channels on the fly for live events and how to seamlessly handle a fluctuation or influx of viewers using AWS Elemental MediaLive, AWS Elemental MediaPackage, and Amazon CloudFront.

Building Alexa Skills - Floor28

Boaz Ziniman

Alexa skills allow you to expand the voice assistant capabilities beyond what comes out of the box. In addition to more than 30,000 available Alexa skills out there, you can start developing your own skill tomorrow morning. This session will show you how to build your first Alexa skill using different AWS services that can help you develop and run your skill in minutes. We will cover AWS Lambda, DynamoDB, S3 and other tools and services that will help you run your skills at scale.

Building Alexa Skills with AWS | AWS Floor28

Amazon Web Services

What's hot

Build a Babel Fish with Machine Learning Language Services (AIM313) - AWS re:...

Amazon Web Services

Provide Faster, Scalable Solutions to Support Research Use Cases with AWS (WP...

Amazon Web Services

Build Deep Learning Applications Using Apache MXNet, Featuring Workday (AIM40...

Amazon Web Services

Train Models on Amazon SageMaker Using Data Not from Amazon S3 (AIM419) - AWS...

Amazon Web Services

Everything You Wanted to Know about Developing for Voice Using Alexa (ALX306-...

Amazon Web Services

Leadership Session: Digital Advertising - Customer Learning & the Road Ahead ...

Amazon Web Services

Three Lessons from “Escape the Room” That Apply to Making Money with Your Ale...

Amazon Web Services

Accelerate ML Training on Amazon SageMaker Using GPU-Based EC2 P3 Instances (...

Amazon Web Services

Build Human-in-the-Loop Systems with AWS Lambda and Mechanical Turk (AIM354) ...

Amazon Web Services

Build a Visual Search Engine Using Amazon SageMaker and AWS Fargate (AIM341) ...

Amazon Web Services

Detect Anomalies Using Amazon SageMaker (AIM420) - AWS re:Invent 2018

Amazon Web Services

Unlock the Full Potential of Your Media Assets, ft. Fox Entertainment Group (...

Amazon Web Services

Democratize Data Preparation for Analytics & Machine Learning A Hands-On Lab ...

Amazon Web Services

Transform the Modern Contact Center Using Machine Learning and Analytics (AIM...

Amazon Web Services

Hollywood's Cloud-Based Content Lakes: Modernized Media Archives (MAE203) - A...

Amazon Web Services

Robocar Rally 2018 (AIM206-R20) - AWS re:Invent 2018

Amazon Web Services

Build, Train, and Deploy ML Models with Amazon SageMaker (AIM410-R2) - AWS re...

Amazon Web Services

Build Deep Learning Applications Using TensorFlow and Amazon SageMaker (AIM42...

Amazon Web Services

Build Deep Learning Applications Using PyTorch and Amazon SageMaker (AIM432-R...

Amazon Web Services

Broadcasting the World's Largest Sporting Events: AWS Media Services When It ...

Amazon Web Services

What's hot (20)