AWS Innovate Montreal Keynote - by Chris Munns

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
May 24, 2017
Innovating in the CloudMontreal, Quebec, Canada
Chris Munns – Senior Developer Advocate - Serverless
https://www.flickr.com/photos/xkristinax/7987570964/

About me:
Chris Munns - munns@amazon.com, @chrismunns
• Senior Developer Advocate - Serverless
• New Yorker
• Previously:
• AWS Business Development Manager – DevOps, July ’15 - Feb ‘17
• AWS Solutions Architect Nov, 2011- Dec 2014
• Formerly on operations teams @Etsy and @Meetup
• Little time at a hedge fund, Xerox and a few other startups
• Rochester Institute of Technology: Applied Networking and
Systems Administration ’05
• Internet infrastructure geek

https://secure.flickr.com/photos/mgifford/4525333972
Why are we
here today?

* As of 1 May 2017
2010
61
516
1,017
159
2012 2014 2016
AWS has been continually expanding its services to support virtually any cloud workload,
and it now has more than 90 services that range from compute, storage, networking,
database, analytics, application services, deployment, management, developer, mobile,
Internet of Things (IoT), Artificial Intelligence (AI), security, hybrid and enterprise
applications. AWS has launched a total of 322 new features and/or services year to date* -
for a total of 3,235 new features and/or services since inception in 2006.
AWS Pace of Innovation

AWS Direct
Connect
AWS Elastic Beanstalk
Schema Conversion Tool
AWS Shield EFS
WorkSpaces
Amazon Lumberyard
Amazon
Pinpoint
AWS IoT
AWS Managed Services
Amazon Route 53
AWS Import/Export
AWS OpsWorks for
Chef Automate
Redshift
Dynamo DB
Amazon Polly
AWS
Snowball
AWS Organizations
Device Farm
Amazon Config
Amazon RDS
for Aurora
WorkDocs
AWS
Snowball Edge
CodeCommit
AWS CodePipeline
AWS Service Catalog
CloudWatch Logs
Amazon Lex
AWS Greengrass
Amazon EC2
Systems Manager
AWS WAF
Amazon Appstream 2.0
Amazon
Athena
AWS Glue
Amazon Lightsail
Amazon Rekognition
AWS Step Functions
AWS Discovery
Services
AWS Certificate
Manager
Amazon
ElastiCache
Mobile Analytics
AWS Mobile Hub
AWS Storage Gateway
AWS OpsWorks
AWS Batch
Amazon Inspector
EC2
Container Service
Amazon Cognito
AWS CodeDeploy
AWS Personal Health Dashboard
AWS Snowmobile
Lambda
* As of 1 May 2017
AWS Codebuild
AWS X-Ray
Amazon QuickSight
Amazon Kinesis Firehose
Amazon
Workmail
Amazon Inspector
Machine Learning

Most Fully-Featured Technology Infrastructure Platform

Largest Number Of Startup Customers

Largest Number Of Enterprise Customers

Cloud Has Become The New Normal

Fundamental Characteristics of the AWS Cloud
SECURITY
And critically…
Velocity Pace of
Innovation
Elasticity
AvailabilityLow Cost

What Are The Patterns Of This
New Normal?

“Bigger” Data
+ Serverless
+ AI

The Ability to Understand Your Customers And
Business Better Through Analytics
Machine
Learning
Amazon
Machine Learning
Hadoop, Spark,
HBase, Hive, Presto,
Mahout, Pig, Zeppelin
Amazon
EMR
Elasticsearch
Amazon
Elasticsearch
Real-time
streaming data
Amazon
Kinesis
Data
Warehouse
Amazon
Redshift
Business
Intelligence
Amazon
QuickSight
Ad-hoc queries
against S3
Amazon
Athena

Amazon Athena:
Interactive Queries On Data In S3
No need to move
data to Athena
Query S3 directly
& right away
No infrastructure or
clusters to setup &
manage
Fast results
within seconds
Pay for just the
queries you run

Redshift, EMR & Athena:
The Right Tool For The Job
Ad-hoc queries
against S3
Amazon Athena
Hadoop, Spark
& Presto
Amazon EMR
Data
Warehouse
Amazon Redshift

Generally available now
Redshift Spectrum
Run queries directly on exabytes of data in Amazon S3
Introducing

Amazon Redshift
Query S3 directly or join data
across Redshift and S3
Support for CSV, JSON, ORC,
and Parquet data formats
Scale Redshift compute and
storage separately
Redshift Query
Engine
Redshift Data
Data
Lake
Amazon S3
Redshift Spectrum: Extend Redshift Queries To
Data In Amazon S3

Complex query against exabyte dataset
4 tables (1 S3, 3 local), 8 filters,
3 joins, 4 group by columns,
1 order by, 1 limit, 1 aggregation,
1 function and 2 casts
Redshift Spectrum Performance

Hive (1000 node clusters):
5 years

Spectrum:
155 seconds
Hive (1000 node clusters):
5 years

“Software is Eating the World” – M. Andreessen
“APIs are Eating Software” – Dr. S. Willmott
Fun fact: Apis is the “Genus” for
Honey Bees

The Micro-elephant in the room
https://www.flickr.com/photos/davidrosenphotography/14711027415/

Microservices
“is a software architecture style in which complex
applications are composed of small, independent
processes communicating with each other using
language-agnostic APIs. These services are small,
highly decoupled and focus on doing a small task,
facilitating a modular approach to system-
building.” - Wikipedia
https://en.wikipedia.org/wiki/Microservices

Development transformation at Amazon: 2001+
<2001 >2001
monolithic
application +
teams
microservices + 2 pizza
teams

Event Driven Computing maps well to
Microservices
Microservices Architecture
GET /pets
PUT /pets
DELETE /pets
GET /describe/pet/$id
PUT /describe/pet/$id
Events

Event Driven Compute maps well to FaaS
GET /pets
PUT /pets
DELETE /pets
GET /describe/pet/$id
PUT /describe/pet/$id
Events Functions As A Service

Serverless application
SERVICES (ANYTHING)
Changes in
data state
Requests to
endpoints
Changes in
resource state
EVENT SOURCE FUNCTION
Node.js
Python
Java
C#

Using AWS Lambda
Bring your own code
• Node.js, Java, Python, C#
• Bring your own libraries
(even native ones)
Simple resource model
• Select power rating from
128 MB to 1.5 GB
• CPU and network
allocated proportionately
Flexible use
• Synchronous or
asynchronous
• Integrated with other
AWS services
Flexible authorization
• Securely grant access to
resources and VPCs
• Fine-grained control for
invoking your functions

Using AWS Lambda
Authoring functions
• WYSIWYG editor or
upload packaged .zip
• Third-party plugins
(Eclipse, Visual Studio)
Monitoring and logging
• Metrics for requests,
errors, and throttles
• Built-in logs to Amazon
CloudWatch Logs
Programming model
• Use processes, threads,
/tmp, sockets normally
• AWS SDK built in
(Python and Node.js)
Stateless
• Persist data using
external storage
• No affinity or access to
underlying infrastructure

Amazon S3 Amazon
DynamoDB
Amazon
Kinesis
AWS
CloudFormation
AWS CloudTrail Amazon
CloudWatch
Amazon
Cognito
Amazon SNSAmazon
SES
Cron events
DATA STORES ENDPOINTS
DEVELOPMENT AND MANAGEMENT TOOLS EVENT/MESSAGE SERVICES
Event sources that trigger AWS Lambda
… and a few more with more on the way!
AWS
CodeCommit
Amazon
API Gateway
Amazon
Alexa
AWS IoT AWS Step
Functions

Amazon
DynamoDB
Amazon
Kinesis
Amazon
S3
Amazon
SNS
ASYNCHRONOUS PUSH MODEL
STREAM PULL MODEL
Lambda Real-Time Event Sources
Amazon
Alexa
AWS
IoT
SYNCHRONOUS PUSH MODEL
Mapping owned by Event Source
Invokes Lambda via Event Source API
Resource-based policy permissions
Concurrent executions
Sync invocation
Async Invocation
Sync invocation
Mapping owned by Lambda
Lambda function invokes when new records
found on stream
Lambda Execution role
policy permissions
Lambda polls the streams
HOW IT WORKS

Amazon API Gateway
Internet
Mobile Apps
Websites
Services
AWS Lambda
functions
AWS
API Gateway
Cache
Endpoints on
Amazon EC2
All publicly accessible
endpoints
Amazon
CloudWatch
Monitoring
Amazon
CloudFront
Any other AWS
service

Create a unified
API frontend for
multiple micro-
services
Authenticate and
authorize requests
to a backend
DDoS protection
and throttling for
your backend
Throttle, meter,
and monetize API
usage by 3rd party
developers
Amazon API Gateway

APPLICATION LIFE CYCLE IN AWS STEP FUNCTIONS
AWS STEP FUNCTIONS
Visualize in the
Console
Define in JSON Monitor
Executions

DEFINE IN JSON AND THEN VISUALIZE IN THE CONSOLE
39AWS STEP FUNCTIONS
{
”Comment”: “Hello World Example",
"StartAt” : "HelloWorld”,
"States” : {
"HelloWorld” : {
"Type” : "Task",
"Resource” :
"arn:aws:lambda:REGION:ACCOUNT_ID:function:FUNCTION_NAME”
,
"End” : true
}
}
}

MONITOR EXECUTIONS FROM THE CONSOLE
40AWS STEP FUNCTIONS

Customers innovating with serverless applications

Common Lambda use cases
Web
Applications
• Static websites
• Complex web
apps
• Packages for
Flask and
Express
Data
Processing
• Real time
• MapReduce
• Batch
Chatbots
• Powering
chatbot logic
Backends
• Apps &
services
• Mobile
• IoT
</></>
Amazon
Alexa
• Powering
voice-enabled
apps
• Alexa Skills Kit
IT
Automation
• Policy engines
• Extending
AWS services
• Infrastructure
management

Serverless Distributed Computing: PyWren
• PyWren Prototype Developed at University of California, Berkeley
• Uses Python with AWS Lambda stateless functions for large scale data
analytics
• Achieved @ 30-40 MB/s write and read performance per-core to S3 object
store
• Scaled to 60-80 GB/s across 2800 simultaneous functions

Common use cases
• Makers of Dragon Quest
• Lambda processes 200-300
images uploaded per minute
• Peak processing of 6,000
images per minutes
• Reduced image processing
time from hours to
only 10+ seconds

15-20 minutes of processing  now in seconds
2x order of magnitude for cost savings
https://www.youtube.com/watch?v=TXmkj2a0fRE
Nordstrom Recommendations

Amazon Alexa Skills
Your skill code

Your Skill Token
NoSQL database
Exchange LWA token for
AWS access key and secret key
Authenticate user
Receives OAuth token
Invoke
w/OAuth token
Identity provider
Use access key and secret key
to read/write items

Amazon AI
Bringing Powerful Artificial Intelligence To All Developers
Amazon
Rekognition
Amazon
Polly
Amazon
Lex

Amazon Rekognition:
Image Recognition And Analysis Powered By Deep Learning
Amazon Rekognition
Car
Outside
Daytime
Driving
Objects/Scenes
Female
Smiling
Sunglasses
Faces
Images In, Categories and Facial Analysis Out

Recognize, Search & Understand Images
Easy to use Batch
analysis
Real time
analysis
Low costContinually
improving

Amazon Polly: Text To Speech
Powered By Deep Learning
Amazon Polly
“The temperature
in WA is 75°F”
“The temperature
in Washington is 75 degrees
Fahrenheit”
Text In, Life-like Speech Out

Text To Speech Powered By Deep Learning
Returns an MP3
audio stream
Unlimited
replay
Fully managedLightning fast
responses

Amazon Lex:
Speech Recognition & Natural Language Understanding
Amazon Lex
Automatic Speech Recognition
Natural Language Understanding
“What’s the weather
forecast?”
Weather
Forecast

Amazon Lex:
Amazon Lex
forecast?”
Weather
Forecast
“It will be
sunny
and 75F”

Amazon Lex:
Amazon Lex
forecast?”
Weather
Forecast
“It will be
sunny
and 75F”
“It will be sunny
and 75 degrees
Fahrenheit”
Amazon Polly

Build Natural, Conversational Interactions In Voice & Text
Integrated
development in the
AWS console
Fully
managed
Trigger
Lambda
functions
Continually
improving
ASR & NLU
models
Enterprise
connectors
Multi-step
conversations

“Bigger” Data
+ Serverless
+ AI
== the future!

aws.amazon.com/blogs/aws
aws.amazon.com/new
@AWScloud

Chris Munns
munns@amazon.com
@chrismunnshttps://www.flickr.com/photos/theredproject/3302110152/

https://secure.flickr.com/photos/dullhunk/202872717/

AWS Innovate Montreal Keynote - by Chris Munns

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to AWS Innovate Montreal Keynote - by Chris Munns

Similar to AWS Innovate Montreal Keynote - by Chris Munns (20)

More from Amazon Web Services

More from Amazon Web Services (20)

Recently uploaded

Recently uploaded (20)

AWS Innovate Montreal Keynote - by Chris Munns