Overview of 2016 AWS RE-Invent New Services & Features Releases - Focus on Compute & Machine Learning

1. Technical & Research Business Development Manager
Mia D Champion, PhD
Seattle, US
©2016, Amazon Web Services, Inc. or its affiliates. All rights reserved

2. The 5 Pillars of AWS Well-Architected Framework
• Global Accessibility
• Agility
• Scalability
• Breadth of Functionality
• Pay-As-You-Go-Pricing• Shared Model of
Responsibility
Slide courtesy of

3. © 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

4. Re:Invent Summary of New Releases

5. Summary
Service Availability Regions
Organisations Preview us-east-1
New Instance Types Mixed Mixed
Lightsail Now us-east-1
Athena Now us-east-1, us-west-2
Polly Now
us-east-1, us-west-2, us-east-2,
eu-west-1
Rekognition Now us-east-1, us-west-2, eu-west-1
Lex Preview us-east-1
Aurora with
PostgreSQL
Preview us-east-1
Greengrass Preview
us-east-1, us-west-2, eu-west-
1, ap-southeast-2, ap-
northeast-2, ap-northeast-1, ap-
southeast-1
Snowball Edge Now Same as Snowball
Snowmobile Now All regions
AppStream 2.0 Now
us-east-1, us-west-2, eu-west-
1, ap-northeast-1
Shield Now Standard Everywhere
Elastic GPU Preview us-east-1
Service Availability Regions
Shield Advanced Now
us-east-1, us-west-2,
eu-west-1, ap-
northeast-1
CodeBuild Now
us-east-1, us-west-2,
eu-west-1
Batch Preview us-east-1
Step Functions Now
us-east-1, us-east-2,
us-west-2, eu-west-1,
ap-northeast-1
OpsWorks for
Chef Automate
Now
us-east-1, us-west-2,
eu-west-1
EC2 Systems Manager Now Most regions
Personal Health Dashboard Now All regions
Blox Now N/A
X-Ray Preview
All Regions except cn-
north-1, us-gov-west-1
Pinpoint Now us-east-1
Lambda@Edge Preview All edge locations
Glue Pre-announcement -
*Services included in my deeper-dive

6. Re:Invent
New compute offerings

8. New Instance Types
General Purpose Computing
• T2 (Burstable CPU)
• Added t2.xlarge, t2.2xlarge
• Available today (including
GovCloud)
• R3 → R4 (Memory Optimized)
• Upgraded from Ivy Bridge to
Broadwell
• Added 16xlarge with 488 GiB RAM
• Available today (including
GovCloud)
• C4 → C5 (Compute Optimized)
• Upgraded from Haswell to Skylake
• Available 2017
High Performance I/O
• I2 → I3
• 5 sizes, 3.3M IOPS for random
reads. 8 GB/s total throughput for
sequential reads
• Ideal for transactional workloads,
high performance databases, real
time analytics, NoSQL databases
• Upgraded from Ivy Bridge to
Broadwell
• SSDs upgraded to NVMe-based
drives
• 3.3 million random IOPS (4
kiB block size)
• 16 GB/sec throughput
• Up to 64 vCPUs, 488 GiB RAM,
15.2 TB storage (vs. 32/244/6.4)
• Added encryption at rest

9. Recently Released Instance Types
• X1 memory-optimized Instances
• 1,952 GiB of DDR4 based memory, 8x the memory offered by any other Amazon EC2
instance
• Each X1 instance is powered by four Intel® Xeon® E7 8880 v3 (Haswell) processors
and offers 128 vCPUs
• G2 → P2 GPU Instances
• P2’s provide up to 16 NVIDIA K80 GPUs, 64 vCPUs and 732 GiB of host memory
• combined 192 GB of GPU memory, 40 thousand parallel processing cores, 70 teraflops
of single precision floating point performance, and over 23 teraflops of double precision
floating point performance.
• GPUDirect™ (peer-to-peer GPU communication) capabilities for up to 16 GPUs, so that
multiple GPUs can work together within a single host.
• ENA-based Enhanced Networking for cluster P2 instances

10. Elastic GPUs
Name GPU Memory
eg1.medium 1 GiB
eg1.large 2 GiB
eg2.xlarge 4 GiB
eg2.2xlarge 8 GiB
OpenEye Scientific on AWS
• Flexible: Elastic GPUs come in a wide range of sizes and attach a wide range of EC2 instances
allowing users to scale GPUs independent of CPU and RAM.
• Cost-effective: fraction the cost of purchasing full GPU instances
• OpenGL-compliant: run any graphics-intensive application
• Workstation quality: capable of running a wide range of demanding graphics workload, such as 3D
modeling. Streaming options include NICE Desktop Cloud Visualization

11. Machine Learning & AI in Medical Software
• High-level Performance & Scalable
• CPU/GPU Cluster Networks
• Support up to 20Gbps of
low-latency networking
• Elastic GPUs
• ELB vs EFS (Elastic File
System)
• Application Elastic Load
Balancing
• ECS RunTask & Blox

13. Amazon EFS & Amazon EBS
• EBS GP2 (SSD) would have a max Volume throughput of 160MB/s and
1,250MB/s to the instance.
• EFS throughput is tied to the provisioned storage in the EFS volume
• All file systems deliver a consistent baseline performance of 50 MB/s per
TB of storage
• All file systems (regardless of size) can burst to 100 MB/s
• File systems larger than 1TB can burst to 100 MB/s per TB of storage.
• As you add data to your file system, the maximum throughput available
to the file system scales linearly and automatically with your storage.

14. EC2 F1 instances
Preview
F1 is the first compute instance with customer programmable FPGA
hardware for application acceleration
• Speed up applications 30x with dedicated access to high
performance FPGAs
• Includes Hardware Developer Kit (HDK) and developer AMI
• Amazon FPGA Images (AFI) can be reused across F1 instances
• Ideal for data flow applications including transcoding, financial and
risk modeling, genomic analysis, big data processing, and large
scale simulations

15. EC2 F1 instances
Preview
• Vivado Design Suite
supported for ultra high
productivity with next
generation C/C++ and
IP-based design

16. We have developed DRAGEN™,
the world’s first bioinformatics
processor that uses a field-
programmable gate array (FPGA) to
provide hardware-accelerated
implementations of genome pipeline
algorithms, genome data
compression, and has been shown
to speed whole genome data
analysis from hours to minutes,
while maintaining high accuracy
and reducing costs”
Pieter van Rooyen, Ph.D.
Chief Executive Officer of Edico Genome
”
“
• The reconfigurable DRAGEN™ Bio-IT
Platform can be loaded with highly
optimized algorithms including Whole
Genome or Exome, RNAseq,
Methylome, Microbiome and Cancer.
• Creating an AWS product offering
(currently workflows are provided as a
service)

17. AWS CodeBuild
• Fully managed build service that compiles source code, runs tests, and
produces software packages that are ready to deploy.

18. Introducing AWS Batch
Preview - us-east-1
Easily and efficiently run hundreds of thousands
of batch computing jobs on AWS.
Fully Managed
Eliminates the need to operate
batch processing solutions
Cost Optimized Resource
Provisioning
Dynamically scales compute
resources to any quantity
required
Integrated with AWS
Natively integrated with the AWS
platform

19. AWS Batch Key Features
Dynamic Spot Bidding
Integrated Monitoring and Logging
Fine-grained Access Control
Priority-based Job Scheduling
Granular Job Definitions
Simple Job Dependency Modeling
Support for Popular Workflow Engines
Dynamic Compute Resource Provisioning and Scaling
ECS Task Placement Engine will manage EC2 instances and containers
according to job specifications like binpacking, spread, affinity.
EC2 Container Service (ECS) Feature

20. Introducing Blox Available Now
A collection of open source projects for container management and orchestration
on Amazon ECS
• Customized scheduling and orchestration
• Build schedulers and integrate third-party schedulers on top of ECS
• Leverage Amazon ECS to fully manage and scale your clusters.
Build Custom Schedulers
End to End Developer
Experience
Integrate 3rd Party
Schedulers

21. Introducing AWS Step Functions
Available Now - us-east-1, us-east-2, us-west-2, eu-west-1, ap-northeast-1
Coordinate distributed applications using visual workflows
• Visually arrange components as a series of steps – in a matter
of minutes
• Triggers and tracks each step so applications execute in order
and as expected
• Handles errors with built-in retry and fallback
• Works with AWS Lambda, Amazon EC2, Amazon EC2
Container Service (ECS), Amazon CloudWatch, and Auto
Scaling

22. Compared to other available methods, GT-Scan2
identifies genomic location with higher sensitivity
and specificity …[and]... democratizes the ability
to find optimal CRISPR target sites by offering
this complex computation as a cloud-service
using AWS Lambda functions [in an architecture
with DynamoDB, API gateway, S3, and SNS]
Denis Bauer, PhD
Team Leader, Transformational Bioinformatics, CSIRO
”
“  CRISPR-Cas9 technology can be used
to recognize and edit specific locations
in the genome by pattern-matching
unique sequences of DNA
 New genome editing technology
introduces revolutionary way of
approaching Cancer treatment
 Identification of robust on target
CRISPR sites is computationally
intensive and time-sensitive
Cloud services for computationally guided genome engineering
Researchers at the Commonwealth Scientific and Industrial Research Organization (CSIRO) in
Australia used AWS resources to power an innovative tool (GT-Scan2) for genome editing engineering

23. Other Announcements
Lambda C# support.
Lambda@Edge allows you to run JavaScript code on the AWS edge
network. (Preview)
Amazon Lightsail provides fixed price virtual private servers. (GA)

24. re:Invent
BIG Data Analytics & Machine Learning Services

25. Big Data Analytics on AWS

26. Amazon Athena
Analyze large amounts of data stored in Amazon S3 using
standard SQL. No hardware to run.
S3 Bucket
Simple Workflow Service
(SWF)
EC2 analysis instances
managed by SWF
Transformed
data
RedShift or RDS
database
Athena

27. Amazon Athena
Based on Presto distributed SQL engine.
Parallelized queries across hundreds or
thousands of cores.
Can process a variety of data formats,
including:
• JSON
• CSV
• Log files
• Text with custom delimiters
• Apache Parquet (columnar format)
• Apache ORC (columnar format)
Available today in N. Virginia
and Oregon.

28. Amazon Rekognition
Image detection and recognition.

29. Amazon Rekognition
APIs:
CreateCollection
DeleteCollection
ListCollections
DetectFaces
CompareFaces
IndexFaces
DeleteFaces
SearchFaces
DetectLabels
Available today in N. Virginia,
Oregon, and Ireland.

30. Amazon Polly
Text to speech service that can be integrated into your own
applications.
• Supports 47 male and female voices.
• Handles 24 different languages.
• Works well with unadorned text.
• Context sensitive: “I live on Main St.” vs. “St. Teresa”
• Also supports Speech Synthesis Markup Language for more detailed
pronunciation.
Available today in Northern Virginia, Oregon, Ohio, and Ireland.

31. Amazon Lex
Build conversational text and voice interfaces.
• Automatic Speech Recognition (ASR)
• Natural Language Understanding (NLU)
• Same technology that powers Amazon
Alexa.

32. OhioHealth Speech Recognition & ML Mobile App
Behind the scenes ML algorithm workflow
OhioHealth Mobile App
We are excited about utilizing
evolving speech recognition and
natural language processing
technology to enhance the lives of
our customers. Amazon Lex
represents a great opportunity for
us to deliver a new experience to
our patients
Michael Krouse,
Senior Vice President Operational Support and
Chief Information Officer, OhioHealth
”
“

33. re:Invent
New storage and data transfer features

34. Simple Storage Service (S3)
• S3 data events in CloudTrail
• Object tagging
• Inventory
Previously announced: IPv6

35. AWS Glue
Fully managed data catalog and ETL service

36. AWS Snowball Edge
Improves on Snowball:
More Connectivity
• 10GBASE-T, 10/25 Gb SFP28, 40 Gb QSFP+
• 3G cellular, Wi-Fi for IoT devices
• PCIe expansion port
More Storage
• 100 TB of storage
Horizontal Scaling and Clustering
• Add capacity and durability
• Rack mountable

37. AWS Snowball Edge
New Storage Endpoints
• Supports a subset of the S3 API.
• NFS v3 and v4.1 support.
• File and directory metadata are mapped to S3 metadata.
Local Lambda Functions
• Can filter, clean, analyze, track, summarize data as it
arrives.
• Python 2.7, 128 MB environment support.

38. AWS Snowmobile

39. AWS Snowmobile
Import up to 100 PB of data
Standard shipping container (45’ long x 9.6’ high x 8’ wide); water-proof
and climate-controlled
350 kW power required (AWS can arrange for a generator)
Data is encrypted using KMS keys
Chain-of-custody tracking; video surveillance; GPS tracking with
cellular and satellite telemetry; security vehicle escort; on-premises
security guards available
Multiple 40 Gb/s connections; 1 Tb/s aggregate throughput

40. re:Invent
New security and management features

41. AWS Organizations
Organizations allows you to create groups of AWS
accounts to more easily manage security and automation
settings.
• Centrally manage multiple accounts to help you scale.
• Control which AWS services are available to individual accounts
• Automate new account creation
• Simplify billing
In preview.

42. AWS Shield
Managed DDoS protection.
All AWS customers benefit from the automatic protections of AWS Shield
Standard, at no additional charge. AWS Shield Standard defends against most
common, frequently occurring network and transport layer DDoS attacks that
target your web site or applications.
AWS Shield Advanced provides enhanced detection and mitigation customized
to your application. The AWS DDoS Response Team (DRT) applies manual
mitigations against more complex and sophisticated DDoS attacks. DDoS cost
protection provides a safeguard against scaling charges as a result of a DDoS
attack.
Available now.

43. Mia D. Champion, PhD
Technical & Research Computing
Business Development Manager
miachamp@amazon.com