AWS provides unprecedented processing power for graphics-intensive applications in areas such as design, engineering simulations, and 3D content rendering. With Amazon EC2 Elastic GPUs, you can easily attach low-cost graphics acceleration to a wide range of EC2 instances over the network, without the constraints of fixed instance types. In this session, learn more about Elastic GPUs architecture, and how you can build powerful graphics-intensive solutions with great flexibility, high quality, and low cost. Our guest speakers discuss their experience building application streaming and SaaS products on top of Elastic GPUs. You also hear from our ISV partners about certifying Elastic GPUs for their 3D applications.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS re:INVENT
Unleash Your Graphics Solutions
with the Flexibility of Elastic GPUs
L e t i a n F e n g , S e n i o r P r o d u c t M a n a g e r – T e c h n i c a l , E C 2
N i k o l a B o z i n o v i c , F o u n d e r , F r a m e
C r a i g R u c h t i , A p p l i c a t i o n s E n g i n e e r , S i e m e n s
N o v e m b e r 2 7 , 2 0 1 7

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Scientific Medical CAD
Gaming CAE Seismic
Graphics Workloads

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
GPU Instances
Many graphics workloads work well with GPU instances (G2, G3)
• Applications that:
• Requiring full access to GPU features
• Consume all of GPU resource
• That need to access hardware encoding
• Use CUDA/OpenCL together with OpenGL/DirectX
• Examples?
• Batch rendering for animation, visual effects, VR
• High-end video games
• GPGPU-based computer-aided engineering (CAE)

4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
GPU Instances
GPU instances have fixed ratio of CPU, RAM, and GPU, which means:
• You might be overprovisioning CPU/RAM to get the desired amount of
GPU resource
• You might be overprovisioning GPU to get more CPU power or larger
RAM
• GPU may be over-powered for light-weight graphics use cases
• Examples?
• Viewing 3D model
• CAD/CAM/CAE
• HPC in-situ visualization

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Elastic GPUs Provide the Best of Both
Choose an EC2 instance with
the right CPU/RAM capacity
T2, M4, C4, R4, etc…
Choose a GPU with the right
graphics performance

6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Overview of Amazon EC2 Elastic GPUs
• Easily attach low-cost graphics acceleration to EC2 instances
• Choose a GPU resource sized for your workload
• Available between 1GB of frame buffer and 8GB of frame buffer.
• Ideal If you need:
• a small amount of GPU for graphics acceleration, or
• you have applications that could benefit from some GPU, but
also require high amounts of compute, memory, or storage

7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Overview of Amazon EC2 Elastic GPUs
• Flexible size and attachment
• Workstation-class graphics performance
• Optimized performance and cost
• OpenGL 4.2 support
• Compatible with a wide range of streaming protocols
Flexible Performance Cost-effective API Support

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Overview of Amazon EC2 Elastic GPUs
Application run
on CPU
Graphics API Call
Image
Elastic
GPU
Driver
Graphics API Call
Image

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Overview of Amazon EC2 Elastic GPUs
$0.00
$2.00
Price
g3.4xlarge
g2.2xlarge
t2.medium+eg1.medium
Flexible attachment matters because
it allows you to combine the right EC2
instance with the appropriate amount
of GPU resource.
You save on
• Compute cost (CPU/RAM)
• Software licensing cost
• GPU cost
Elastic GPUs allow you to save your
spending on graphics infrastructure
by up to 85%

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Overview of Amazon EC2 Elastic GPUs
0
0.5
1
1.5
2
2.5
3
3.5
0 10 20 30 40 50 60
UserPerception
Frame Rate
User Performance1 vs Frame Rate User Perception2 vs Frame Rate
For many workloads, frame rate >20fps has diminishing marginal value to human perception
of graphics quality and human performance. Elastic GPUs allow you to right-size your GPU.
Source: M Claypoola et al. “The effects of frame rate and resolution on users playing first person shooter games”, Proceedings of SPIE, 1/15/2006, ISSN: 0277 -786X, Volume
6071, Issue 1
1User performance is determined by the number of times the user killed the bot
2User Perception is a subjective measure of how appealing the game looks to users
0
0.5
1
1.5
2
2.5
3
3.5
4
0 10 20 30 40 50 60
Score
Frame Rate
Elastic GPUs $
Over-provisioned
GPU $$$
Elastic GPUs $
Over-provisioned
GPU $$$

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Overview of Amazon EC2 Elastic GPUs
Over-provisioned GPU Elastic GPUs
Many interactive graphics workloads are
spiky. They only utilize GPU sporadically, and
a large portion of GPU resources are not being
utilized
Elastic GPUs leverage GPU virtualization
technology to allow you to attach a small
amount of GPU resource to your EC2 instances.
You only need to pay for the GPU resource you
need
GPU
resource
underutilized
between
spikes
Only pay
for the
GPU
resource
you need
High frames
per second
generated

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Overview of Amazon EC2 Elastic GPUs
Many Interactive Graphics Workloads GPU Benchmarking Workloads
GPU benchmark result may not be a good indicator of the user experience of many interactive
graphics workloads because it is stressing GPU constantly.
Make your GPU purchasing decision based on user experience, not benchmark result!

13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Overview of Amazon EC2 Elastic GPUs
Many Interactive Graphics Workloads GPU Benchmarking Workloads
GPU benchmark result may not be a good indicator of the user experience of many interactive
graphics workloads because it is stressing GPU constantly.
Make your GPU purchasing decision based on user experience, not benchmark result!

14. Run Any Software in a Browser
November 2017 – Amazon EC2 Elastic GPUs

15. Frame is a secure cloud platform that lets
enterprises and ISVs deliver software-defined
workspaces to users on all connected
devices.
What is Frame?

16. Global, programmable cloud platform for
streaming of Windows apps and desktops
Founded in 2012, HQ in San Mateo. 80 people, offices
in CA, DC, and Serbia.
Key strategic contracts and partnerships: Autodesk,
VMware, leading ISVs, US Gov; hundreds of enterprise
customers
Backed by leading VCs ($30M+raised)
Delivered as a hosted service or as software
(private edition)
At a glance

17. Evolution of graphics on Frame
Frame founded in 2012, launched at AWS
re:Invent 2013
Focused on streaming graphics apps from the
beginning
g2.2xlarge is a workhorse, but over-powered for
some use cases
Elastic GPUs good for many use cases with
OpenGL; used side by side with g2 and g3
instances, and instances without graphics

18. Motivation: It is not easy to deliver enterprise
desktop software from the cloud.
On-Premises

19. 10x 1/2 1%
Frame: high-performance, secure, affordable, easy-to-use platform
Shorter time to
value
Cost Administration
complexity
Solution
0
Change in the
applications

20. Frame is more than just a protocol
App streaming and graphics
are important part of Frame,
and they fit together perfectly
with other parts of the
system to create great user
experience.

21. Rich set of enterprise-grade
features running on a modern,
cloud-first architecture.
Everything you need to run
a large scale production
system on AWS today
Scales to 1,000s of concurrent
users, advanced enterprise
features (e.g., authentication,
networking, storage).

22. Strong relationship with AWS (Frame was
an integral part of the technical preview
during 2017)
More GPU options : good user
experience at lower cost for many
workloads
Opportunity to boost user experience for
those that aren’t using a GPU today
Deployment scalability is attractive -
significantly easier to add GPUs to any
instance type
Elastic GPUs on Frame

23. The t2.xlarge with 2GB eGPU is
virtually indistinguishable from
g2.2xlarge, and we have a really
good case to move to those
instances!
- CAD ISV
Customer feedback
“The frame rate is smooth, very
similar to our usual Frame
g2.2xl rate it feels like.”
- Visualization Customer

24. Demo: Elastic GPUs on Frame
Easy account creation
Supports eGPUs in all regions
Automatically scale number of
instances running up and down

25. Demo: Elastic GPUs on Frame
(cont.)
Frame: high-performance, secure, affordable, easy-to-use platform
Same Frame account can support
multiple eGPU instance types
Requires reboot before instance is
changed (1-2 minutes downtime)
Users can switch to instances with full
GPU (e.g., g2, g3) when eGPUs are not
enough
Admin can control usage (e.g., default
on eGPU, 10hrs of g2.2xl per month)

26. Visual Benchmarking
One of these videos was recorded on g2.2xlarge, the other on Elastic GPU
Can you tell which one is which?

27. Benchmarking
FPS numbers not fully reflecting visual experience
t2.xlarge + eg1.large
$0.33 per hour
g2.2xlarge
$0.77 per hour

28. 2. Pick infrastructure*
(Compute, Graphics, Network)
1. Bring your apps
4. Connect files
( storage)
3. Authorize users
(SSO)
5. Deliver to users
(Any location, any device)
AD/ADFS Custom
Custom

29. 100s of features for
enterprise; security and
regulatory aware platform.
Built-in compliance
Powerful
features
Fully
Programmable
Modern, developer-friendly
Integrates with 20+ services
(auth, storage, network)
Accelerates time to value
Multiple
deployment
options
Multi-tenant or single-tenant,
hosted service or private edition.
Available in all AWS regions
(incl. GovCloud and C2S)
API
Deliver sets of apps (no full
desktop access) or desktop
experience. Using 1 user per
1 VM in both cases.
Flexible apps
and desktops

30. TrainingTrial ProductionBeta DemoQA
Product development Customer journey Daily use
Instant customer engagement
and sales enablement
Multiple use cases
Deliver applications as SaaS
or move to the cloud
Accelerate development,
collect instant feedback

32. www.fra.me/egpu

33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Moving Your Toolchain to the Cloud
Data &
Process
(PLM)
Conceptual
Design
Engineering Design
(CAD)
Simulation & Analysis
(CAE)
Tooling Design
(CAM)

34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Moving Your Toolchain to the Cloud
Data &
Process
(PLM)
Conceptual
Design
Engineering Design
(CAD)
Simulation & Analysis
(CAE)
Tooling Design
(CAM)

35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Moving Your Toolchain to the Cloud
Conceptual
Design
Engineering Design
(CAD)
Simulation & Analysis
(CAE)
Tooling Design
(CAM)

36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Moving Your Toolchain to the Cloud
Conceptual
Design
Engineering Design
(CAD)
Simulation & Analysis
(CAE)
Tooling Design
(CAM)
Elastic GPU enables
you to move your
whole toolchain and
process to the cloud
with lower cost

37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Solutions in the Cloud
Craig Ruchti
Applications Engineer, Global Technical Business Development
Huntsville, AL
S i e m e n s P L M S o f t w a r e

38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
3,3Billion Euros
+300% 86%
Software sales worldwide
10th largest software
company in the world
Of Fortune
Global 100
Companies
are our
clients
Of our clients
are small and
medium-
sized
enterprises
Tripling of
employees in PL
Business Unit
in 5 years
90%
Siemens PLM Software

39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Siemens PLM Software Solutions
DESIGN
BUILD
SIMULATE
PROGRAM
ANALYZE
EXECUTE
AUTOMATE
SERVICE
NX
Solid Edge
Catchbook
Symbolica
Fibersim
Syncrofit
Mastertrim
Polarion Application
Lifecycle Management
NX Nastran
Imagine.Lab
Virtual.Lab
Test.Lab
Simcenter
Star-CCM+
HEEDS
Tecnomatix
NX CAM
Intosite
Line Designer
Product Intelligence
(becoming a MindAPP)
SIEMENS
DIGITAL SERVICES
SIMATIC
SINUMERIK
SIMOTION
TIA Portal
SIMATIC IT
IBS QMS
WinCC
Camstar
Preactor
Production
Systems
Engineering
COLLABORATE
Teamcenter
CONNECT
Mindsphere

40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.

41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!

42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SaaS on Elastic GPUs
• Challenges of hosting multiple user sessions in one single instance:
• Proper session isolation is hard
• Deal with noisy-neighbor effect
• Scaling is not straightforward
• High blast-radius
• Elastic GPUs help you:
• Provide session isolation natively
• Enforce fair usage of compute and GPU resources
• Straightforward to scale-out
• Reduce blast-radius

43. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Graphics Certification Program
• AWS partners with many ISVs, enabling customers to run a wide range
of applications on the Cloud
• Many of these ISV solutions require GPU accelerated graphics
• The Graphics Certification Program helps ISVs and their customers
achieve the maximum possible graphics performance on AWS

44. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Graphics Certification Program
• AWS partners with ISVs to:
• Test and optimize applications for AWS platform
• Invest in certifying AWS as a supported platform
• Set up customer support mechanics
• Invest in co-marketing
• Interested in having your application certified?
• Contact graphics-certification-program@amazon.com

45. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
To Learn More
• Elastic GPU landing page: https://aws.amazon.com/ec2/elastic-gpus/
• Elastic GPU documentation:
docs.aws.amazon.com/AWSEC2/latest/WindowsGuide/elastic-gpus.html
• Deep Dive on Amazon EC2 Elastic GPUs - 2017 AWS Online Tech Talks:
https://www.youtube.com/watch?v=HbJ2xxgrcCE
• BAP311 - Rethink Your Graphics Workstation Strategy with Amazon
AppStream 2.0

46. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!