Netflix is using AWS Snowball Edge to deliver post-production content to our asset management system, called Content Hub, in the AWS Cloud. Production companies have been historically using LTO tapes to move data around, and that has well-known complications. In order to accelerate and secure our media workflows Netflix has shifted to using Snowball Edge devices for data migration. Please join us to learn how Netflix is using the Snowball Edge service at scale.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Post-Production Media Delivery
at Scale with AWS
Zile Liao
Senior Software Engineer
Netflix/Content Platform
Engineering
STG391
Brandon Bussinger
Product Manager
Netflix/Content Platform
Engineering

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
OUR CHALLENGE*
*WARNING: FUZZY MATH TO FOLLOW

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
NETFLIX ORIGINALS BY YEAR
WTF!700400100 250

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
10TB
DEVELOPMENT
250TB
PRODUCTION
50TB
EDITORIAL
10TB
SOUND
25TB
VFX
50TB
FINISHING
5TB
FINAL MASTER
PRODUCTION DATA FOOTPRINT

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
300TB - 1PB
2HR 4K FEATURE
PRODUCTION DATA FOOTPRINT

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
5000 Content Hours / Year
X
200 TeraBytes/CH @ 4K
=
1.625 ExaBytes/YR

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pitch
Deal
Negotiation
Development Production
Post
Production Delivery Launch
6-24 Months

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
OUR REQUIREMENTS

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
MINIMAL WAN NEEDS
RUGGED
SECURE
RELIABLE
FAST
GLOBAL LOGISTICS SUPPORT
CREATIVE USER FRIENDLY
IDEAL SOLUTION

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS SNOWBALL EDGE

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
✓ MINIMAL WAN NEEDS
✓ RUGGED
✓ SECURE
✓ RELIABLE
✓ FAST
✓ GLOBAL LOGISTICS SUPPORT
✓ CREATIVE USER FRIENDLY
IDEAL SOLUTION
✓ MINIMAL WAN NEEDS
✓ RUGGED
✓ SECURE
X RELIABLE
X FAST
✓ GLOBAL LOGISTICS SUPPORT
X CREATIVE USER FRIENDLY
AWS SNOWBALL EDGE

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Snowball Vendor Netflix Title
Roles

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Snowball Edge
● 90 TB usable space
● 10 GBase-T
● S3 REST API

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Content Delivery Workflow

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Anand Narasimhan Govindaraju Muthusamy
Rajnish Prasad
Jose Thomas Poorna Reddy
Rebeca Gallardo Victor Yelevich Jackie Yu
Nick Levin

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Order Snowball
1. Capture vendor’s name and
address
2. Use AWS Snowball Service
API to create a new job
3. Associate Snowball job ID
with Netflix title, uploader
user name, AWS region,
and other metadata.

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why Netflix CLI?
1. Security
2. Large file chunking
3. Performance
4. Batch management
5. Resumability

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Local File Transfer Using CLI
1. Authenticate & Authorize
2. Unlock Snowball
3. Checksum verification
4. Sync local content with Cloud Drive
5. High speed upload

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Server Side Ingestion
1. Notify user of Snowball State Transition
2. Aggregate file parts; compute
checksums
3. Activate Cloud Drive items
4. Monitor batch for completion

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Challenges (CLI)
1. Speed
2. CPU
3. Memory
4. Data source

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Challenges (CLI)
1. Speed
2. CPU
3. Memory
4. Data source

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Challenges (CLI)
1. Speed
2. CPU
3. Memory
4. Data source

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Challenges (Server Side)
1. 100% completeness
2. Multi-region
3. Operation & Support

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Snowball Edge with AMI
• Download via Snowball (Export)
• Workflow optimization for “on-set” use
Looking forward...

33. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Zile Liao
zliao@netflix.com
Brandon Bussinger
bbussinger@netflix.com

34. Please complete the session
survey in the mobile app.
!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.