SlideShare a Scribd company logo
1 of 69
1© 2017 Quantum Corporation | Company Confidential
3© 2017 Quantum Corporation | Company Confidential
5© 2017 Quantum Corporation | Company Confidential
WHAT’S CHANGING?
VIDEO PRODUCERS ARE MOVING TO ADOPTING
HIGHER STANDARDS FOR:
9© 2017 Quantum Corporation | Company Confidential
11© 2017 Quantum Corporation | Company Confidential
Power by
14© 2017 Quantum Corporation | Company Confidential
Atiwat Rungsirikulwit
Business Development Manager
BUILD A NEXT-GENERATION
STORAGE ENVIRONMENT FOR
4K/UHD VIDEO WITH QUANTUM SOLUTIONS.
15© 2017 Quantum Corporation | Company Confidential
What These Applications Need
Impossible for a single storage
configuration to deliver all of
these three attributes
Performance
Meet the
requirements
of demanding
workflows
Access
Access all data
at any time
from any client
Low-cost
Capacity
Efficiently store vast
amounts of data for
long-term retention
16© 2017 Quantum Corporation | Company Confidential
What Quantum Delivers
Performance
Access
Low Cost
Capacity
Only Quantum provides flexible
storage platform that delivers all
three attributes simultaneously
17© 2017 Quantum Corporation | Company Confidential
Quantum Summary
Northampton,
UK
EMEA Service HQ
Paris, FR
EMEA HQ
Kuala Lumpur,
MY
APAC Service HQ
Beijing, PRC
North Asia Service HQ
Singapore
APAC HQ
Sydney &
Adelaide, AU
Dedupe R&D
BELLEVUE, WA
WW Sales, Mktg,
& Finance
San Jose, CA
WW HQ
DXi and VM R&D
Irvine, CA
Devices R&D
Denver, CO
Systems R&D / Test
WW Service
Mendota Hts.,
MN
Scale-out Storage R&D
35
100K
74
year storage specialist
deployments in 100+ countries,
serviced by world-class support
% growth in scale-out storage
2300
650
trained engineers
patents – strong IP in file systems
& data lifecycle management
18© 2017 Quantum Corporation | Company Confidential
Leaders in Media and Entertainment
ALL BIG SIX MOVIE STUDIOS RELY ON STORNEXT
ALL BIG FOUR BROADCAST NETWORKS RELY ON STORNEXT
100,000 STORNEXT LICENSES DEPLOYED
WORLDWIDE
4
6
Info Browser
19© 2017 Quantum Corporation | Company Confidential
Modern Workflows Have Changed
Video content is 100% digital from ingest
through archive
Globally distributed teams require
shared access
Files sizes are highly variable depending on
the stage of the workflow
Asset and content size continues to grow as
resolutions increase
Topologies and interconnects have evolved—
there is no single one-size-fits-all interconnect
Deliver
20© 2017 Quantum Corporation | Company Confidential
CHALLENGES AND LIMITATIONS TO
4K WORKFLOW
21© 2017 Quantum Corporation | Company Confidential
What Impacts 4K Performance
Data Rate
– Compressed or Uncompressed
– Resolution and Frame Rate
Stream Count
– Number of cameras used in acquisition,
composition layers, workstation requirements
– Mezzanine or proxy workflows
Host (client) machine
Drive type
22© 2017 Quantum Corporation | Company Confidential
8K UHD is on the way
7680 x 4320 16-bit @ 60fps
12 GB/s 12.9 TB/hr
4K UHD
3840 x 2160 10-bit @ 60fps
2 GB/s 7.2 TB/hr
Cinema4K
4K DCI
(4096 x 2160) 10-bit @ 24fps
849 MB/s 3.1 TB/hr
2K
High-Definition (Full HD)
1920 x 1080 10-bit @ 30fps
248 MB/s 896 GB/hr2K
(2048 x 1080) 10-bit @ 24 fps
212 MB/s 764 GB/hr
Standard Definition
720 x 488
10-bit@ 29.97fps
27 MB/s 94 GB/hr
The 4K Family
• Approx. 4X the horizontal resolution of HD
• 3840x2160, 4096x2160 most common
• 4096x3072, 4096x3112 variants
• All “4K”
Uncompressed - Defined
23© 2017 Quantum Corporation | Company Confidential
But All 4K Is Not Equal
4K Format
Resolution
(W x H)
Frame Rate
(fps)
Data Rates
(MB/s)
Storage Capacity
(GB/Hr)
UHD ProRes 422 HQ 3840 X 2160
30 111 400
60 221 796
UHD ProRes 4444 XQ 3840 X 2160 30 249 896
UHD (10 bit) 3840 x 2160
24 807 2,905
60 1990 7,164
4K Full App (10 bit) 4096 x 3112 24 1224 4,406
UHD (16Bit) 3840 x 2160 60 3190 Untested
4K Format Guide
• 4K is horizontal resolution of approx. 4,000 pixels
• There are several resolutions that qualify as 4K
• UHD or “Quad HD” is 4x HD resolution (TV)
• Full App 4K is Super 35mm resolution (Film)
Tested formats and frame rates
24© 2017 Quantum Corporation | Company Confidential
How Operating Systems Differ
Linux is the optimal performer
– More efficient HBA drivers
Windows drivers have more CPU overhead, less efficient
– Windows is 15% less efficient than Linux
40-60% less efficient in multi-client environments than either
– macOS is overly aggressive with I/O requests
25© 2017 Quantum Corporation | Company Confidential
4K Challenges in Post
Flat-bidding
Unknown shooting ratios
Last-minute client demands
UHDp60, HFR, HDR, WCG accelerating quality,
consumption and delivery
Film / tape to RAW on disk
More cameras = more streams
VFX and grading = more bandwidth, nodes and
disk
26© 2017 Quantum Corporation | Company Confidential
Collaborative 4K Post Is Not Easy
Varying size and data rates challenge
standard file systems
– Reading, writing, tracking, sharing and
protecting
NAS-based HD will struggle with 4K
workflows
– Latency from packetization is real
RAID 5 Performance/Protection
Tradeoffs
– Large TB drives in RAID 5 leave valuable
media exposed during rebuilds
27© 2017 Quantum Corporation | Company Confidential
The Right Drive for the Job
LFF HDDs
– High-capacity
– Low performance (7.2K RPM)
– Affordable
SFF HDDs
– Low capacity
– High performance (10K RPM)
– Higher priced
SFF Solid State Drives (SSDs)
– Lowest capacity
– Highest performance
– Highest price
Matching Drive Type to Stream Count Requirements
SSD
SFF
LFF
Capacity
Performance
High
Data Rate/
Low Stream Count
High
Data Rate/
High Stream Count
Low
Data Rate/
Low Stream Count
Low
Data Rate/
High Stream Count
28© 2017 Quantum Corporation | Company Confidential
29© 2017 Quantum Corporation | Company Confidential
INTRODUCING XCELLIS CONVERGED STORAGE
Xcellis™ includes both data
storage and data management
Xcellis Workflow Director
Xcellis Storage
Built for StorNext 6
Same tiered storage platform
Greater Connectivity
Massive Scalability
StorNext Connect™ Built-In
30© 2017 Quantum Corporation | Company Confidential
Converged Architecture
Continuous Scalability
Unified Access
31© 2017 Quantum Corporation | Company Confidential
CONVERGED ARCHITECTURE
StorNext Metadata
Appliance
DLC Gateway
User Storage
NAS Gateway
Dedicated Metadata
Storage
Metadata Appliance
High Availability Pair
Xcellis Workflow Director
Xcellis Workflow Director
High Availability Pair
Metadata + User
Storage
Optional Dedicated
Metadata Storage
• Xcellis Workflow Director includes
SAN, DLC & NAS client connectivity
• Xcellis metadata storage resides in
user storage or optionally separated
32© 2017 Quantum Corporation | Company Confidential
CONTINUOUS SCALABILITY
12 Drives
~ 1 GB/s
• Add RAIDs for Capacity + Bandwidth
24 Drives
~1.9 GB/s
48 Drives
~3.8 GB/s
56 Drives
~4.5 GB/s
• Any combination of disk performance
33© 2017 Quantum Corporation | Company Confidential
CONTINUOUS SCALABILITY
• Add RAIDs for Capacity + Bandwidth
• Add JBODS for Capacity
• Any combination of disk performance
Initial Investment Protected
12 Drives
~ 1 GB/s
24 Drives
~1.9 GB/s
48 Drives
~3.8 GB/s
56 Drives
~4.5 GB/s
© 2016 Quantum Corporation
UNIFIED ACCESS
METADATA
CONTROL
PATH
Xcellis
XCELLIS
WORKFLOW
DIRECTOR
FIBRE CHANNEL
DATA PATH
STORAGE
SAN CLIENT
35© 2017 Quantum Corporation | Company Confidential
METADATA
CONTROL
PATH
Xcellis
DLC CLIENTSSAN CLIENTS
STORAGE
XCELLIS WORKFLOW DIRECTORS
UNIFIED ACCESS
IP DATA PATH
FIBRE CHANNEL
DATA PATH
36© 2017 Quantum Corporation | Company Confidential
CLIENTS
NAS CLIENTS
DLC CLIENTS
METADATA
CONTROL
PATH
Xcellis
SAN CLIENTS
STORAGE
• File, Directory, and Volume level access
control via StorNext, Active Directory, and
LDAP
FIBRE CHANNEL
DATA PATH
UNIFIED ACCESS
IP DATA PATH IP DATA &
METADATA PATH
37© 2017 Quantum Corporation | Company Confidential
Key Concepts – Tiered Storage
StorNext manages file movement across
types of storage (disk, object storage,
tape or cloud) via policies
Transparent data access regardless of
where it’s stored
Policy applied at directory level
Time-based movement of data
Up to 4 copies on tape and secondary
disk
Checksum creation/validation
Stub files
Windows OS X Linux
38© 2017 Quantum Corporation | Company Confidential
Complete Data Lifecycle Management
Primary
Disk
Archive
Disk Nearline
Tape Active
Vault
$’sPerTB(List)
Access and Restore Times
Nature/ Value of Data Type of Storage
Tuned Performance
Shared Access
Durability
Multi PB Scalability
Lower TCO
Ease of Use
39© 2017 Quantum Corporation | Company Confidential
EXPLORE
40© 2017 Quantum Corporation | Company Confidential
Quality of Service
RESERVED BANDWIDTH
Highest Priority
Bandwidth permanently assigned
DYNAMIC ALLOCATION
Standard Usage
Share bandwidth not assigned to higher or lower
class
Inactive clients donate bandwidth to others in class
LIMITED BANDWIDTH
Controlled Access
Clients access data no higher than the set amount
41© 2017 Quantum Corporation | Company Confidential
Chassis2
Online Stripe Group Management
Single Stripe
Group
Chassis1
Data Automatically
Redistributed and
Defragmented for
Additional Performance
Without Disruption
Much Lower Cost to Scale
vs. Clustered Systems
Add More Space to
Existing Stripe
Group
42© 2017 Quantum Corporation | Company Confidential
Audit History
Track all File System Activity
What, When, Where and Who
Access and Print Activity History for File System
Stores All
File Activity
Report
Generated
SAN DLC NAS
Tracks Activity Across All Client Types and Connectivity Methods
43© 2017 Quantum Corporation | Company Confidential
Mac Finder Remote File Access
ANNOTATED FILE ICONS IDENTIFY
ONLINE AND OFFLINE FILES
Navigating through directories that include offline archives no longer cause slow
searches as the Finder takes time to show the contents of the directory.
Prevents the Storage Manager “storm” caused by Finder recall requests
Enables macOS users to view, access, and manage offline content in archives
Uses StorNext web services to control file retrieves, stores and truncation
OFFLINE ACTIONS
MENU WITH
RETRIEVE, STORE
AND TRUNCATE
MENU ACTIONS
44© 2017 Quantum Corporation | Company Confidential
Primary
StorNext
Tiered Data Management
Copy 1
Lattus
Copy 2
Cloud/Tape
Origin
al File
45© 2017 Quantum Corporation | Company Confidential
Primary
StorNext
Tiered Data Management
Copy 1
Lattus
Copy 2
Cloud/Tape
Files Immediately Protected in Multiple Locations
Files
Protected
Here
Origin
al File
Files
Protected
Here
46© 2017 Quantum Corporation | Company Confidential
Tiered Data Management
Copy 1
Lattus
Copy 2
Cloud/Tape
Primary
StorNext
Files
Protected
Here
Files
Protected
Here
Files
Put
Here
Stub
File
Origin
al File
Truncating a File Frees Valuable Primary Storage Space and Leaves a
“Stub” Pointing to Archived Copies
47© 2017 Quantum Corporation | Company Confidential
Tiered Data Management
Copy 1
Lattus
Copy 2
Cloud/Tape
Primary
StorNext
Files
Protected
Here
Files
Protected
Here
Files
Put
Here
Stub
File
Archived Copies Can Be “Aged Off” of Any Tier Automatically Based On Time
Copy 1
48© 2017 Quantum Corporation | Company Confidential
Tiered Data Management
Lattus
Copy 1
Cloud/Tape
Primary
StorNext
Files
Protected
Here
Files
Put
Here
Stub
File
Origin
al File
Files are Accessed and Restored Just By Clicking
49© 2017 Quantum Corporation | Company Confidential
FlexTier Public & Private Cloud Archives
XCELLIS PRIMARY STORAGE
DATA
Extends StorNext Archive Visibility and Access to a Variety of Targets
50© 2017 Quantum Corporation | Company Confidential
StorNext FlexSync: Point to Point Synchronization
SITE A SITE B
51© 2017 Quantum Corporation | Company Confidential
StorNext FlexSync: Content Distribution
SITE B
SITE C
SITE D
SITE A
52© 2017 Quantum Corporation | Company Confidential
StorNext FlexSync: Content Consolidation
SITE B
SITE C
SITE D
SITE A
53© 2017 Quantum Corporation | Company Confidential
StorNext FlexSync: Content Distribution and Protection
SITE A
TAPEOBJECT/
LATTUS
CLOUD
SITE B
SITE C
SITE D
54© 2017 Quantum Corporation | Company Confidential
SITE A
StorNext FlexSync: Limitless Combinations
SITE B
SITE DSITE C
SITE E
55© 2017 Quantum Corporation | Company Confidential
Designs utilizing Quantum portfolio
SN 6 Specific benefits to 4K
– QoS
– Stripe Group management “Live”
– Tunable parameters
 ASR, ISW, Stripe breadth, # of stripe groups
Xcellis more than just metadata servers
– Converged Architecture
 SAN, NAS, Block over IP
 DLC still stands out above and beyond most if not all Ethernet transport – Line Rate
Performance shared file system across Linux, Windows and macOS
6
POWERED
BY
56© 2017 Quantum Corporation | Company Confidential
XCELLIS 4K REFERENCE
ARCHITECTURES
57© 2017 Quantum Corporation | Company Confidential
How StorNext Scales
“Scale-up” (Capacity)
Adding storage to an existing controller/storage
(RBOD) chassis
• Capacity upgrade with slight increase in
performance from additional spindles
• Too many spindles can saturate the controller
- Xcellis Workflow Director HA Pair
- RBOD (controller & storage)
- Metadata Array
JBOD or EBOD
Expansion, No RAID controller
-
1+1
- JBOD
- JBOD
1+3
- Xcellis Workflow Director HA Pair
- Metadata Array
- RBOD
- JBOD
1+1
2+2
“Scale-Out” (Performance)
Adding RBOD chassis to existing RBOD chassis
(with or without expansion)
• Simultaneous performance and capacity upgrade
• Performance nearly doubles on 4-series controller
- RBOD
- JBOD
58© 2017 Quantum Corporation | Company Confidential
4K Reference Architectures
• Compressed & uncompressed
• Scale-up
• With & w/o archive
Compressed: 8
Uncompressed: 2
• Compressed & uncompressed
• Scale-out
• With & w/o archive
• High compressed stream count
• Low, multiple uncompressed stream count
• Scale-out or scale-up
• Archive-ready
• Very high compressed
stream count
• Multiple, uncompressed
stream count
• Scale-out or scale-up
• Archive-ready
Optional Dedicated Metadata
Dedicated Metadata
StorNext Base 4K
QXS-412 1+1
StorNext High Capacity 4K
QXS-456
QXS-648 w/ SSDs
Price
StreamCount
4K Low-Cost, High-Capacity
LFF
Compressed: 14
Uncompressed: 4
Compressed: 66
Uncompressed: 9
4K High-Performance
SFF SSD
Optional Dedicated Metadata
Dedicated Metadata
Compressed: 28
Uncompressed: 7
4K Performance
SFF
StorNext Performance Disk 4K
QXS-424 2+2
StorNext All Flash 4K
59© 2017 Quantum Corporation | Company Confidential
QXS-412
Low, compressed stream
count
6 3 N/A N/A 48
Xcellis Workflow Director
4K Low-cost, optional archive support
Converged or Dedicated Metadata with 3.5” drives
QXS-412
– Single RAID, compressed only
– Must scale-up for uncompressed support
– 4TB or 6TB HDDs for 48 or 72TB per chassis
– Add 12x900GB 10K for dedicated MD
 Dedicated MD needed Storage Manager archiving
 Optional upgrade to 400GB or 800GB SSDs
Xcellis Workflow Director HA Pair
Power of 2 Expansion = add 1 JBOD
for uncompressed
Power of 2 Expansion = add 3 JBODs
for multi-stream uncompressed
Dedicated Metadata
Metadata + User StorageUser Storage
Xcellis
System
4K Support
ProRes 422 HQ
30 fps
ProRes 4444 XQ
60 fps
Full AP (10 bit)
24 fps
UHD
(10 bit)
60 fps
Capacity
(4TB Drives)
QXS-412 1+1
Low compressed stream
count, two uncompressed
8 4 2 1 96
QXS-412 1+3
Multi-compressed stream
count, two uncompressed
15 6 2 1 192
60© 2017 Quantum Corporation | Company Confidential
QXS-456
– Uncompressed (DPX) capable
– Scale-Out Only: 448 or 672TB w/ 2xRBODs
– 4TB or 6TB for 224/336TB capacity w/ 1xRBOD
– Add 12x900GB 10K for dedicated MD
 Dedicated MD needed for SNSM archiving
 Optional upgrade to 400GB or 800GB SSDs
Converged or Dedicated Metadata with 3.5” drives
4K Low-cost, optional archive support
Xcellis Workflow Director HA Pair
Converged Metadata
RAID expansion only, no JBOD
x2
Dedicated Metadata
Xcellis
System
4K Support
ProRes 422 HQ
30 fps
ProRes 4444 XQ
60 fps
Full AP (10 bit)
24 fps
UHD
(10 bit)
60 fps
Capacity
(4TB Drives)
QXS-456
Multi-stream compressed,
two uncompressed
14 6 2 1 224
QXS-456x2
High compressed stream
count, multi-stream
uncompressed
24 17 6 2 448
61© 2017 Quantum Corporation | Company Confidential
4K Performance, archive ready
Dedicated metadata array w/ 2.5” drives
Xcellis
System
4K Support
ProRes 422
HQ
30 fps
ProRes 4444 XQ
60 fps
Full AP (10 bit)
24 fps
UHD (10 bit)
60 fps
Capacity
(1.2TB Drives)
QXS-424 1+1
Multi-stream
compressed, two
uncompressed
17 7 2 1 57.6 TB
Dedicated Metadata, Archive Ready
RBOD + JBOD for high compressed stream
counts and multi-stream uncompressed
Xcellis Workflow Director HA Pair
Add 1+1 for high stream counts to
multiple rooms or dual stream
uncompressed to multiple rooms
QXS-424 2+2
High compressed stream
count, multi-stream
uncompressed
28 13 5 2 115.2 TB
QXS-424 1+1
– Dedicated 900GBx12 MD, optional SSD
– High compressed and multi-stream uncompressed
– 1.2TB/1.8TB drives for 29/43TB per chassis
Add 1+1
– Total Capacity 115/172TB
– Scale to 28 compressed/5 uncompressed
Super High-Density QXS-448 option
– 58/86TB per chassis
62© 2017 Quantum Corporation | Company Confidential
4K High Performance, archive ready
Dedicated metadata array, SSD
QXS-424 All Flash Array
– Scale-Out Only: 2U24 and 2U48 chassis
– QXS-4 or QXS-6
– 400GB, 800GB, 1600GB SSDs
– Always use dedicated MD
 900GB HDD or SSD based MD array
 Optional upgrade to 400GB or 800GB SSDs
Dedicated Metadata, Archive Ready
RBOD + with 24 400 TB SSDs for multi-
stream uncompressed
Xcellis Workflow Director HA Pair
Xcellis
System
Target
ProRes 422 HQ
30 fps
ProRes 4444 XQ
60 fps
Full AP (10 bit)
24 fps
UHD (10 bit)
60 fps
Capacity
(400GB Drives)
QXS-424 RAID
All Flash
Very high compressed stream
count, multi-stream uncompressed
49 24 3 2 9.6TB
QXS-648 RAID
All Flash
Very high compressed stream
count, multi-stream uncompressed
66 32 6 3 19.2TB
63© 2017 Quantum Corporation | Company Confidential
4K Reference Architectures
QXS-424 2+2 QXS-648 AFAQXS-412 1+1 QXS-456
Price
StreamCount
Base 4K High Capacity 4K High Performance Disk 4K All Flash 4K
1 1 2 32 2
5 6
2
4
7
9
6 5
16
30
4
6
13
32
8
14
28
66
4K Quad HD (10-bit) 60 fps
4K Full (10-bit) 24 fps
UHD (10-bit) 24 fps
ProRes 4444 XQ 30 fps
Apple ProRes 422 HQ 60 fps
ProRes 422 HQ 30 fps
64© 2017 Quantum Corporation | Company Confidential
TESTING OVERVIEW
65© 2017 Quantum Corporation | Company Confidential
Setup
Switch
– Brocade 32Gb Fiber Switch
– 1Gb Ethernet Metadata Network
Storage Configuration
– Rack elevation on the right
Workstations
– Linux z840 32Gb 2 port FC
– Linux z840 32Gb 2 port FC
– Linux IBM 16GB 4port FC
– Windows Server 2 x 8Gb FC
– MAC Pro OSX 10.12 – Thunderlink 16Gb FC
– MAC Pro OSX 10.12 – Thunderlink 16Gb FC
– MAX Pro OSX 10.11 – Thunderlink 2 x 8Gb FC
M&E Performance Test System
66© 2017 Quantum Corporation | Company Confidential
What was used to produce streams of 4K
Unconstrained RAW performance baseline
– Push all clients to the maximum performance to show maximum performance of controller
 This is how we first discovered the flooding of IO on the controller from OSX
 Read ahead cache settings not optimal
Applications - streams baseline
– Davinci Resolve
 Linux
 macOS
Utilities – count those streams
– vidio
 Sample streams (first line is compressed simulation of Prorez 4444 XQ)
• vidio –c –d –f 8690074 –n 10000 –N 10000 -F 30 –v –w dir1 dir 2 dir 3 ….
• vidio –c –d –f fa4k –n 5000 –F 24 –v –w dir1 dir2 dir 3 ….
– frametest
 Sample streams
• frametest –w 8486 –n 10000 -s –f 30 –t 1 dir1
• Frametest –w 4k –t 4 –n 5000 –f 24 dir1
67© 2017 Quantum Corporation | Company Confidential
Best Practices Guide: Second Edition
New Updates in the Latest Edition (follow link to open)
All flash array configurations
QXS-424 and QXS-448
QXS-6
Spindle speed comparisons
Operating system performance attributes
Appendix for media formats and bitrates
68© 2017 Quantum Corporation | Company Confidential
69© 2017 Quantum Corporation | Company Confidential
© 2017 Quantum Corporation. Company Confidential.

More Related Content

What's hot

steve twene_cv2016
steve twene_cv2016steve twene_cv2016
steve twene_cv2016
Steve Twene
 
MySQL in the Cloud, is Amazon RDS for you?
MySQL in the Cloud, is Amazon RDS for you?MySQL in the Cloud, is Amazon RDS for you?
MySQL in the Cloud, is Amazon RDS for you?
Continuent
 

What's hot (20)

Regarding Clouds, Mainframes, and Desktops … and Linux
Regarding Clouds, Mainframes, and Desktops … and LinuxRegarding Clouds, Mainframes, and Desktops … and Linux
Regarding Clouds, Mainframes, and Desktops … and Linux
 
Make a Move to the Azure Cloud with SoftNAS
Make a Move to the Azure Cloud with SoftNASMake a Move to the Azure Cloud with SoftNAS
Make a Move to the Azure Cloud with SoftNAS
 
HCI comparison whatmatrix
HCI comparison whatmatrixHCI comparison whatmatrix
HCI comparison whatmatrix
 
Optymalizacja środowiska Open Source w celu zwiększenia oszczędności i kontroli
Optymalizacja środowiska Open Source w celu zwiększenia oszczędności i kontroliOptymalizacja środowiska Open Source w celu zwiększenia oszczędności i kontroli
Optymalizacja środowiska Open Source w celu zwiększenia oszczędności i kontroli
 
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-WarWebinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
Webinar: Performance vs. Cost - Solving The HPC Storage Tug-of-War
 
steve twene_cv2016
steve twene_cv2016steve twene_cv2016
steve twene_cv2016
 
TechEvent 2019: DBaaS from Swisscom Cloud powered by Trivadis; Konrad Häfeli ...
TechEvent 2019: DBaaS from Swisscom Cloud powered by Trivadis; Konrad Häfeli ...TechEvent 2019: DBaaS from Swisscom Cloud powered by Trivadis; Konrad Häfeli ...
TechEvent 2019: DBaaS from Swisscom Cloud powered by Trivadis; Konrad Häfeli ...
 
Provisioning server high_availability_considerations2
Provisioning server high_availability_considerations2Provisioning server high_availability_considerations2
Provisioning server high_availability_considerations2
 
The Value of NetApp with VMware
The Value of NetApp with VMwareThe Value of NetApp with VMware
The Value of NetApp with VMware
 
Windows Server 2012 Deep-Dive - EPC Group
Windows Server 2012 Deep-Dive - EPC GroupWindows Server 2012 Deep-Dive - EPC Group
Windows Server 2012 Deep-Dive - EPC Group
 
Link Samba to Cloud Storage
Link Samba to Cloud StorageLink Samba to Cloud Storage
Link Samba to Cloud Storage
 
VMworld 2013: Dell Solutions for VMware Virtual SAN
VMworld 2013: Dell Solutions for VMware Virtual SAN VMworld 2013: Dell Solutions for VMware Virtual SAN
VMworld 2013: Dell Solutions for VMware Virtual SAN
 
MySQL in the Cloud, is Amazon RDS for you?
MySQL in the Cloud, is Amazon RDS for you?MySQL in the Cloud, is Amazon RDS for you?
MySQL in the Cloud, is Amazon RDS for you?
 
NephoScale Elastic Networking
NephoScale Elastic NetworkingNephoScale Elastic Networking
NephoScale Elastic Networking
 
Copy Data Management for the DBA
Copy Data Management for the DBACopy Data Management for the DBA
Copy Data Management for the DBA
 
Co-Design Architecture for Exascale
Co-Design Architecture for ExascaleCo-Design Architecture for Exascale
Co-Design Architecture for Exascale
 
Accelerating Devops via Data Virtualization | Delphix
Accelerating Devops via Data Virtualization | DelphixAccelerating Devops via Data Virtualization | Delphix
Accelerating Devops via Data Virtualization | Delphix
 
SUSE Linux Enterprise Server for IBM Power
SUSE Linux Enterprise Server for IBM Power SUSE Linux Enterprise Server for IBM Power
SUSE Linux Enterprise Server for IBM Power
 
Not All Storage Arrays Are Created Equal - with Arraya Solutions and EMC
Not All Storage Arrays Are Created Equal - with Arraya Solutions and EMCNot All Storage Arrays Are Created Equal - with Arraya Solutions and EMC
Not All Storage Arrays Are Created Equal - with Arraya Solutions and EMC
 
Cisco NetApp VMware - Long Distance VMotion
Cisco NetApp VMware - Long Distance VMotionCisco NetApp VMware - Long Distance VMotion
Cisco NetApp VMware - Long Distance VMotion
 

Similar to Designing 4 k workflows [seminar]compress

robust-company-profile-2015
robust-company-profile-2015robust-company-profile-2015
robust-company-profile-2015
Tecsun Yeep
 
Enabling OpenStack for Enterprise - Tarso Dos Santos, Veritas
Enabling OpenStack for Enterprise - Tarso Dos Santos, VeritasEnabling OpenStack for Enterprise - Tarso Dos Santos, Veritas
Enabling OpenStack for Enterprise - Tarso Dos Santos, Veritas
OpenStack
 

Similar to Designing 4 k workflows [seminar]compress (20)

Best practices: running high-performance databases on Kubernetes
Best practices: running high-performance databases on KubernetesBest practices: running high-performance databases on Kubernetes
Best practices: running high-performance databases on Kubernetes
 
robust-company-profile-2015
robust-company-profile-2015robust-company-profile-2015
robust-company-profile-2015
 
Designing your XenApp 7.5 Environment
Designing your XenApp 7.5 EnvironmentDesigning your XenApp 7.5 Environment
Designing your XenApp 7.5 Environment
 
Designing your xen app 7.5 environment
Designing your xen app 7.5 environmentDesigning your xen app 7.5 environment
Designing your xen app 7.5 environment
 
AWS Elemental and cloud
AWS Elemental and cloudAWS Elemental and cloud
AWS Elemental and cloud
 
Enabling OpenStack for Enterprise - Tarso Dos Santos, Veritas
Enabling OpenStack for Enterprise - Tarso Dos Santos, VeritasEnabling OpenStack for Enterprise - Tarso Dos Santos, Veritas
Enabling OpenStack for Enterprise - Tarso Dos Santos, Veritas
 
How to Stop Over Paying Your VMware Taxes
How to Stop Over Paying Your VMware TaxesHow to Stop Over Paying Your VMware Taxes
How to Stop Over Paying Your VMware Taxes
 
Macroview Netapp Overview
Macroview Netapp OverviewMacroview Netapp Overview
Macroview Netapp Overview
 
Webinar: End NAS Sprawl - Gain Control Over Unstructured Data
Webinar: End NAS Sprawl - Gain Control Over Unstructured DataWebinar: End NAS Sprawl - Gain Control Over Unstructured Data
Webinar: End NAS Sprawl - Gain Control Over Unstructured Data
 
Veritas - Software Defined Storage
Veritas - Software Defined StorageVeritas - Software Defined Storage
Veritas - Software Defined Storage
 
NetBackup CloudCatalyst: Efficient, Cost-Effective Deduplication to the Cloud
NetBackup CloudCatalyst: Efficient, Cost-Effective Deduplication to the CloudNetBackup CloudCatalyst: Efficient, Cost-Effective Deduplication to the Cloud
NetBackup CloudCatalyst: Efficient, Cost-Effective Deduplication to the Cloud
 
Citrix Portfolio Updates
Citrix Portfolio UpdatesCitrix Portfolio Updates
Citrix Portfolio Updates
 
Citrix Desktop Master Class – New in XA/XD 7.9, Skype for Business, HDX Raspb...
Citrix Desktop Master Class – New in XA/XD 7.9, Skype for Business, HDX Raspb...Citrix Desktop Master Class – New in XA/XD 7.9, Skype for Business, HDX Raspb...
Citrix Desktop Master Class – New in XA/XD 7.9, Skype for Business, HDX Raspb...
 
MySQL High Availability & Disaster Recovery (DAT361) - AWS re:Invent 2018
MySQL High Availability & Disaster Recovery (DAT361) - AWS re:Invent 2018MySQL High Availability & Disaster Recovery (DAT361) - AWS re:Invent 2018
MySQL High Availability & Disaster Recovery (DAT361) - AWS re:Invent 2018
 
Carbonite HA for Azure Stacks.pptx
Carbonite HA for Azure Stacks.pptxCarbonite HA for Azure Stacks.pptx
Carbonite HA for Azure Stacks.pptx
 
Keeping Your Cloud Workloads Protected
Keeping Your Cloud Workloads ProtectedKeeping Your Cloud Workloads Protected
Keeping Your Cloud Workloads Protected
 
Présentation VERITAS Backup Exec 16
Présentation VERITAS Backup Exec 16Présentation VERITAS Backup Exec 16
Présentation VERITAS Backup Exec 16
 
Born to be fast! - Aviram Bar Haim - OpenStack Israel 2017
Born to be fast! - Aviram Bar Haim - OpenStack Israel 2017Born to be fast! - Aviram Bar Haim - OpenStack Israel 2017
Born to be fast! - Aviram Bar Haim - OpenStack Israel 2017
 
Global Media Exchange: Work of the ETC By Christine Thomas of Dolby
Global Media Exchange: Work of the ETC By Christine Thomas of DolbyGlobal Media Exchange: Work of the ETC By Christine Thomas of Dolby
Global Media Exchange: Work of the ETC By Christine Thomas of Dolby
 
AWS Media and Entertainment Cloud Symposium: Broadcast and OTT
AWS Media and Entertainment Cloud Symposium:  Broadcast and OTTAWS Media and Entertainment Cloud Symposium:  Broadcast and OTT
AWS Media and Entertainment Cloud Symposium: Broadcast and OTT
 

Recently uploaded

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 

Designing 4 k workflows [seminar]compress

  • 1. 1© 2017 Quantum Corporation | Company Confidential
  • 2.
  • 3. 3© 2017 Quantum Corporation | Company Confidential
  • 4.
  • 5. 5© 2017 Quantum Corporation | Company Confidential WHAT’S CHANGING? VIDEO PRODUCERS ARE MOVING TO ADOPTING HIGHER STANDARDS FOR:
  • 6.
  • 7.
  • 8.
  • 9. 9© 2017 Quantum Corporation | Company Confidential
  • 10.
  • 11. 11© 2017 Quantum Corporation | Company Confidential
  • 12.
  • 14. 14© 2017 Quantum Corporation | Company Confidential Atiwat Rungsirikulwit Business Development Manager BUILD A NEXT-GENERATION STORAGE ENVIRONMENT FOR 4K/UHD VIDEO WITH QUANTUM SOLUTIONS.
  • 15. 15© 2017 Quantum Corporation | Company Confidential What These Applications Need Impossible for a single storage configuration to deliver all of these three attributes Performance Meet the requirements of demanding workflows Access Access all data at any time from any client Low-cost Capacity Efficiently store vast amounts of data for long-term retention
  • 16. 16© 2017 Quantum Corporation | Company Confidential What Quantum Delivers Performance Access Low Cost Capacity Only Quantum provides flexible storage platform that delivers all three attributes simultaneously
  • 17. 17© 2017 Quantum Corporation | Company Confidential Quantum Summary Northampton, UK EMEA Service HQ Paris, FR EMEA HQ Kuala Lumpur, MY APAC Service HQ Beijing, PRC North Asia Service HQ Singapore APAC HQ Sydney & Adelaide, AU Dedupe R&D BELLEVUE, WA WW Sales, Mktg, & Finance San Jose, CA WW HQ DXi and VM R&D Irvine, CA Devices R&D Denver, CO Systems R&D / Test WW Service Mendota Hts., MN Scale-out Storage R&D 35 100K 74 year storage specialist deployments in 100+ countries, serviced by world-class support % growth in scale-out storage 2300 650 trained engineers patents – strong IP in file systems & data lifecycle management
  • 18. 18© 2017 Quantum Corporation | Company Confidential Leaders in Media and Entertainment ALL BIG SIX MOVIE STUDIOS RELY ON STORNEXT ALL BIG FOUR BROADCAST NETWORKS RELY ON STORNEXT 100,000 STORNEXT LICENSES DEPLOYED WORLDWIDE 4 6 Info Browser
  • 19. 19© 2017 Quantum Corporation | Company Confidential Modern Workflows Have Changed Video content is 100% digital from ingest through archive Globally distributed teams require shared access Files sizes are highly variable depending on the stage of the workflow Asset and content size continues to grow as resolutions increase Topologies and interconnects have evolved— there is no single one-size-fits-all interconnect Deliver
  • 20. 20© 2017 Quantum Corporation | Company Confidential CHALLENGES AND LIMITATIONS TO 4K WORKFLOW
  • 21. 21© 2017 Quantum Corporation | Company Confidential What Impacts 4K Performance Data Rate – Compressed or Uncompressed – Resolution and Frame Rate Stream Count – Number of cameras used in acquisition, composition layers, workstation requirements – Mezzanine or proxy workflows Host (client) machine Drive type
  • 22. 22© 2017 Quantum Corporation | Company Confidential 8K UHD is on the way 7680 x 4320 16-bit @ 60fps 12 GB/s 12.9 TB/hr 4K UHD 3840 x 2160 10-bit @ 60fps 2 GB/s 7.2 TB/hr Cinema4K 4K DCI (4096 x 2160) 10-bit @ 24fps 849 MB/s 3.1 TB/hr 2K High-Definition (Full HD) 1920 x 1080 10-bit @ 30fps 248 MB/s 896 GB/hr2K (2048 x 1080) 10-bit @ 24 fps 212 MB/s 764 GB/hr Standard Definition 720 x 488 10-bit@ 29.97fps 27 MB/s 94 GB/hr The 4K Family • Approx. 4X the horizontal resolution of HD • 3840x2160, 4096x2160 most common • 4096x3072, 4096x3112 variants • All “4K” Uncompressed - Defined
  • 23. 23© 2017 Quantum Corporation | Company Confidential But All 4K Is Not Equal 4K Format Resolution (W x H) Frame Rate (fps) Data Rates (MB/s) Storage Capacity (GB/Hr) UHD ProRes 422 HQ 3840 X 2160 30 111 400 60 221 796 UHD ProRes 4444 XQ 3840 X 2160 30 249 896 UHD (10 bit) 3840 x 2160 24 807 2,905 60 1990 7,164 4K Full App (10 bit) 4096 x 3112 24 1224 4,406 UHD (16Bit) 3840 x 2160 60 3190 Untested 4K Format Guide • 4K is horizontal resolution of approx. 4,000 pixels • There are several resolutions that qualify as 4K • UHD or “Quad HD” is 4x HD resolution (TV) • Full App 4K is Super 35mm resolution (Film) Tested formats and frame rates
  • 24. 24© 2017 Quantum Corporation | Company Confidential How Operating Systems Differ Linux is the optimal performer – More efficient HBA drivers Windows drivers have more CPU overhead, less efficient – Windows is 15% less efficient than Linux 40-60% less efficient in multi-client environments than either – macOS is overly aggressive with I/O requests
  • 25. 25© 2017 Quantum Corporation | Company Confidential 4K Challenges in Post Flat-bidding Unknown shooting ratios Last-minute client demands UHDp60, HFR, HDR, WCG accelerating quality, consumption and delivery Film / tape to RAW on disk More cameras = more streams VFX and grading = more bandwidth, nodes and disk
  • 26. 26© 2017 Quantum Corporation | Company Confidential Collaborative 4K Post Is Not Easy Varying size and data rates challenge standard file systems – Reading, writing, tracking, sharing and protecting NAS-based HD will struggle with 4K workflows – Latency from packetization is real RAID 5 Performance/Protection Tradeoffs – Large TB drives in RAID 5 leave valuable media exposed during rebuilds
  • 27. 27© 2017 Quantum Corporation | Company Confidential The Right Drive for the Job LFF HDDs – High-capacity – Low performance (7.2K RPM) – Affordable SFF HDDs – Low capacity – High performance (10K RPM) – Higher priced SFF Solid State Drives (SSDs) – Lowest capacity – Highest performance – Highest price Matching Drive Type to Stream Count Requirements SSD SFF LFF Capacity Performance High Data Rate/ Low Stream Count High Data Rate/ High Stream Count Low Data Rate/ Low Stream Count Low Data Rate/ High Stream Count
  • 28. 28© 2017 Quantum Corporation | Company Confidential
  • 29. 29© 2017 Quantum Corporation | Company Confidential INTRODUCING XCELLIS CONVERGED STORAGE Xcellis™ includes both data storage and data management Xcellis Workflow Director Xcellis Storage Built for StorNext 6 Same tiered storage platform Greater Connectivity Massive Scalability StorNext Connect™ Built-In
  • 30. 30© 2017 Quantum Corporation | Company Confidential Converged Architecture Continuous Scalability Unified Access
  • 31. 31© 2017 Quantum Corporation | Company Confidential CONVERGED ARCHITECTURE StorNext Metadata Appliance DLC Gateway User Storage NAS Gateway Dedicated Metadata Storage Metadata Appliance High Availability Pair Xcellis Workflow Director Xcellis Workflow Director High Availability Pair Metadata + User Storage Optional Dedicated Metadata Storage • Xcellis Workflow Director includes SAN, DLC & NAS client connectivity • Xcellis metadata storage resides in user storage or optionally separated
  • 32. 32© 2017 Quantum Corporation | Company Confidential CONTINUOUS SCALABILITY 12 Drives ~ 1 GB/s • Add RAIDs for Capacity + Bandwidth 24 Drives ~1.9 GB/s 48 Drives ~3.8 GB/s 56 Drives ~4.5 GB/s • Any combination of disk performance
  • 33. 33© 2017 Quantum Corporation | Company Confidential CONTINUOUS SCALABILITY • Add RAIDs for Capacity + Bandwidth • Add JBODS for Capacity • Any combination of disk performance Initial Investment Protected 12 Drives ~ 1 GB/s 24 Drives ~1.9 GB/s 48 Drives ~3.8 GB/s 56 Drives ~4.5 GB/s
  • 34. © 2016 Quantum Corporation UNIFIED ACCESS METADATA CONTROL PATH Xcellis XCELLIS WORKFLOW DIRECTOR FIBRE CHANNEL DATA PATH STORAGE SAN CLIENT
  • 35. 35© 2017 Quantum Corporation | Company Confidential METADATA CONTROL PATH Xcellis DLC CLIENTSSAN CLIENTS STORAGE XCELLIS WORKFLOW DIRECTORS UNIFIED ACCESS IP DATA PATH FIBRE CHANNEL DATA PATH
  • 36. 36© 2017 Quantum Corporation | Company Confidential CLIENTS NAS CLIENTS DLC CLIENTS METADATA CONTROL PATH Xcellis SAN CLIENTS STORAGE • File, Directory, and Volume level access control via StorNext, Active Directory, and LDAP FIBRE CHANNEL DATA PATH UNIFIED ACCESS IP DATA PATH IP DATA & METADATA PATH
  • 37. 37© 2017 Quantum Corporation | Company Confidential Key Concepts – Tiered Storage StorNext manages file movement across types of storage (disk, object storage, tape or cloud) via policies Transparent data access regardless of where it’s stored Policy applied at directory level Time-based movement of data Up to 4 copies on tape and secondary disk Checksum creation/validation Stub files Windows OS X Linux
  • 38. 38© 2017 Quantum Corporation | Company Confidential Complete Data Lifecycle Management Primary Disk Archive Disk Nearline Tape Active Vault $’sPerTB(List) Access and Restore Times Nature/ Value of Data Type of Storage Tuned Performance Shared Access Durability Multi PB Scalability Lower TCO Ease of Use
  • 39. 39© 2017 Quantum Corporation | Company Confidential EXPLORE
  • 40. 40© 2017 Quantum Corporation | Company Confidential Quality of Service RESERVED BANDWIDTH Highest Priority Bandwidth permanently assigned DYNAMIC ALLOCATION Standard Usage Share bandwidth not assigned to higher or lower class Inactive clients donate bandwidth to others in class LIMITED BANDWIDTH Controlled Access Clients access data no higher than the set amount
  • 41. 41© 2017 Quantum Corporation | Company Confidential Chassis2 Online Stripe Group Management Single Stripe Group Chassis1 Data Automatically Redistributed and Defragmented for Additional Performance Without Disruption Much Lower Cost to Scale vs. Clustered Systems Add More Space to Existing Stripe Group
  • 42. 42© 2017 Quantum Corporation | Company Confidential Audit History Track all File System Activity What, When, Where and Who Access and Print Activity History for File System Stores All File Activity Report Generated SAN DLC NAS Tracks Activity Across All Client Types and Connectivity Methods
  • 43. 43© 2017 Quantum Corporation | Company Confidential Mac Finder Remote File Access ANNOTATED FILE ICONS IDENTIFY ONLINE AND OFFLINE FILES Navigating through directories that include offline archives no longer cause slow searches as the Finder takes time to show the contents of the directory. Prevents the Storage Manager “storm” caused by Finder recall requests Enables macOS users to view, access, and manage offline content in archives Uses StorNext web services to control file retrieves, stores and truncation OFFLINE ACTIONS MENU WITH RETRIEVE, STORE AND TRUNCATE MENU ACTIONS
  • 44. 44© 2017 Quantum Corporation | Company Confidential Primary StorNext Tiered Data Management Copy 1 Lattus Copy 2 Cloud/Tape Origin al File
  • 45. 45© 2017 Quantum Corporation | Company Confidential Primary StorNext Tiered Data Management Copy 1 Lattus Copy 2 Cloud/Tape Files Immediately Protected in Multiple Locations Files Protected Here Origin al File Files Protected Here
  • 46. 46© 2017 Quantum Corporation | Company Confidential Tiered Data Management Copy 1 Lattus Copy 2 Cloud/Tape Primary StorNext Files Protected Here Files Protected Here Files Put Here Stub File Origin al File Truncating a File Frees Valuable Primary Storage Space and Leaves a “Stub” Pointing to Archived Copies
  • 47. 47© 2017 Quantum Corporation | Company Confidential Tiered Data Management Copy 1 Lattus Copy 2 Cloud/Tape Primary StorNext Files Protected Here Files Protected Here Files Put Here Stub File Archived Copies Can Be “Aged Off” of Any Tier Automatically Based On Time Copy 1
  • 48. 48© 2017 Quantum Corporation | Company Confidential Tiered Data Management Lattus Copy 1 Cloud/Tape Primary StorNext Files Protected Here Files Put Here Stub File Origin al File Files are Accessed and Restored Just By Clicking
  • 49. 49© 2017 Quantum Corporation | Company Confidential FlexTier Public & Private Cloud Archives XCELLIS PRIMARY STORAGE DATA Extends StorNext Archive Visibility and Access to a Variety of Targets
  • 50. 50© 2017 Quantum Corporation | Company Confidential StorNext FlexSync: Point to Point Synchronization SITE A SITE B
  • 51. 51© 2017 Quantum Corporation | Company Confidential StorNext FlexSync: Content Distribution SITE B SITE C SITE D SITE A
  • 52. 52© 2017 Quantum Corporation | Company Confidential StorNext FlexSync: Content Consolidation SITE B SITE C SITE D SITE A
  • 53. 53© 2017 Quantum Corporation | Company Confidential StorNext FlexSync: Content Distribution and Protection SITE A TAPEOBJECT/ LATTUS CLOUD SITE B SITE C SITE D
  • 54. 54© 2017 Quantum Corporation | Company Confidential SITE A StorNext FlexSync: Limitless Combinations SITE B SITE DSITE C SITE E
  • 55. 55© 2017 Quantum Corporation | Company Confidential Designs utilizing Quantum portfolio SN 6 Specific benefits to 4K – QoS – Stripe Group management “Live” – Tunable parameters  ASR, ISW, Stripe breadth, # of stripe groups Xcellis more than just metadata servers – Converged Architecture  SAN, NAS, Block over IP  DLC still stands out above and beyond most if not all Ethernet transport – Line Rate Performance shared file system across Linux, Windows and macOS 6 POWERED BY
  • 56. 56© 2017 Quantum Corporation | Company Confidential XCELLIS 4K REFERENCE ARCHITECTURES
  • 57. 57© 2017 Quantum Corporation | Company Confidential How StorNext Scales “Scale-up” (Capacity) Adding storage to an existing controller/storage (RBOD) chassis • Capacity upgrade with slight increase in performance from additional spindles • Too many spindles can saturate the controller - Xcellis Workflow Director HA Pair - RBOD (controller & storage) - Metadata Array JBOD or EBOD Expansion, No RAID controller - 1+1 - JBOD - JBOD 1+3 - Xcellis Workflow Director HA Pair - Metadata Array - RBOD - JBOD 1+1 2+2 “Scale-Out” (Performance) Adding RBOD chassis to existing RBOD chassis (with or without expansion) • Simultaneous performance and capacity upgrade • Performance nearly doubles on 4-series controller - RBOD - JBOD
  • 58. 58© 2017 Quantum Corporation | Company Confidential 4K Reference Architectures • Compressed & uncompressed • Scale-up • With & w/o archive Compressed: 8 Uncompressed: 2 • Compressed & uncompressed • Scale-out • With & w/o archive • High compressed stream count • Low, multiple uncompressed stream count • Scale-out or scale-up • Archive-ready • Very high compressed stream count • Multiple, uncompressed stream count • Scale-out or scale-up • Archive-ready Optional Dedicated Metadata Dedicated Metadata StorNext Base 4K QXS-412 1+1 StorNext High Capacity 4K QXS-456 QXS-648 w/ SSDs Price StreamCount 4K Low-Cost, High-Capacity LFF Compressed: 14 Uncompressed: 4 Compressed: 66 Uncompressed: 9 4K High-Performance SFF SSD Optional Dedicated Metadata Dedicated Metadata Compressed: 28 Uncompressed: 7 4K Performance SFF StorNext Performance Disk 4K QXS-424 2+2 StorNext All Flash 4K
  • 59. 59© 2017 Quantum Corporation | Company Confidential QXS-412 Low, compressed stream count 6 3 N/A N/A 48 Xcellis Workflow Director 4K Low-cost, optional archive support Converged or Dedicated Metadata with 3.5” drives QXS-412 – Single RAID, compressed only – Must scale-up for uncompressed support – 4TB or 6TB HDDs for 48 or 72TB per chassis – Add 12x900GB 10K for dedicated MD  Dedicated MD needed Storage Manager archiving  Optional upgrade to 400GB or 800GB SSDs Xcellis Workflow Director HA Pair Power of 2 Expansion = add 1 JBOD for uncompressed Power of 2 Expansion = add 3 JBODs for multi-stream uncompressed Dedicated Metadata Metadata + User StorageUser Storage Xcellis System 4K Support ProRes 422 HQ 30 fps ProRes 4444 XQ 60 fps Full AP (10 bit) 24 fps UHD (10 bit) 60 fps Capacity (4TB Drives) QXS-412 1+1 Low compressed stream count, two uncompressed 8 4 2 1 96 QXS-412 1+3 Multi-compressed stream count, two uncompressed 15 6 2 1 192
  • 60. 60© 2017 Quantum Corporation | Company Confidential QXS-456 – Uncompressed (DPX) capable – Scale-Out Only: 448 or 672TB w/ 2xRBODs – 4TB or 6TB for 224/336TB capacity w/ 1xRBOD – Add 12x900GB 10K for dedicated MD  Dedicated MD needed for SNSM archiving  Optional upgrade to 400GB or 800GB SSDs Converged or Dedicated Metadata with 3.5” drives 4K Low-cost, optional archive support Xcellis Workflow Director HA Pair Converged Metadata RAID expansion only, no JBOD x2 Dedicated Metadata Xcellis System 4K Support ProRes 422 HQ 30 fps ProRes 4444 XQ 60 fps Full AP (10 bit) 24 fps UHD (10 bit) 60 fps Capacity (4TB Drives) QXS-456 Multi-stream compressed, two uncompressed 14 6 2 1 224 QXS-456x2 High compressed stream count, multi-stream uncompressed 24 17 6 2 448
  • 61. 61© 2017 Quantum Corporation | Company Confidential 4K Performance, archive ready Dedicated metadata array w/ 2.5” drives Xcellis System 4K Support ProRes 422 HQ 30 fps ProRes 4444 XQ 60 fps Full AP (10 bit) 24 fps UHD (10 bit) 60 fps Capacity (1.2TB Drives) QXS-424 1+1 Multi-stream compressed, two uncompressed 17 7 2 1 57.6 TB Dedicated Metadata, Archive Ready RBOD + JBOD for high compressed stream counts and multi-stream uncompressed Xcellis Workflow Director HA Pair Add 1+1 for high stream counts to multiple rooms or dual stream uncompressed to multiple rooms QXS-424 2+2 High compressed stream count, multi-stream uncompressed 28 13 5 2 115.2 TB QXS-424 1+1 – Dedicated 900GBx12 MD, optional SSD – High compressed and multi-stream uncompressed – 1.2TB/1.8TB drives for 29/43TB per chassis Add 1+1 – Total Capacity 115/172TB – Scale to 28 compressed/5 uncompressed Super High-Density QXS-448 option – 58/86TB per chassis
  • 62. 62© 2017 Quantum Corporation | Company Confidential 4K High Performance, archive ready Dedicated metadata array, SSD QXS-424 All Flash Array – Scale-Out Only: 2U24 and 2U48 chassis – QXS-4 or QXS-6 – 400GB, 800GB, 1600GB SSDs – Always use dedicated MD  900GB HDD or SSD based MD array  Optional upgrade to 400GB or 800GB SSDs Dedicated Metadata, Archive Ready RBOD + with 24 400 TB SSDs for multi- stream uncompressed Xcellis Workflow Director HA Pair Xcellis System Target ProRes 422 HQ 30 fps ProRes 4444 XQ 60 fps Full AP (10 bit) 24 fps UHD (10 bit) 60 fps Capacity (400GB Drives) QXS-424 RAID All Flash Very high compressed stream count, multi-stream uncompressed 49 24 3 2 9.6TB QXS-648 RAID All Flash Very high compressed stream count, multi-stream uncompressed 66 32 6 3 19.2TB
  • 63. 63© 2017 Quantum Corporation | Company Confidential 4K Reference Architectures QXS-424 2+2 QXS-648 AFAQXS-412 1+1 QXS-456 Price StreamCount Base 4K High Capacity 4K High Performance Disk 4K All Flash 4K 1 1 2 32 2 5 6 2 4 7 9 6 5 16 30 4 6 13 32 8 14 28 66 4K Quad HD (10-bit) 60 fps 4K Full (10-bit) 24 fps UHD (10-bit) 24 fps ProRes 4444 XQ 30 fps Apple ProRes 422 HQ 60 fps ProRes 422 HQ 30 fps
  • 64. 64© 2017 Quantum Corporation | Company Confidential TESTING OVERVIEW
  • 65. 65© 2017 Quantum Corporation | Company Confidential Setup Switch – Brocade 32Gb Fiber Switch – 1Gb Ethernet Metadata Network Storage Configuration – Rack elevation on the right Workstations – Linux z840 32Gb 2 port FC – Linux z840 32Gb 2 port FC – Linux IBM 16GB 4port FC – Windows Server 2 x 8Gb FC – MAC Pro OSX 10.12 – Thunderlink 16Gb FC – MAC Pro OSX 10.12 – Thunderlink 16Gb FC – MAX Pro OSX 10.11 – Thunderlink 2 x 8Gb FC M&E Performance Test System
  • 66. 66© 2017 Quantum Corporation | Company Confidential What was used to produce streams of 4K Unconstrained RAW performance baseline – Push all clients to the maximum performance to show maximum performance of controller  This is how we first discovered the flooding of IO on the controller from OSX  Read ahead cache settings not optimal Applications - streams baseline – Davinci Resolve  Linux  macOS Utilities – count those streams – vidio  Sample streams (first line is compressed simulation of Prorez 4444 XQ) • vidio –c –d –f 8690074 –n 10000 –N 10000 -F 30 –v –w dir1 dir 2 dir 3 …. • vidio –c –d –f fa4k –n 5000 –F 24 –v –w dir1 dir2 dir 3 …. – frametest  Sample streams • frametest –w 8486 –n 10000 -s –f 30 –t 1 dir1 • Frametest –w 4k –t 4 –n 5000 –f 24 dir1
  • 67. 67© 2017 Quantum Corporation | Company Confidential Best Practices Guide: Second Edition New Updates in the Latest Edition (follow link to open) All flash array configurations QXS-424 and QXS-448 QXS-6 Spindle speed comparisons Operating system performance attributes Appendix for media formats and bitrates
  • 68. 68© 2017 Quantum Corporation | Company Confidential
  • 69. 69© 2017 Quantum Corporation | Company Confidential © 2017 Quantum Corporation. Company Confidential.

Editor's Notes

  1. Here are a few facts and figures that sum it up
  2. Big 6 Movie Studio: Warner Bros. Pictures, Paramount Pictures, Walt Disney, Columbia Pictures, Universal Studios & 20th Century Fox. Big 4 Broadcast Network : FOX, NBC, ABC & CBS
  3. Talk about impact of CPU on number of streams, memory, even GPU Some players have been the limiting factor as well during the advancement of storage
  4. 4K Ultra-HD (2160p), has a resolution of 3840 x 2160 (8.3 megapixels). It is roughly equivalent to digital cinema (DCI) 4K and has four times as many pixels as Full HD (1080p). Digital cinema differs slightly from television (DCI 4K has 4096 pixels per line, compared with 3840 for 4K TV).  8K Ultra-HD, also called UHD-2 or Phase 3 (4320p), has a resolution of 7680 × 4320 pixels (33.2 megapixels) and is roughly equivalent to an IMAX film, or 16 times the resolution of Full HD (1080p). It corresponds to NHK's Super Hi-Vision format. 8K is four times greater than 4K in terms of resolution. Gone Girl 500 hours of raw footage The film was shot on a RED Dragon at 6k (6144 x 3072), ultimately to be used for a 5k extraction (5120 x 2876). The additional space was used for stabilization and re-framing\adjustment of shots in post production. The final film was delivered at 4K (4096 x 1706). ~80% of the films shots have been stabilized, split-screened for performance-enhancement, re-framed, or otherwise manipulated, Gone Girl used 342TB of spinning storage online and 38TB SSD RAID
  5. Netflix 25 mbps
  6. Talk about actual performance on a system after hitting memory and CPU limitations
  7. DC camera sensors are covered with a mosaic RGB filter pattern, called the Bayer pattern. When an exposed frame is sampled by the sensor, it is captured as a one-channel image (as opposed to a regular RGB three-channel color image). The reconstruction of the missing color components for each pixel, based on the type and position on the Bayer pattern is called de-bayering. With a Bayer pattern sensor, 50% of the sensors photosites are used to represent green, 25% of the photosites represent red and the remaining 25% represent blue. For more information, please click here. Most of commercial S35mm digital cinema cameras nowadays employ a single bayer CMOS sensor, the image process would include de-bayer (de-mosaic) into RGB images, then YUV color sampling and compression into some video file with specific codec for delivery (MPEG2, 264 or 265)
  8. The red line in this graph represents the value of your data over time, and this graph helps assign a value to your data over time. As you follow the red arrow down from left to right you can see where the value drops sharply Primary disk has been designed to store the left side of the graph Tape has been used to store the right side of the graph The red text outlines some examples of data in each area. People have tried to extend their primary storage to address the area in the middle and it just too costly to scale to the capacities required. Trying to scale the tape to the center does not deliver the required access to get benefit from the data. The data in the middle is different and has different needs.
  9. QOS Particularly important with 4K workflows Bandwidth management Specify the maximum bandwidth permitted for a client Bandwidth reservation Guaranteed bandwidth for a client by limiting all others For SAN and DLC clients Linux and Windows Web service API for future Connect integration CLI only on initial release Included in StorNext; no additional license required SG re-alignment Hot Extend existing stripe groups when adding arrays Non-disruptive scaling Auto redistribution and defrag Minimal performance degradation during redistribution Move file data (extents) from 1 stripe group to another Will redistribute (balance) data when new storage is added Can be used to empty a stripe group to retire old drives Vacant stripe groups can be reused
  10. Expand for $6600, double capacity and performance, and gets you into uncompressed territory Add 13K, gets you more compressed streams and capacity, but uncompressed stays the same
  11. Scale-out on 456 only: The number of drives under 4000 series controller in a 456 maxes out controller, so we don’t add expansion chassis for M&E. Unlike 412, 456 must scale-out
  12. Baseline stream count, scales to with
  13. LFF drives can be configured for non-tiered data use or, with dedicated MD, archive us Dedicated metadata required for archive
  14. Explain when and why video and frametest were used and why we choose both during certain times Explain Applications was used first to get some baseline for how our utilities were compared to actual tests Explain our initial tests were all about raw performance by doing the unconstrained reads and writes, followed by Applications, followed by streams counts
  15. Go through highlights Performance characteristics Maybe move later in deck based on flow of slides