More Related Content Similar to Designing 4 k workflows [seminar]compress (20) Designing 4 k workflows [seminar]compress5. 5© 2017 Quantum Corporation | Company Confidential
WHAT’S CHANGING?
VIDEO PRODUCERS ARE MOVING TO ADOPTING
HIGHER STANDARDS FOR:
14. 14© 2017 Quantum Corporation | Company Confidential
Atiwat Rungsirikulwit
Business Development Manager
BUILD A NEXT-GENERATION
STORAGE ENVIRONMENT FOR
4K/UHD VIDEO WITH QUANTUM SOLUTIONS.
15. 15© 2017 Quantum Corporation | Company Confidential
What These Applications Need
Impossible for a single storage
configuration to deliver all of
these three attributes
Performance
Meet the
requirements
of demanding
workflows
Access
Access all data
at any time
from any client
Low-cost
Capacity
Efficiently store vast
amounts of data for
long-term retention
16. 16© 2017 Quantum Corporation | Company Confidential
What Quantum Delivers
Performance
Access
Low Cost
Capacity
Only Quantum provides flexible
storage platform that delivers all
three attributes simultaneously
17. 17© 2017 Quantum Corporation | Company Confidential
Quantum Summary
Northampton,
UK
EMEA Service HQ
Paris, FR
EMEA HQ
Kuala Lumpur,
MY
APAC Service HQ
Beijing, PRC
North Asia Service HQ
Singapore
APAC HQ
Sydney &
Adelaide, AU
Dedupe R&D
BELLEVUE, WA
WW Sales, Mktg,
& Finance
San Jose, CA
WW HQ
DXi and VM R&D
Irvine, CA
Devices R&D
Denver, CO
Systems R&D / Test
WW Service
Mendota Hts.,
MN
Scale-out Storage R&D
35
100K
74
year storage specialist
deployments in 100+ countries,
serviced by world-class support
% growth in scale-out storage
2300
650
trained engineers
patents – strong IP in file systems
& data lifecycle management
18. 18© 2017 Quantum Corporation | Company Confidential
Leaders in Media and Entertainment
ALL BIG SIX MOVIE STUDIOS RELY ON STORNEXT
ALL BIG FOUR BROADCAST NETWORKS RELY ON STORNEXT
100,000 STORNEXT LICENSES DEPLOYED
WORLDWIDE
4
6
Info Browser
19. 19© 2017 Quantum Corporation | Company Confidential
Modern Workflows Have Changed
Video content is 100% digital from ingest
through archive
Globally distributed teams require
shared access
Files sizes are highly variable depending on
the stage of the workflow
Asset and content size continues to grow as
resolutions increase
Topologies and interconnects have evolved—
there is no single one-size-fits-all interconnect
Deliver
20. 20© 2017 Quantum Corporation | Company Confidential
CHALLENGES AND LIMITATIONS TO
4K WORKFLOW
21. 21© 2017 Quantum Corporation | Company Confidential
What Impacts 4K Performance
Data Rate
– Compressed or Uncompressed
– Resolution and Frame Rate
Stream Count
– Number of cameras used in acquisition,
composition layers, workstation requirements
– Mezzanine or proxy workflows
Host (client) machine
Drive type
22. 22© 2017 Quantum Corporation | Company Confidential
8K UHD is on the way
7680 x 4320 16-bit @ 60fps
12 GB/s 12.9 TB/hr
4K UHD
3840 x 2160 10-bit @ 60fps
2 GB/s 7.2 TB/hr
Cinema4K
4K DCI
(4096 x 2160) 10-bit @ 24fps
849 MB/s 3.1 TB/hr
2K
High-Definition (Full HD)
1920 x 1080 10-bit @ 30fps
248 MB/s 896 GB/hr2K
(2048 x 1080) 10-bit @ 24 fps
212 MB/s 764 GB/hr
Standard Definition
720 x 488
10-bit@ 29.97fps
27 MB/s 94 GB/hr
The 4K Family
• Approx. 4X the horizontal resolution of HD
• 3840x2160, 4096x2160 most common
• 4096x3072, 4096x3112 variants
• All “4K”
Uncompressed - Defined
23. 23© 2017 Quantum Corporation | Company Confidential
But All 4K Is Not Equal
4K Format
Resolution
(W x H)
Frame Rate
(fps)
Data Rates
(MB/s)
Storage Capacity
(GB/Hr)
UHD ProRes 422 HQ 3840 X 2160
30 111 400
60 221 796
UHD ProRes 4444 XQ 3840 X 2160 30 249 896
UHD (10 bit) 3840 x 2160
24 807 2,905
60 1990 7,164
4K Full App (10 bit) 4096 x 3112 24 1224 4,406
UHD (16Bit) 3840 x 2160 60 3190 Untested
4K Format Guide
• 4K is horizontal resolution of approx. 4,000 pixels
• There are several resolutions that qualify as 4K
• UHD or “Quad HD” is 4x HD resolution (TV)
• Full App 4K is Super 35mm resolution (Film)
Tested formats and frame rates
24. 24© 2017 Quantum Corporation | Company Confidential
How Operating Systems Differ
Linux is the optimal performer
– More efficient HBA drivers
Windows drivers have more CPU overhead, less efficient
– Windows is 15% less efficient than Linux
40-60% less efficient in multi-client environments than either
– macOS is overly aggressive with I/O requests
25. 25© 2017 Quantum Corporation | Company Confidential
4K Challenges in Post
Flat-bidding
Unknown shooting ratios
Last-minute client demands
UHDp60, HFR, HDR, WCG accelerating quality,
consumption and delivery
Film / tape to RAW on disk
More cameras = more streams
VFX and grading = more bandwidth, nodes and
disk
26. 26© 2017 Quantum Corporation | Company Confidential
Collaborative 4K Post Is Not Easy
Varying size and data rates challenge
standard file systems
– Reading, writing, tracking, sharing and
protecting
NAS-based HD will struggle with 4K
workflows
– Latency from packetization is real
RAID 5 Performance/Protection
Tradeoffs
– Large TB drives in RAID 5 leave valuable
media exposed during rebuilds
27. 27© 2017 Quantum Corporation | Company Confidential
The Right Drive for the Job
LFF HDDs
– High-capacity
– Low performance (7.2K RPM)
– Affordable
SFF HDDs
– Low capacity
– High performance (10K RPM)
– Higher priced
SFF Solid State Drives (SSDs)
– Lowest capacity
– Highest performance
– Highest price
Matching Drive Type to Stream Count Requirements
SSD
SFF
LFF
Capacity
Performance
High
Data Rate/
Low Stream Count
High
Data Rate/
High Stream Count
Low
Data Rate/
Low Stream Count
Low
Data Rate/
High Stream Count
29. 29© 2017 Quantum Corporation | Company Confidential
INTRODUCING XCELLIS CONVERGED STORAGE
Xcellis™ includes both data
storage and data management
Xcellis Workflow Director
Xcellis Storage
Built for StorNext 6
Same tiered storage platform
Greater Connectivity
Massive Scalability
StorNext Connect™ Built-In
30. 30© 2017 Quantum Corporation | Company Confidential
Converged Architecture
Continuous Scalability
Unified Access
31. 31© 2017 Quantum Corporation | Company Confidential
CONVERGED ARCHITECTURE
StorNext Metadata
Appliance
DLC Gateway
User Storage
NAS Gateway
Dedicated Metadata
Storage
Metadata Appliance
High Availability Pair
Xcellis Workflow Director
Xcellis Workflow Director
High Availability Pair
Metadata + User
Storage
Optional Dedicated
Metadata Storage
• Xcellis Workflow Director includes
SAN, DLC & NAS client connectivity
• Xcellis metadata storage resides in
user storage or optionally separated
32. 32© 2017 Quantum Corporation | Company Confidential
CONTINUOUS SCALABILITY
12 Drives
~ 1 GB/s
• Add RAIDs for Capacity + Bandwidth
24 Drives
~1.9 GB/s
48 Drives
~3.8 GB/s
56 Drives
~4.5 GB/s
• Any combination of disk performance
33. 33© 2017 Quantum Corporation | Company Confidential
CONTINUOUS SCALABILITY
• Add RAIDs for Capacity + Bandwidth
• Add JBODS for Capacity
• Any combination of disk performance
Initial Investment Protected
12 Drives
~ 1 GB/s
24 Drives
~1.9 GB/s
48 Drives
~3.8 GB/s
56 Drives
~4.5 GB/s
34. © 2016 Quantum Corporation
UNIFIED ACCESS
METADATA
CONTROL
PATH
Xcellis
XCELLIS
WORKFLOW
DIRECTOR
FIBRE CHANNEL
DATA PATH
STORAGE
SAN CLIENT
35. 35© 2017 Quantum Corporation | Company Confidential
METADATA
CONTROL
PATH
Xcellis
DLC CLIENTSSAN CLIENTS
STORAGE
XCELLIS WORKFLOW DIRECTORS
UNIFIED ACCESS
IP DATA PATH
FIBRE CHANNEL
DATA PATH
36. 36© 2017 Quantum Corporation | Company Confidential
CLIENTS
NAS CLIENTS
DLC CLIENTS
METADATA
CONTROL
PATH
Xcellis
SAN CLIENTS
STORAGE
• File, Directory, and Volume level access
control via StorNext, Active Directory, and
LDAP
FIBRE CHANNEL
DATA PATH
UNIFIED ACCESS
IP DATA PATH IP DATA &
METADATA PATH
37. 37© 2017 Quantum Corporation | Company Confidential
Key Concepts – Tiered Storage
StorNext manages file movement across
types of storage (disk, object storage,
tape or cloud) via policies
Transparent data access regardless of
where it’s stored
Policy applied at directory level
Time-based movement of data
Up to 4 copies on tape and secondary
disk
Checksum creation/validation
Stub files
Windows OS X Linux
38. 38© 2017 Quantum Corporation | Company Confidential
Complete Data Lifecycle Management
Primary
Disk
Archive
Disk Nearline
Tape Active
Vault
$’sPerTB(List)
Access and Restore Times
Nature/ Value of Data Type of Storage
Tuned Performance
Shared Access
Durability
Multi PB Scalability
Lower TCO
Ease of Use
40. 40© 2017 Quantum Corporation | Company Confidential
Quality of Service
RESERVED BANDWIDTH
Highest Priority
Bandwidth permanently assigned
DYNAMIC ALLOCATION
Standard Usage
Share bandwidth not assigned to higher or lower
class
Inactive clients donate bandwidth to others in class
LIMITED BANDWIDTH
Controlled Access
Clients access data no higher than the set amount
41. 41© 2017 Quantum Corporation | Company Confidential
Chassis2
Online Stripe Group Management
Single Stripe
Group
Chassis1
Data Automatically
Redistributed and
Defragmented for
Additional Performance
Without Disruption
Much Lower Cost to Scale
vs. Clustered Systems
Add More Space to
Existing Stripe
Group
42. 42© 2017 Quantum Corporation | Company Confidential
Audit History
Track all File System Activity
What, When, Where and Who
Access and Print Activity History for File System
Stores All
File Activity
Report
Generated
SAN DLC NAS
Tracks Activity Across All Client Types and Connectivity Methods
43. 43© 2017 Quantum Corporation | Company Confidential
Mac Finder Remote File Access
ANNOTATED FILE ICONS IDENTIFY
ONLINE AND OFFLINE FILES
Navigating through directories that include offline archives no longer cause slow
searches as the Finder takes time to show the contents of the directory.
Prevents the Storage Manager “storm” caused by Finder recall requests
Enables macOS users to view, access, and manage offline content in archives
Uses StorNext web services to control file retrieves, stores and truncation
OFFLINE ACTIONS
MENU WITH
RETRIEVE, STORE
AND TRUNCATE
MENU ACTIONS
44. 44© 2017 Quantum Corporation | Company Confidential
Primary
StorNext
Tiered Data Management
Copy 1
Lattus
Copy 2
Cloud/Tape
Origin
al File
45. 45© 2017 Quantum Corporation | Company Confidential
Primary
StorNext
Tiered Data Management
Copy 1
Lattus
Copy 2
Cloud/Tape
Files Immediately Protected in Multiple Locations
Files
Protected
Here
Origin
al File
Files
Protected
Here
46. 46© 2017 Quantum Corporation | Company Confidential
Tiered Data Management
Copy 1
Lattus
Copy 2
Cloud/Tape
Primary
StorNext
Files
Protected
Here
Files
Protected
Here
Files
Put
Here
Stub
File
Origin
al File
Truncating a File Frees Valuable Primary Storage Space and Leaves a
“Stub” Pointing to Archived Copies
47. 47© 2017 Quantum Corporation | Company Confidential
Tiered Data Management
Copy 1
Lattus
Copy 2
Cloud/Tape
Primary
StorNext
Files
Protected
Here
Files
Protected
Here
Files
Put
Here
Stub
File
Archived Copies Can Be “Aged Off” of Any Tier Automatically Based On Time
Copy 1
48. 48© 2017 Quantum Corporation | Company Confidential
Tiered Data Management
Lattus
Copy 1
Cloud/Tape
Primary
StorNext
Files
Protected
Here
Files
Put
Here
Stub
File
Origin
al File
Files are Accessed and Restored Just By Clicking
49. 49© 2017 Quantum Corporation | Company Confidential
FlexTier Public & Private Cloud Archives
XCELLIS PRIMARY STORAGE
DATA
Extends StorNext Archive Visibility and Access to a Variety of Targets
50. 50© 2017 Quantum Corporation | Company Confidential
StorNext FlexSync: Point to Point Synchronization
SITE A SITE B
51. 51© 2017 Quantum Corporation | Company Confidential
StorNext FlexSync: Content Distribution
SITE B
SITE C
SITE D
SITE A
52. 52© 2017 Quantum Corporation | Company Confidential
StorNext FlexSync: Content Consolidation
SITE B
SITE C
SITE D
SITE A
53. 53© 2017 Quantum Corporation | Company Confidential
StorNext FlexSync: Content Distribution and Protection
SITE A
TAPEOBJECT/
LATTUS
CLOUD
SITE B
SITE C
SITE D
54. 54© 2017 Quantum Corporation | Company Confidential
SITE A
StorNext FlexSync: Limitless Combinations
SITE B
SITE DSITE C
SITE E
55. 55© 2017 Quantum Corporation | Company Confidential
Designs utilizing Quantum portfolio
SN 6 Specific benefits to 4K
– QoS
– Stripe Group management “Live”
– Tunable parameters
ASR, ISW, Stripe breadth, # of stripe groups
Xcellis more than just metadata servers
– Converged Architecture
SAN, NAS, Block over IP
DLC still stands out above and beyond most if not all Ethernet transport – Line Rate
Performance shared file system across Linux, Windows and macOS
6
POWERED
BY
56. 56© 2017 Quantum Corporation | Company Confidential
XCELLIS 4K REFERENCE
ARCHITECTURES
57. 57© 2017 Quantum Corporation | Company Confidential
How StorNext Scales
“Scale-up” (Capacity)
Adding storage to an existing controller/storage
(RBOD) chassis
• Capacity upgrade with slight increase in
performance from additional spindles
• Too many spindles can saturate the controller
- Xcellis Workflow Director HA Pair
- RBOD (controller & storage)
- Metadata Array
JBOD or EBOD
Expansion, No RAID controller
-
1+1
- JBOD
- JBOD
1+3
- Xcellis Workflow Director HA Pair
- Metadata Array
- RBOD
- JBOD
1+1
2+2
“Scale-Out” (Performance)
Adding RBOD chassis to existing RBOD chassis
(with or without expansion)
• Simultaneous performance and capacity upgrade
• Performance nearly doubles on 4-series controller
- RBOD
- JBOD
58. 58© 2017 Quantum Corporation | Company Confidential
4K Reference Architectures
• Compressed & uncompressed
• Scale-up
• With & w/o archive
Compressed: 8
Uncompressed: 2
• Compressed & uncompressed
• Scale-out
• With & w/o archive
• High compressed stream count
• Low, multiple uncompressed stream count
• Scale-out or scale-up
• Archive-ready
• Very high compressed
stream count
• Multiple, uncompressed
stream count
• Scale-out or scale-up
• Archive-ready
Optional Dedicated Metadata
Dedicated Metadata
StorNext Base 4K
QXS-412 1+1
StorNext High Capacity 4K
QXS-456
QXS-648 w/ SSDs
Price
StreamCount
4K Low-Cost, High-Capacity
LFF
Compressed: 14
Uncompressed: 4
Compressed: 66
Uncompressed: 9
4K High-Performance
SFF SSD
Optional Dedicated Metadata
Dedicated Metadata
Compressed: 28
Uncompressed: 7
4K Performance
SFF
StorNext Performance Disk 4K
QXS-424 2+2
StorNext All Flash 4K
59. 59© 2017 Quantum Corporation | Company Confidential
QXS-412
Low, compressed stream
count
6 3 N/A N/A 48
Xcellis Workflow Director
4K Low-cost, optional archive support
Converged or Dedicated Metadata with 3.5” drives
QXS-412
– Single RAID, compressed only
– Must scale-up for uncompressed support
– 4TB or 6TB HDDs for 48 or 72TB per chassis
– Add 12x900GB 10K for dedicated MD
Dedicated MD needed Storage Manager archiving
Optional upgrade to 400GB or 800GB SSDs
Xcellis Workflow Director HA Pair
Power of 2 Expansion = add 1 JBOD
for uncompressed
Power of 2 Expansion = add 3 JBODs
for multi-stream uncompressed
Dedicated Metadata
Metadata + User StorageUser Storage
Xcellis
System
4K Support
ProRes 422 HQ
30 fps
ProRes 4444 XQ
60 fps
Full AP (10 bit)
24 fps
UHD
(10 bit)
60 fps
Capacity
(4TB Drives)
QXS-412 1+1
Low compressed stream
count, two uncompressed
8 4 2 1 96
QXS-412 1+3
Multi-compressed stream
count, two uncompressed
15 6 2 1 192
60. 60© 2017 Quantum Corporation | Company Confidential
QXS-456
– Uncompressed (DPX) capable
– Scale-Out Only: 448 or 672TB w/ 2xRBODs
– 4TB or 6TB for 224/336TB capacity w/ 1xRBOD
– Add 12x900GB 10K for dedicated MD
Dedicated MD needed for SNSM archiving
Optional upgrade to 400GB or 800GB SSDs
Converged or Dedicated Metadata with 3.5” drives
4K Low-cost, optional archive support
Xcellis Workflow Director HA Pair
Converged Metadata
RAID expansion only, no JBOD
x2
Dedicated Metadata
Xcellis
System
4K Support
ProRes 422 HQ
30 fps
ProRes 4444 XQ
60 fps
Full AP (10 bit)
24 fps
UHD
(10 bit)
60 fps
Capacity
(4TB Drives)
QXS-456
Multi-stream compressed,
two uncompressed
14 6 2 1 224
QXS-456x2
High compressed stream
count, multi-stream
uncompressed
24 17 6 2 448
61. 61© 2017 Quantum Corporation | Company Confidential
4K Performance, archive ready
Dedicated metadata array w/ 2.5” drives
Xcellis
System
4K Support
ProRes 422
HQ
30 fps
ProRes 4444 XQ
60 fps
Full AP (10 bit)
24 fps
UHD (10 bit)
60 fps
Capacity
(1.2TB Drives)
QXS-424 1+1
Multi-stream
compressed, two
uncompressed
17 7 2 1 57.6 TB
Dedicated Metadata, Archive Ready
RBOD + JBOD for high compressed stream
counts and multi-stream uncompressed
Xcellis Workflow Director HA Pair
Add 1+1 for high stream counts to
multiple rooms or dual stream
uncompressed to multiple rooms
QXS-424 2+2
High compressed stream
count, multi-stream
uncompressed
28 13 5 2 115.2 TB
QXS-424 1+1
– Dedicated 900GBx12 MD, optional SSD
– High compressed and multi-stream uncompressed
– 1.2TB/1.8TB drives for 29/43TB per chassis
Add 1+1
– Total Capacity 115/172TB
– Scale to 28 compressed/5 uncompressed
Super High-Density QXS-448 option
– 58/86TB per chassis
62. 62© 2017 Quantum Corporation | Company Confidential
4K High Performance, archive ready
Dedicated metadata array, SSD
QXS-424 All Flash Array
– Scale-Out Only: 2U24 and 2U48 chassis
– QXS-4 or QXS-6
– 400GB, 800GB, 1600GB SSDs
– Always use dedicated MD
900GB HDD or SSD based MD array
Optional upgrade to 400GB or 800GB SSDs
Dedicated Metadata, Archive Ready
RBOD + with 24 400 TB SSDs for multi-
stream uncompressed
Xcellis Workflow Director HA Pair
Xcellis
System
Target
ProRes 422 HQ
30 fps
ProRes 4444 XQ
60 fps
Full AP (10 bit)
24 fps
UHD (10 bit)
60 fps
Capacity
(400GB Drives)
QXS-424 RAID
All Flash
Very high compressed stream
count, multi-stream uncompressed
49 24 3 2 9.6TB
QXS-648 RAID
All Flash
Very high compressed stream
count, multi-stream uncompressed
66 32 6 3 19.2TB
63. 63© 2017 Quantum Corporation | Company Confidential
4K Reference Architectures
QXS-424 2+2 QXS-648 AFAQXS-412 1+1 QXS-456
Price
StreamCount
Base 4K High Capacity 4K High Performance Disk 4K All Flash 4K
1 1 2 32 2
5 6
2
4
7
9
6 5
16
30
4
6
13
32
8
14
28
66
4K Quad HD (10-bit) 60 fps
4K Full (10-bit) 24 fps
UHD (10-bit) 24 fps
ProRes 4444 XQ 30 fps
Apple ProRes 422 HQ 60 fps
ProRes 422 HQ 30 fps
65. 65© 2017 Quantum Corporation | Company Confidential
Setup
Switch
– Brocade 32Gb Fiber Switch
– 1Gb Ethernet Metadata Network
Storage Configuration
– Rack elevation on the right
Workstations
– Linux z840 32Gb 2 port FC
– Linux z840 32Gb 2 port FC
– Linux IBM 16GB 4port FC
– Windows Server 2 x 8Gb FC
– MAC Pro OSX 10.12 – Thunderlink 16Gb FC
– MAC Pro OSX 10.12 – Thunderlink 16Gb FC
– MAX Pro OSX 10.11 – Thunderlink 2 x 8Gb FC
M&E Performance Test System
66. 66© 2017 Quantum Corporation | Company Confidential
What was used to produce streams of 4K
Unconstrained RAW performance baseline
– Push all clients to the maximum performance to show maximum performance of controller
This is how we first discovered the flooding of IO on the controller from OSX
Read ahead cache settings not optimal
Applications - streams baseline
– Davinci Resolve
Linux
macOS
Utilities – count those streams
– vidio
Sample streams (first line is compressed simulation of Prorez 4444 XQ)
• vidio –c –d –f 8690074 –n 10000 –N 10000 -F 30 –v –w dir1 dir 2 dir 3 ….
• vidio –c –d –f fa4k –n 5000 –F 24 –v –w dir1 dir2 dir 3 ….
– frametest
Sample streams
• frametest –w 8486 –n 10000 -s –f 30 –t 1 dir1
• Frametest –w 4k –t 4 –n 5000 –f 24 dir1
67. 67© 2017 Quantum Corporation | Company Confidential
Best Practices Guide: Second Edition
New Updates in the Latest Edition (follow link to open)
All flash array configurations
QXS-424 and QXS-448
QXS-6
Spindle speed comparisons
Operating system performance attributes
Appendix for media formats and bitrates
69. 69© 2017 Quantum Corporation | Company Confidential
© 2017 Quantum Corporation. Company Confidential.
Editor's Notes Here are a few facts and figures that sum it up Big 6 Movie Studio: Warner Bros. Pictures, Paramount Pictures, Walt Disney, Columbia Pictures, Universal Studios & 20th Century Fox.
Big 4 Broadcast Network : FOX, NBC, ABC & CBS Talk about impact of CPU on number of streams, memory, even GPU
Some players have been the limiting factor as well during the advancement of storage
4K Ultra-HD (2160p), has a resolution of 3840 x 2160 (8.3 megapixels). It is roughly equivalent to digital cinema (DCI) 4K and has four times as many pixels as Full HD (1080p). Digital cinema differs slightly from television (DCI 4K has 4096 pixels per line, compared with 3840 for 4K TV).
8K Ultra-HD, also called UHD-2 or Phase 3 (4320p), has a resolution of 7680 × 4320 pixels (33.2 megapixels) and is roughly equivalent to an IMAX film, or 16 times the resolution of Full HD (1080p). It corresponds to NHK's Super Hi-Vision format. 8K is four times greater than 4K in terms of resolution.
Gone Girl
500 hours of raw footage
The film was shot on a RED Dragon at 6k (6144 x 3072), ultimately to be used for a 5k extraction (5120 x 2876). The additional space was used for stabilization and re-framing\adjustment of shots in post production. The final film was delivered at 4K (4096 x 1706).
~80% of the films shots have been stabilized, split-screened for performance-enhancement, re-framed, or otherwise manipulated,
Gone Girl used 342TB of spinning storage online and 38TB SSD RAID Netflix 25 mbps
Talk about actual performance on a system after hitting memory and CPU limitations DC camera sensors are covered with a mosaic RGB filter pattern, called the Bayer pattern. When an exposed frame is sampled by the sensor, it is captured as a one-channel image (as opposed to a regular RGB three-channel color image). The reconstruction of the missing color components for each pixel, based on the type and position on the Bayer pattern is called de-bayering.With a Bayer pattern sensor, 50% of the sensors photosites are used to represent green, 25% of the photosites represent red and the remaining 25% represent blue. For more information, please click here. Most of commercial S35mm digital cinema cameras nowadays employ a single bayer CMOS sensor, the image process would include de-bayer (de-mosaic) into RGB images, then YUV color sampling and compression into some video file with specific codec for delivery (MPEG2, 264 or 265)
The red line in this graph represents the value of your data over time, and this graph helps assign a value to your data over time.
As you follow the red arrow down from left to right you can see where the value drops sharply
Primary disk has been designed to store the left side of the graph
Tape has been used to store the right side of the graph
The red text outlines some examples of data in each area.
People have tried to extend their primary storage to address the area in the middle and it just too costly to scale to the capacities required.
Trying to scale the tape to the center does not deliver the required access to get benefit from the data.
The data in the middle is different and has different needs. QOS
Particularly important with 4K workflows
Bandwidth management
Specify the maximum bandwidth permitted for a client
Bandwidth reservation
Guaranteed bandwidth for a client by limiting all others
For SAN and DLC clients
Linux and Windows
Web service API for future Connect integration
CLI only on initial release
Included in StorNext; no additional license required
SG re-alignment Hot
Extend existing stripe groups when adding arrays
Non-disruptive scaling
Auto redistribution and defrag
Minimal performance degradation during redistribution
Move file data (extents) from 1 stripe group to another
Will redistribute (balance) data when new storage is added
Can be used to empty a stripe group to retire old drives
Vacant stripe groups can be reused
Expand for $6600, double capacity and performance, and gets you into uncompressed territory
Add 13K, gets you more compressed streams and capacity, but uncompressed stays the same
Scale-out on 456 only: The number of drives under 4000 series controller in a 456 maxes out controller, so we don’t add expansion chassis for M&E.
Unlike 412, 456 must scale-out Baseline stream count, scales to with LFF drives can be configured for non-tiered data use or, with dedicated MD, archive us
Dedicated metadata required for archive Explain when and why video and frametest were used and why we choose both during certain times
Explain Applications was used first to get some baseline for how our utilities were compared to actual tests
Explain our initial tests were all about raw performance by doing the unconstrained reads and writes, followed by Applications, followed by streams counts Go through highlights
Performance characteristics
Maybe move later in deck based on flow of slides