Netapp Insight 2012 Big Data Track Video Surveillance Storage Solution

1. BD-2-577
NetApp Video Surveillance
Storage Solution
Joel W. King

2. Agenda
This is a technical deep dive on video surveillance deployment
architectures and the role that storage plays – including how
to size, scale, and design using best practices derived from
extensive testing and experience with real world deployment
 Key Takeaways
− Identify video surveillance trends and their impact on storage
− How to size storage for video surveillance deployments
− Best practices for designing storage for video surveillance
 Resources – Contacts, TRs and Whitepapers
2

3. Outline
 Video Surveillance
Industry Trends
 Deployment Architectures
 Sizing Considerations
 Best Practices
 Summary / References
3

4. Video Surveillance
Industry Trends
4

5. Television has changed user expectations
 Increasing demand for Megapixel /
HDTV resolutions
 More than 50% of security cameras shipped
by 2014 will be megapixel/HD resolution
“The World Market for CCTV and Video Surveillance
Equipment – 2010 Edition.” – IMS Research
 Some expectations are unattainable
− Unlimited digital zoom
− Immediate forensic search results
CSI publicity Photo / Fair Use
5

6. Three ‘R’s of Video Surveillance
High Definition and Megapixel cameras
Resolution dramatically increase storage requirements
over Standard Definition
Increasing retention periods as storage costs
Retention decrease and public safety threats increase
Loss of video may incur fines (gaming) or
Reliability hamper forensic analysis
6

7. Resolution (Scaled to 20% of Original Size)
Factors Influencing
Demand for Storage
− Resolution
− Frame Rate
− Retention Period
− Image Complexity
− CODEC /
Compression
− Continuous or
Record on Motion
(CIF) Common Intermediate Format
7

8. Purchasing Decision Drivers
 Storage costs – 30% of deployment
Servers
 Key decision points are Surveillance
20%
Switches
25% 15%
− Network Video Cameras Software
− Video Management Software
10%
Storage
 Servers and Networking 30%
viewed as commodity items
 Storage efficiency and reliability
increasingly more important
8

9. Storage Requirements – 30 Day Retention Period
200 Number of Cameras 1000
E5460
E2660
Arecont Axis
Axis
Vision Q6035
P1346E
AV8185DN
6400 x 1200 1280x720 1920x1080 60 drives 120 drives 180 drives 240 drives 300 drives 360 drives
2.2 TB 330 GB 1.7 TB 180TB 360TB 540TB 720TB 900TB 1080TB
9

10. Deployment Architectures
10

11. Deployment Architectures
Recording Server model Cameras
Servers
• Control cameras 0101010 Video Management Software
• Receive video feed IP SAN
0101010
• Archive 0101010 iSCSI
SAN
Transport: IP Network FC
H.264/RTP/UDP or
Direct Attach
H.264/RTP/RTSP/TCP
SAS
MJPEG/TCP 0101010
Storage FC
Viewing
Camera to Storage model Workstations
• Bosch (iSCSI)
• MOBOTIX / IQinVision
(NFS/CIFS)
• Axis (Local SDHC / CIFS)
11

12. E-Series Modular Design for Video Surveillance
• 4U/60 x 3.5” drives
DE6600 • Highest throughput
• Largest capacity/density
• 3TB NL-SAS drives
Disk Shelves • Easy to service
• 8Gb/s FC • SAS (for RACK Solution)
Controllers • 12 or 24GB Cache per system • 4GB Cache per system
• ~ 24.8Gb/s write performance • ~ 11.2Gb/s write performance
• High Bandwidth / High IOPs • Cost effective performance
5400 2600
• Verify support in IMT • NVS Storage Rack only
Delivery
• Use Quote Edge • Quotable and orderable
through distribution
12

13. NetApp Video Surveillance Storage Solution Rack
Hardware / software components
OnSSI
Milestone Cisco
Utilities Windows Server Redhat
SANtricity 2008 R2 Linux
NTFS ext3
Video
10/100/1000 LAN on VMware ESXi 5.1 Broadcom
Ingress
Motherboard Quad Port
Management Raw device mapping 1Gb Ethernet
LOM
Cisco UCS (RDM) C220-M3 Links
Ethernet
LSI SAS 9200-8e – 6Gbps x 4 Aggregated
Serial Attached SCSI (SAS)
NetApp E2660
E-Series Controller Controller
A Cache Cache B
2GB 2GB
Volumes (LUNs)
13

14. NetApp Video Surveillance Storage Solution
Hardware / software components
Genetec Omnicast
Verint Nextivia
OnSSI Ocularis
Utilities Windows Server
Failover driver SANtricity 2008 R2
NTFS
10/100/1000 Management Optional ESXi 5.1 Gigabit /
Ethernet commercial 10 Gigabit Video
Management Ports Raw device mapping Ethernet
Ethernet off-the-shelf (RDM) Server(s) Ingress
8Gbps optional FC HBA
SAN SAN
NetApp E5460
E-Series Controller Controller
A Cache Cache B
6/12GB 6/12GB
Volumes (LUNs)
14

15. Virtualization
 Most VMS vendors support virtual servers (Milestone XProtect
certified with VMware and Microsoft Hyper-V)
 Recording servers are high resource demand –
do not co-host with other applications
 Some VMware functions
(Vmotion / Snapshots) not
supported on RDM LUNs
 Primary advantage – sharing
Network and FC or SAS HBAs
Raw device mapping (RDM)
15

16. Sizing Considerations
16

17. Sizing Based on Determining Several Parameters
Resolution
HW / SW
Performance
Video Management Volumes (LUNs)
Frame Rate Software
Number of Data Rate
Cameras Recording Server
CODEC
Compression
(Quality)
Group Variable/
Volume Group
of Pictures Constant
(GOP) Bit Rate RAID Level
Retention
Policy
Disk Drives
17

18. Bandwidth and Storage
Calculator
 Camera manufacturers provide
sizing calculators
 User Inputs:
− Camera Model
− Frame Rate
− Resolution
− Compression
− Image
Complexity
18

19. Image Complexity
 Variable Bit Rate (VBR)
− Pre-defined image
quality 7%
 Bandwidth fluctuates
− Scene complexity
− Motion
− Image Noise
7pm 7am
 Storage capacity and Lights off Lights on
throughput also change
19

20. Usable Capacity by RAID Level
Number of Dynamic Disk
RAID-6 RAID-5 RAID-10
3 TB Disks Pool (RAID-6)
14.8TB/month 2 2,794.019 GB
or 3 5,588.039 GB
40 18.8TB with 4 8,382.059 GB 5,588.039 GB
Cameras 20% free 5 8,382.059 GB 10.914 TB
space 6 10.914 TB 13.642 TB 8,382.059 GB
7 13.642 TB 16.371 TB
393 Mbps 8 16.371 TB 19.099 TB 10.914 TB
50 MB/s 9 19.099 TB 21.828 TB
Recording Server 10 21.828 TB 24.556 TB 13.642 TB
(100 IO/s) 11 21.375 TB 24.556 TB 27.285 TB
12 21.371 TB 27.285 TB 30.013 TB 16.371 TB
30 day 13 23.511 TB 30.013 TB 32.742 TB
retention 14 25.648 TB 32.742 TB 35.470 TB 19.099 TB
policy 15 27.789 TB 35.470 TB 38.199 TB
and 16 29.925 TB 38.199 TB 40.928 TB 21.828 TB
20% free 17 32.062 TB 40.928 TB 43.656 TB
space 18 34.199 TB 43.656 TB 46.385 TB 24.556 TB
20

21. Sizing Example
Video Surveillance Rack (2660) OnSSI Ocularis
RAID 1
Physical Server
1+1
VM Base Volume RAID 6
Group 12+2
VM Fail Over Server 1
Volume Volume
VM Fail Over Server 2 * Bookmarks Group
VOL_FAIL_1
3-5
VM RC-E Manager Days
30
VOL_ARCH_1 Days
Physical Server
RAID 6
VM Recording Server 1 12+2
VM Recording Server 2 Volume
RAID 10 Group
VM reserved Data Store
5+5
* VOL_FAIL_2
Volume
VM reserved RAID-1 Group
1
VOL_LIVE_1
Day VOL_ARCH_2
VOL_LIVE_2
2 Hot Spares
Per 60 disk shelf
21

22. Data Rates
NetApp Video Surveillance Storage Solution Rack
Link Aggregation
Physical Machine(s) Four 1 GigEthernet
640 Cameras
@
2 Mbps Each
Virtual Machines 256 Cameras @ 2 Mbps
512 Mbps 1.5 Gbps
aggregate
3 physical machines
10 virtual machines 28-32 TB
Volume
IOMETER test tool E2660
Failover
6 Gbps SAS
640 Mbps
9-11 Gbps @ 512K I/0
Failover ARCHIVE
32.742 TB VGs
Each VM writing to both (14+2)
64 Cameras LIVE
LIVE and ARCHIVE
per VM 1 TB 4.1TB VGs
Volume (5+5)
22

23. Best Practices
23

24. High Availability Architecture
Cameras to Storage Array
IP IP – Core /
Access Layer Distribution Layer
(B)
Overlapping
Field of View
(A) (B)
(A)
IP (B)
Server Recording
Access Layer Servers
(Top-of-Rack) (A) Dual Fabric E5460
SAN Duplex Controllers
24

25. Tuning Performance Parameters
 One active Volume (LUN) per  Start / Stop Cache Flush: 80%
Volume Group (VG)
 Flush Write Cache: 10 sec.
 Read/Write Cache: Enabled
 Cache Block Size: 32K
 Write Cache Mirroring:
 Media Scan Frequency: 30 days
Disabled
 Data Assurance (DA): Disabled
 Initial Segment Size: 128K
 Windows (NTFS) Allocation
Unit Size: 64K
26

26. OnSSI Ocularis / Milestone XProtect
Best Practices
 Archival function
 Moves video files from
„Recording‟ location to
„Archive‟ location.
 Files may be groomed
to reduce the frame rate Separate Recording and Archive Configuration
or encrypt
 User configured schedule
 I/O rates increase during
archive (8x observed)
Recording Only Configuration
27

27. Summary
 High Definition / Megapixel
cameras – must sell proposition –
drives storage sales
 Retention periods – minimum of
30 days – storage efficiency
 Reliability and Redundancy –
lead with high availability and
redundant solutions
 Trusted partner – Position the
NetApp brand through training,
education, certification and support
28

28. Resources
NetApp Video Surveillance Storage Solution
 Distribution List (DL) for questions on this session.
− xdl-bd-2-577@netapp.com
 NetApp Community (Blog Posts)
https://communities.netapp.com/blogs/Video_Surveillance_Solution
 Documentation
− Field Portal  E-Series Solutions 
NetApp Video Storage Solution
 Contacts
− Jenifer Piccioni, Solution Product Manager – Jenifer.Piccioni@netapp.com
− Jon Robbins, Solution Marketing Manager – Jon.Robbins@netapp.com
29

29. © 2012 NetApp, Inc. All rights reserved. No portions of this document may be reproduced without
prior written consent of NetApp, Inc. Specifications are subject to change without notice. NetApp,
the NetApp logo, and Go further, faster, are trademarks or registered trademarks of NetApp, Inc.
in the United States and/or other countries. All other brands or products are trademarks or
registered trademarks of their respective holders and should be treated as such.

30. Video Surveillance Acronyms
Video Codecs
 VMS Server : Video Management System  M-JPEG : Motion – Joint Photographic Experts Group
Server – aka Network DVR. Manages IP  MPEG-4 : ISO/IEC Moving Picture Experts Group
camera video feeds and storage media. (Part 2)
 Viewing Station: High-end Intel workstation  H.264 : ISO/IEC Moving Picture Experts Group (Part
10)
for displaying live or archived camera feeds.
on a locally attached monitor  JPEG 2000 – Joint Photographic Experts Group
(committee 2000)
 Video Wall : One or more dedicated
workstations to control/displays video on
physical and virtual monitors. Video Signaling and Transport Protocols
 HTTP : Hyper Text Transport Protocol
 IP Video Surveillance Camera : digital
video camera – small form factor IP  HTTPS : Secure HTTP
networked Linux host which encodes and  RTSP : Real Time Streaming Protocol
transports video over an IP network.  RTP : Real-time Transport Protocol
 RTCP: Real Time Transport Control Protocol
NetApp Confidential – Internal Use Only 31

31. NetApp Video Surveillance
Storage Solution Rack
 Video Management Software
− OnSSI Ocularis ES
− Milestone XProtect Corporate
− Cisco Video Surveillance Manager (VSM)
 VMware ESXi 5.1 hypervisor
 Cisco UCS C220-M3 Servers (2-4)
 E2660 (SAS) duplex controller (1-3 DE6600)
 Cisco Nexus 3048 Switches (2)
 Cisco Rack and Power Distribution Unit(s)
Pre-assembled by distribution channel partner
32

32. NetApp Video Surveillance Storage Solution Rack
 Cisco UCSC-C220-M3S High-Density Rack Server
− Intel(R) Xeon(R) CPU E5-2665 0 @ 2.40GHz (2 CPU 8 Core)
− 64 GB Memory
− N2XX-ABPCI03-M3 Broadcom 5709 Quad Port 1Gb
− LSI SAS 9200-8E 6Gb/s PCIe 2.0 HBA
− UCSC RAID SAS 2008M-8i Mezzanine Card
− A03-D300GA2 300 GB 6Gb SAS 10K RPM SFF HDD (2 disks)
 Cisco N3K-C3048TP-1GE Nexus 3048TP-1GE 1RU
− 48 x 10/100/1000 and 4 x 10GE ports
33

33. NetApp Video Surveillance Storage Solution Rack
 E2600 / DE6600
− Number of controllers: 2
− Data Cache: 2GB per controller
− Firmware version: [TBD]
− Host Interface: 6Gbps SAS (4 per controller)
− Drives (60-180):
 3TB 7500 rpm NL-SAS
 900GB 10K rpm SAS
34