The document describes Coldstore, a storage solution from Veracity that addresses challenges with traditional hard disk drives (HDDs) in surveillance systems. It presents SFS (Sequential Filing System) and LAID (Linear Array of Idle Disks) which utilize HDDs more efficiently for surveillance needs by writing data sequentially and only powering one disk at a time. This reduces wear, heat, vibration and failure rates compared to RAID solutions. When an HDD fails in LAID, the system skips it and continues functioning normally without data loss or rebuild times.

1. C O L D S T O R E A R C U S
COLDSTORE
with Milestone Arcus
Q3 2013
By SQX

2. C O L D S T O R E A R C U S
Agenda
Present Challenges in Storage
• Hard Disk
• FAT32, NTFS etc..
• R.A.I.D. (Redundant Array of Independent
Disks)
Veracity’s Answer to Storage
• SFS (Sequential Filing System)
• L.A.I.D. (Linear Array of Idle Disks)
Application of Coldstore
• Network Attached Storage
• Embedded Network Video Recorder

3. C O L D S T O R E A R C U S
Present Challenges
IT and Surveillance industry alike

4. C O L D S T O R E A R C U S
Challenges
Longer retention time
Higher resolution & frame rate
Storage!!! 100TB – 10PB is common!!!
Typical Surveillance System
Storage
Cameras
Server & Network
Misc.

5. C O L D S T O R E A R C U S
Challenges – Hard Disk 101
Actuator
Read/Write Arm
Read/Write Head
Spindle
Disk Platters
Hard drives are the most important and most sensitive part of the system!!!
7,200 to 15,000 rpm
Gap is 3 nanometer
Imagine a fighter jet at Mach 8, flying 1 mm above ground!!!

6. C O L D S T O R E A R C U S
Challenges – Hard Disk 101
Actuator
Read/Write
Arm
Read/Write
Head
Disk Platter
Spindle
Cylinder
Sector

7. C O L D S T O R E A R C U S
Challenges – Hard Disk 101
Heat, Vibration & Wear will kill it!!!
UBE (Unrecoverable Bit Error) is inevitable
• Enterprise SATA capacity increased by a factor
of 375 over the past 15 years
• Error rate improved only 10x in the same time
• Actually, it is closer then ever!!!
Device Hard Error Rate in Bits PB equivalent
Consumer SATA 10E14 .89
Enterprise SATA 10E15 8.88
Enterprise SAS/FC 10E16 88.82

8. C O L D S T O R E A R C U S
Challenges – Hard Disk Fails
Hard Disk Fails more frequently due to:
• Temperature
• Vibration
• Wear
Heat
Dust
Forced Ventilation
Vibration
Full Power
Power Spikes

9. C O L D S T O R E A R C U S
Challenges – File System 101
WD Raptor X HD 10,000 rpm
Max Data Rate 84MB/s
1 GB File in 46 Secs (21.7MB/s)
http://vimeo.com/sqx/veracitydfs

10. C O L D S T O R E A R C U S
Challenges – File System 101
Examples
• FAT, FAT32, XFS, HFS, NTFS etc..
Directory
• a complex map of all files and file segments
Ideal for random and rapid access to any
file
Challenges :
• Directory area uses 5% of disk space
• Disk can become severely fragmented over
time
• Directory is most written-to area of disk

11. C O L D S T O R E A R C U S
Challenges – RAID 101
Commonly adopted RAID level:
• RAID 5 & 6 – Archive Database (Milestone XProtect)
• RAID 10 – Live Database (Milestone XProtect)
Mirror & Stripe across HDDs
Rebuild base on parity bit on failure

12. C O L D S T O R E A R C U S
Challenges – RAID 101
Serious Write Penalty
Long rebuild time, especially when writing is ongoing!!!
Full speed & full power on all hard disk, high duty cycle!!!
Disk failures are highly co-related.
RAID rebuild at 10% of full disk rate
RAID has been
evolving over the past
quarter century!!!

13. C O L D S T O R E A R C U S
Challenges – RAID Fails
We can roughly classify hard disks into two classes :
• Enterprise Storage (ES) and Personal Storage (PS)
ES disks are designed for high duty cycles, PS disks for low duty cycles
BUT : nearly all DVR / NVR systems and external storage systems used for
DVR / NVR systems use PS disks on grounds of cost
Thus PS disks are used in ES mode
Also : failure rate increases exponentially with temperature & vibration!!!
Seagate quotes Annualised Failure Rates (AFR) for both types of disks used
in both modes (under ideal conditions)
• PS disks used in PS mode : AFR = 0.34%
• PS disks used in ES mode : AFR = 1.25%
RAID 1, RAID 5, RAID 6 systems (in %) Year 1 Year 2 Year 3 Year 4 Year 5
Probability of individual disk failure per year 1.25% 2.50% 3.75% 5.00% 6.25%
Cumulative probability of individual disk surviving 98.75% 96.28% 92.67% 88.04% 82.53%
Cumulative probability of individual disk failing 1.25% 3.72% 7.33% 11.96% 17.47%
Cumulative probability of 16-disk array surviving 81.77% 54.53% 29.59% 13.02% 4.64%
Cumulative probability of 16-disk array failing 18.23% 45.47% 70.41% 86.98% 95.36%

14. C O L D S T O R E A R C U S
Challenges – Power Consumption
According to Western Digital (http://www.wdc.com/en/products/greenpower/)
• One 10W PS drive running at 8760 hours/year with a 65% efficient power
supply at $0.12 per kilowatt hour =
• Cost of ownership of $10.51/year
• 60.5 Kg of CO2 generated (the same as 14 days of driving!) per year
• 15 of the same drives?
• 150 watts
• 131,400 total hours per year of use
• Cost of ownership $157.68/year
• 907.5 Kg of CO2 which is the same as 210 days of driving per year
But WAIT!
• 15 drives in a RAID 5 array- assume 30TB total- need:
• 200 watts for the drives
• 200+ watts for the motherboard, fans, cooling, etc. (125% more)
• Assume a 500 watt power supply…
• $525.60 per year TCO ($1.44 per DAY)
• 2,520 Kg of CO2 generated

15. C O L D S T O R E A R C U S
Challenges
Heat
Vibration
Fragmentation
Operating & Cooling Power
Write Penalty
Unrecoverable Bit Error
Long Rebuild Time
Enterprise Grade Hard Disk

16. C O L D S T O R E A R C U S
Other peoples’ answers!!!
Solid State Drive (SSD)
N+4 redundancy in disk array
Smart failure of HDD (eliminate rebuild time)
Tons of CPU for rebuild
Liquid cool system (vs. Air Cold)
Scale Out NAS
Full replication of data
Online defragmentation
Snapshot backup & incremental backup
Are they all relevant to Surveillance Industry?!

17. C O L D S T O R E A R C U S
Veracity’s answer
For the Surveillance industry
Storage as the foundation of your surveillance system

18. C O L D S T O R E A R C U S
Surveillance Industry’s need
97% of disk operation in Surveillance are write
operations!!!!
• Other IT application is quite the opposite.
Surveillance data is BIG but sequential!!!!
• Others is not as BIG and randomized.
Speed requirement is high, but, not that high.
• Present HDD technology can handle.
Directory requirement is low.
• Channel and time header is simple.
Yesterday’s data Today’s data
nowTime

19. C O L D S T O R E A R C U S
Veracity’s answer
Coldstore, cures the HDD’s high failure
rate!!!
• SFS™ – Sequential Filing System
• LAID™ – Linear Array of Idle Disks
US/Worldwide Patent Applications filed in 2006
Product was released in 2009

20. C O L D S T O R E A R C U S
Coldstore – SFS
WD Raptor X HD 10,000 rpm
Max Data Rate 84MB/s
2 GB File in 30 Secs (66.7MB/s)
Three times faster!!!!
http://vimeo.com/sqx/veracitysfs

21. C O L D S T O R E A R C U S
Coldstore– SFS
No directory & large clusters
Allocation blocks
• 1 header sector + 128 data sectors
• fast playback of sequential files & even fast reverse
playback !
Single-sector header area uses 0.78% of disk
space
• Vs. 5% of disk space used for directory in NTFS or FAT
As fast as the theoretical speed limit!!!
Negligible read/write arm movement, less
vibration
• Low wear, low errors, lower temperature
• Dramatically increased MTBF (i.e. reduced AFR)

22. C O L D S T O R E A R C U S
Coldstore– SFS
Hint index
• uses less than 0.0001% of disk space
• NOT ESSENTIAL and is easily reconstructed
Highly robust data structure
• even severely damaged disk can be read
Light encryption available

23. C O L D S T O R E A R C U S
Coldstore – LAID
L.A.I.D.
• Linear Array of Idle Disks
Only required HDD is turned ON
Use SFS as file system
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15

24. C O L D S T O R E A R C U S
Coldstore – LAID with protection
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs
Current disks
(Powered On)
Idle disks
(Powered Off)

25. C O L D S T O R E A R C U S
Coldstore – LAID with protection
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs
Current disks
(Powered On)
Idle disk
(Shut Off)

26. C O L D S T O R E A R C U S
Coldstore – LAID with protection
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

27. C O L D S T O R E A R C U S
Coldstore – LAID with protection
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

28. C O L D S T O R E A R C U S
Coldstore – LAID with protection
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

29. C O L D S T O R E A R C U S
Coldstore – LAID with protection
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

30. C O L D S T O R E A R C U S
Coldstore – LAID with protection
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

31. C O L D S T O R E A R C U S
Coldstore – LAID with protection
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

32. C O L D S T O R E A R C U S
Coldstore – LAID with protection
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

33. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

34. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

35. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

36. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

37. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

38. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

39. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
A better solution : Mirrored Writing with Overlapping Pairs

40. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
So what happens now when a disk fails ?

41. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
So what happens now when a disk fails ?

42. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
So what happens now when a disk fails ?

43. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
So what happens now when a disk fails ?
Data is preserved Writing skips over to new pair…
…and carries on normally

44. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
And how does the disk failure affect the system ?
The failed disk is skipped and the old
data on the next disk overwritten
…and writing carries on normally

45. C O L D S T O R E A R C U S
Sequential Storage - LAID
1 2 3 4 5 6 7 8 9 10 11 12131415
What is the overall effect of a failed disk ?
• No effect - the disk array continues to operate normally
• No data are lost
• Nothing needs to be rebuilt
What happens when the failed disk is replaced ?
• It is automatically checked for capacity, then shut down
• Then it is written to during the next storage loop cycle
How soon must the failed disk be replaced ?
• Anytime before the faulty disk would normally be overwritten – e.g. if the storage
loop was 30 days with 15 disks (i.e. 2 days per disk), then within 28 days.
What happens if the disk not replaced ?
• The storage period shortens by one disk, e.g. in the above example the storage
period would drop from 30 days to 28 days, but the most recent 28 days would
still be preserved

46. C O L D S T O R E A R C U S
Physical Location Of Evidence
Evidential advantages
• The original recording of vital evidence can be easily located
• The evidence can be removed and preserved
• One, several or ALL disks can be removed if required
• Very large data volumes may be transported
• Disks may be copied off line
• A disk may be played back through a USB cradle on a PC
The sequential nature of
recording means that the
physical location of any
particular date and time
span is now very easy :
Simply select any disk
(highlighted by yellow LED)
and the time span will be
displayed.
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
Sunday, 7th January 2007 – 13:42:21
to
Tuesday 9th January 2007 – 15:38:10
Tuesday 9th January 2007 – 15:38:10
To
Thursday 11th January 2007 – 17:34:09
Thursday 11th January 2007 – 17:34:09
To
Saturday 13th January 2007 – 19:30:17
Saturday 13th January 2007 – 19:30:17
To
Monday 15th January 2007 – 21:26:22
Monday 15th January 2007 – 21:26:22
To
Wednesday 17th January 2007 – 23:22:01

47. C O L D S T O R E A R C U S
COLDSTORE System Power Consumption
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
Motherboard consumes only 15 to 20W
Total Power Consumption of Array
• Around 70W with 2 disks operating
• Includes PSU inefficiencies
• Assumes dual hot-swappable PSU
RAID-5 Equivalent need 200 Watt
Don’t forget the exact 125% for cooling

48. C O L D S T O R E A R C U S
Expansion – Master & Slave
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
MASTER
16 17 18 19 20 21 22 23 24 25 26 27 28 29 30SLAVE 1
31 32 33 34 35 36 37 38 39 40 41 42 43 44 45
SLAVE 2
Extended Sequential Recording : Disks 1 to 45
Master-Slave system with :
1 Master
2 Slaves
45 Disks
90 TeraByte Capacity
Massive storage periods
Reliability x 20 (estimate)
Power consumption ~ 150W
average
Any storage period identified
instantly
Any faulty disks replaced at leisure
Simplified evidential transport

49. C O L D S T O R E A R C U S
Application– NAS or NVR
Network Attached Storage
• Use Coldstore’s SDK
• Perfect for any sequential data
• Event log
• Audio
• Media industry
• Surveillance
Embedded Network Video Recorder
• Coldstore Arcus!!!!

50. C O L D S T O R E A R C U S
Do we answer to the challenges?
Heat
Vibration
Fragmentation
Operating & Cooling Power
Write Penalty
Unrecoverable Bit Error
Long Rebuild Time
Enterprise Grade Hard Disk

51. C O L D S T O R E A R C U S
COLDSTORE Benefits
Field proven since 2006, in Europe and USA market.
Total system >20 times higher reliability
>10 times lower power use, >15 times lower running costs
25% lower cost (no Windows, no system disk, no RAID controllers, own hardware, largest disks, no cooling)
Specifically designed for Surveillance applications
• Linear recording – exact location of dates & times
• Faulty disk replacement - no rebuild required (simply copy)
• Hot swap of all drives (actually cold-swap) at any time and are USEFUL
• Hot expansion of storage capacity
• Infinite storage capacity by use of new drives (all-SATA system)
• Each drive : self-contained continuous recording period
• Low level automatic encryption
System design will cope with
• Multiple channel data generation
• Start/Stop data generation
• Varying data rate per channel
• Some idiot pulling the disk being written to
• Total power loss, with very fast reboot time

52. C O L D S T O R E A R C U S
Milestone Arcus on Coldstore
World number one VMS
On
The best surveillance storage

53. C O L D S T O R E A R C U S
EMBEDDED VIDEO SURVEILLANCE PLATFORM

54. C O L D S T O R E A R C U S
What is Milestone Arcus?
Milestone Arcus is the video surveillance
platform designed for embedding into
hardware technology to produce an
efficient, intuitive and ready-to-use video
surveillance solution

55. C O L D S T O R E A R C U S
Who is Milestone Arcus for?
Hardware technology vendors
Linux, Mac® OS X, or Microsoft
Windows® operating systems running on
Intel or Arm based processors
These devices are suitable for Milestone
Arcus edge video surveillance solution:
• Network storage
• IP Cameras
• Switches
• Consumer electronic devices
• Other embedded surveillance device on the
edge

56. C O L D S T O R E A R C U S
System Complexity
Complex
Simple
Small Medium Large
Airport
Security
Education
City
Surveillance
Ports
Industry
Hotel
Gaming &
Casinos
Retail
Finance Government
Transport
Residential
Commercial
Complex
Residential Complexity depends
on
applications, NOT
only on number of
channels!!!

57. C O L D S T O R E A R C U S
Typical VMS of today

58. C O L D S T O R E A R C U S
Playback Stream
Simplicity – Coldstore Arcus

59. C O L D S T O R E A R C U S
Arcus – Operation

60. C O L D S T O R E A R C U S
Arcus – Operation

61. C O L D S T O R E A R C U S
Arcus – Operation

62. C O L D S T O R E A R C U S
Arcus – Milestone Mobile
Available on Android & iOS
Viewing, playback, multiple servers
access…..

63. C O L D S T O R E A R C U S
Milestone Interconnect
Central surveillance site
XProtect® Corporate
Any size
Any number
Remote management Remote surveillance
XProtect® Essential
XProtect® Express
XProtect® Professional
XProtect® Enterprise
Please refer to Milestone’s website for the latest list of products compatible with
Milestone Interconnect: www.milestonesys.com/milestoneinterconnect_compatibility
Remote backupRemote backup

64. C O L D S T O R E A R C U S
Why Coldstore Arcus?
Why you want a storage supplier to develop and
support a VMS?
Why you want a VMS vendor to source and
support the storage for you?
Coldstore Arcus provides:
• 5 Years software upgrade plan on Milestone Arcus
• Upgrade path to Milestone Interconnect on pre-channel
basis.

65. C O L D S T O R E A R C U S
Thanks!!!
Please contact SQX for further details.
sales@securex.hk
+852 31043323