Data In Motion

406 views

Published on

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
406
On SlideShare
0
From Embeds
0
Number of Embeds
124
Actions
Shares
0
Downloads
3
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Data In Motion

  1. 1. TIMMES Data Compression and Network Efficiency Technology for Data in Motion TIMMES, Inc. 601 5th Avenue North St. Petersburg, FL 33701 www.timmes.com 11/21/2013
  2. 2. ODEN and MAGNUS Technology Introduction • Optimized Data Environment for Networks (ODEN) provides increased data-in-motion network transmission efficiency utilizing compression and Transfer Control Protocol acceleration techniques. • Media Agnostic Global Network Uniform Saturation (MAGNUS) is an evolutionary improvement over ODEN to improve TCP communications and utilizes TCP acceleration to reduce the effect of latency and improve bandwidth efficiency for file transfers • ODEN and MAGNUS are proprietary software solutions for Data compression protocols, from a digital perspective, that efficiently compress, transmit, and decompress all file formats and data types, including video H.264/MPEG4 • TIMMES is deploying these technologies in production today, and 3rd party tests have validated their effectiveness • Readily deployable across wired, wireless and satellite use cases • Can be combined with TIMMES data-at-rest technologies, ODEN-M and LDNC, to further enhance their effectiveness 11/21/2013 2
  3. 3. ODEN and MAGNUS Market Discriminators Description ODEN • Software that utilizes proprietary technology to efficiently compress, transmit, and decompress a dataset of any type or size • ODEN replaces and improves upon FTP • Restructuring source data and/or files to optimize for transmission over high latency / low bandwidth networks • H.264/MPEG4 data passage MAGNUS • Evolution of ODEN, requires software on only one side of transmission (usually client) • Utilizes TCP acceleration to reduce effect of file transfer latency and bandwidth required Competing Market Technologies Likely Use Cases Data in Motion 11/21/2013 • Efficiency improvement of disadvantaged networks (e.g., satellite) • H.264/MPEG4 data passage • • • • FTP HTTP HTTP-S Open source / proprietary • Bluecoat • CISCO CIOS N/W Optimizer • CTCP – M/S • Steelhead Appliance • Open source / proprietary 3
  4. 4. ODEN Overview and Installation Technology Overview • Proprietary software-based file transfer protocol for data-in-motion that reduces effect of latency and bandwidth required to transport data • Efficiently compresses, transmits, and decompresses a dataset of any type or size, including video H.264/MPEG4 • 3rd party evaluation completed by the Defense Information Systems Agency (DISA) in 2007, in which ODEN’s Dynamic Transfer Syntax (DTS) attained lossless 200% to 2,000% network throughput increases over benchmark metrics • Covered by patent #7,379,605 (issued May 27, 2008) Installation and Operation • ODEN software is installed on both the client and server, compressing files prior to transmission • Verifies data by mini-block, only sending differences, and re-verifying macro-blocks - redundant data blocks are not sent; in the event of failure, ODEN resumes transmission at the point of failure without reconnect • Further optimizes transmission by examining previously sent files to find matching micro - or macro-blocks and prevents retransmission of redundant data Since 2002, ODEN has passed over 290TB of medical data with no loss or retransmission 11/21/2013 4
  5. 5. MAGNUS Overview and Installation Technology Overview • Evolution of ODEN technology for data-in-motion that requires software on only one side of transmission (usually client) • MAGNUS is effective in improving TCP communications and utilizes TCP acceleration to reduce the effect of latency and improve bandwidth efficiency for file transfers, including video H.264/MPEG4 (similar to ODEN) • 3rd party evaluation completed by the United States Southern Operations Command (USSOCOM) in 2008, which validated that the technology “performed brilliantly” Installation and Operation • MAGNUS is self tuning – during installation inbound/outbound IP addresses are set • MAGNUS creates new TCP connection with destination IP addresses and launches a proxy to spawn two concurrent threads (read/write) from one TCP socket; proxy process ends with closure of connection • Regulates transmission of data packets across the network (from the cache) on FIFO basis to ensure fair use and dynamically adjusts the timing of ACKS sent according to NACKS received Unlike other transfer protocols, MAGNUS is capable of operating in high latency environments (up to 4 seconds) 11/21/2013 5
  6. 6. ODEN and MAGNUS 3rd Party Test Background • Assessed video/imagery acceleration with a network accelerator (MAGNUS) on the client side and compression software (ODEN) on both the server and client side • MAGNUS provided for the acceleration of TCP traffic to maximize bandwidth and throughput on low bandwidth and high latency networks • MAGNUS functioned as a performance enhancing proxy for file transfer protocol using a client-to-server architecture for TCP acceleration with data compression capabilities Network Configuration and Test Scenarios • Client connected to the target server through the National Institute of Standards Technology (NIST) Net Emulator, which introduced delay and bit error rate (BER) • All data flow, server states, and switch states were monitored without introducing extraneous traffic to the network • Test scenarios emulated a standard wired connection and satellite connection at varying speeds • BER during all scenarios was configured to 1x10-9 to reflect average number of errors experienced on satellite and wired connections where collisions and errors are likely to occur File and Format Size Speed 1.5Mbps 25Mbps DOC 25Mb 50Mb 11/21/2013 JPEG JPEG2000 5Mb 13Mb 5Mb 13Mb PPT 25Mb 50Mb WMV 22Mb 40Mb MPEG4 20Mb 20Mb Transfer Protocols MPEG2 MoJPEG 20Mb 33Mb 20Mb 33Mb BMP 40Mb 40Mb NITF 100Mb 100Mb GeoTIF 450Mb 450Mb Protocol ODEN HTTP FTP Application Verison ODEN Script Microsoft Internet Explorer 7.0.5730.13 FileZilla 3.0.11 6
  7. 7. MAGNUS and ODEN+MAGNUS Transfer Rates 1.5Mbps FTP – Satellite Emulation 600ms RTT 1.5 Mbps FTP Baseline File Size (KB) File Type Transfer Avg. Transfer Time(s) Rate (KB/s) 1.5 Mbps FTP MAGNUS Improvement 1.5 Mbps MAGNUS/ODEN FTP Improvement Transfer Avg. Transfer Improvement Avg. Rate / Time(s) Rate (KB/s) (KB/s) Baseline (%) Transfer Avg. Transfer Improvement Avg. Rate / Time(s) Rate (KB/s) (KB/s) Baseline (%) DOC 25,674 337.7 76.0 N/A N/A N/A N/A 30.7 837.8 761.7 1101.8% JPEG 5,630 77.7 72.5 66.0 85.4 12.9 117.8% 38.7 145.5 73.1 200.8% JPEG2000 13,305 186.6 71.3 93.8 141.8 70.5 198.9% 84.6 157.4 86.1 220.7% WMV 23,202 297.0 78.1 204.1 113.7 35.6 145.5% 131.4 176.5 98.4 226.0% MPEG4 20,847 267.3 78.0 180.8 115.3 37.3 147.8% 127.4 163.7 85.7 209.9% MPEG2 21,208 272.9 77.7 152.8 138.8 61.1 178.6% 125.8 168.6 90.9 216.9% MoJPEG 33,754 467.7 72.2 238.4 141.6 69.4 196.2% 185.5 181.9 109.8 252.1% BMP 41,068 520.5 78.9 295.1 139.2 60.2 176.3% 61.5 667.7 588.8 846.2% NITF 98,318 1,268.7 77.5 722.6 136.1 58.6 175.6% 353.9 277.8 200.4 358.5% 441,288 6,128.2 72.0 3,178.1 138.9 66.8 192.8% 76.2 5,791.4 5,719.4 GeoTIF 900.0 8042.6% 5,791.4 837.8 Avg. Transfer Rate (KB/s) 800.0 667.7 700.0 600.0 500.0 400.0 277.8 300.0 200.0 100.0 76.0 145.5 72.585.4 157.4 141.8 71.3 JPEG JPEG2000 176.5 113.7 78.1 163.7 115.3 78.0 168.6 138.8 77.7 181.9 141.6 72.2 MPEG4 MPEG2 MoJPEG 139.2 78.9 136.1 77.5 BMP NITF 138.9 72.0 0.0 DOC WMV FTP Baseline FTP MAGNUS GeoTIF FTP MAGNUS/ODEN Note: FTP utilizing FileZilla (v3.0.11). 11/21/2013 7
  8. 8. MAGNUS and ODEN+MAGNUS Transfer Rates 1.5Mbps HTTP – Satellite Emulation 600ms RTT 1.5 Mbps HTTP Baseline File Type File Size (KB) 1.5 Mbps HTTP MAGNUS Improvement Transfer Avg. Transfer Time(s) Rate (KB/s) 1.5 Mbps MAGNUS/ODEN HTTP Improvement Transfer Avg. Transfer Improvement Avg. Rate / Time(s) Rate (KB/s) (KB/s) Baseline (%) DOC 25,674 249.9 102.8 151.3 169.7 67.0 165.2% JPEG 5,630 58.5 96.2 35.7 157.6 61.4 163.8% JPEG2000 13,305 131.8 101.0 79.8 166.7 65.7 165.1% WMV 23,202 226.3 102.5 137.2 169.1 66.5 164.9% MPEG4 20,847 203.6 102.4 123.5 168.9 66.5 165.0% MPEG2 21,208 207.1 102.4 125.5 169.1 66.7 165.1% MoJPEG 33,754 327.4 103.1 198.0 170.5 67.4 165.3% BMP 41,068 397.3 103.4 239.8 171.3 67.9 165.7% NITF 98,318 962.8 102.1 569.5 172.6 70.5 169.1% 441,288 4,384.4 100.7 2,545.2 173.4 72.7 Transfer Avg. Transfer Improvement Avg. Rate / Time(s) Rate (KB/s) (KB/s) Baseline (%) 172.3% GeoTIF ODEN REPLACES FTP 200.0 169.7 Avg. Transfer Rate (KB/s) 180.0 169.1 166.7 157.6 160.0 173.4 172.6 171.3 170.5 169.1 168.9 140.0 120.0 100.0 80.0 102.8 76.0 101.0 96.2 72.5 71.3 102.5 78.1 102.4 78.0 102.4 77.7 103.1 72.2 103.4 78.9 102.1 77.5 100.7 72.0 60.0 40.0 20.0 0.0 DOC JPEG JPEG2000 WMV MPEG4 MPEG2 FTP Baseline HTTP Baseline MoJPEG BMP NITF GeoTIF HTTP MAGNUS Note: HTTP utilizing Microsoft Internet Explorer (v7.0.5730.13). 11/21/2013 8
  9. 9. MAGNUS and ODEN+MAGNUS Transfer Rates 25Mbps FTP – Wired Connection 35ms RTT 25 Mbps FTP MAGNUS Improvement 25 Mbps FTP Baseline File Type File Size (KB) 25 Mbps MAGNUS/ODEN Improvement Avg. Rate / Transfer Avg. Transfer Improvement (KB/s) Baseline (%) Time(s) Rate (KB/s) Transfer Avg. Transfer Time(s) Rate (KB/s) Avg. Rate / Transfer Avg. Transfer Improvement Time(s) Rate (KB/s) (KB/s) Baseline (%) DOC 51,185 44.7 1,145.0 17.9 1,434.6 289.6 125.3% 5.91 8,667.1 7,522.1 756.9% JPEG 5,630 5.0 1,125.9 2.1 2,631.2 1,505.3 233.7% 2.77 2,030.0 904.1 180.3% JPEG2000 13,305 11.5 1,154.7 4.8 2,773.6 1,619.0 240.2% 6.19 2,149.1 994.4 186.1% WMV 41,179 35.2 1,171.4 14.4 2,853.1 1,681.7 243.6% 14.13 2,913.5 1,742.1 248.7% MPEG4 20,847 18.0 1,159.9 7.4 2,811.4 1,651.5 242.4% 7.96 2,619.4 1,459.5 225.8% MPEG2 21,208 18.2 1,164.9 7.5 2,819.4 1,654.4 242.0% 8.26 2,567.8 1,402.9 220.4% MoJPEG 33,754 28.9 1,169.8 11.9 2,846.0 1,676.2 243.3% 12.09 2,790.8 1,621.0 238.6% BMP 41,068 35.0 1,172.5 14.4 2,850.5 1,678.0 243.1% 6.44 6,377.4 5,204.9 543.9% NITF 98,318 83.4 1,179.6 34.2 2,876.7 1,697.1 243.9% 26.07 3,770.8 2,591.3 319.7% 441,288 374.0 1,179.9 155.1 2,844.6 1,664.6 241.1% 12.99 33,977.3 32,797.3 2879.6% GeoTIF 10,000.0 Avg. Transfer Rate (KB/s) 9,000.0 33,977.3 8,667.1 8,000.0 6,377.4 7,000.0 6,000.0 5,000.0 4,000.0 3,000.0 2,000.0 1,000.0 1,434.6 1,145.0 2,631.2 2,030.0 1,125.9 2,773.6 2,149.1 1,154.7 2,913.5 2,853.1 1,171.4 2,811.4 2,619.4 1,159.9 2,819.4 2,567.8 1,164.9 2,846.0 2,790.8 1,169.8 2,850.5 1,172.5 3,770.8 2,876.7 1,179.6 2,844.6 1,179.9 0.0 DOC JPEG JPEG2000 WMV FTP Baseline MPEG4 FTP MAGNUS MPEG2 MoJPEG BMP NITF GeoTIF FTP MAGNUS/ODEN Note: FTP utilizing FileZilla (v3.0.11). 11/21/2013 9
  10. 10. MAGNUS and ODEN+MAGNUS Transfer Rates 25Mbps HTTP – Wired Connection 35ms RTT 25 Mbps HTTP Baseline File Size (KB) File Type DOC 25 Mbps HTTP MAGNUS Improvement Transfer Avg. Transfer Time(s) Rate (KB/s) 25 Mbps MAGNUS/ODEN HTTP Improvement Transfer Avg. Transfer Improvement Avg. Rate / Time(s) Rate (KB/s) (KB/s) Baseline (%) 51,185 31.4 1,631.7 23.40 2,187.0 555.3 134.0% 5,630 5.1 1,111.1 16.81 335.0 (776.1) 30.2% 13,305 9.7 1,377.7 30.04 443.0 (934.8) 32.2% WMV 41,179 25.0 1,648.5 9.04 4,557.6 2,909.2 276.5% MPEG4 20,847 13.9 1,495.2 7.56 2,757.0 1,261.8 184.4% MPEG2 21,208 14.0 1,511.3 8.98 2,361.5 850.2 156.3% MoJPEG 33,754 21.3 1,585.1 12.50 2,700.5 1,115.4 170.4% BMP 41,068 25.6 1,603.8 15.28 2,688.2 1,084.4 167.6% NITF 98,318 59.1 1,664.5 35.46 2,772.8 1,108.3 166.6% 441,288 257.8 1,711.8 156.22 2,824.8 1,112.9 Transfer Avg. Transfer Improvement Avg. Rate / Time(s) Rate (KB/s) (KB/s) Baseline (%) 165.0% JPEG 1 JPEG2000 GeoTIF 1 5,000.0 4,557.6 4,500.0 Avg. Transfer Rate (KB/s) ODEN REPLACES FTP 4,000.0 3,500.0 2,757.0 3,000.0 2,500.0 2,000.0 1,500.0 1,631.7 1,145.0 1,000.0 1,125.9 1,111.1 335.0 500.0 2,700.5 2,361.5 2,187.0 1,377.7 1,154.7 1,648.5 1,171.4 1,495.2 1,159.9 1,511.3 1,164.9 1,585.1 1,169.8 MPEG4 MPEG2 MoJPEG 1,603.8 1,172.5 2,824.8 2,772.8 2,688.2 1,664.5 1,179.6 1,711.8 1,179.9 443.0 0.0 DOC JPEG JPEG2000 WMV FTP Baseline HTTP Baseline Note: HTTP utilizing Microsoft Internet Explorer (v7.0.5730.13). 1: GZIP compression was turned on for JPEG and JPEG2000 test cases, negatively impacting transfer rates. 11/21/2013 BMP NITF GeoTIF HTTP MAGNUS 10
  11. 11. Summary ODEN and MAGNUS  Powerful, proprietary data compression and network efficient technology  Offers significant reduction in bandwidth requirements for data passage and time to pass data  Provides optimum cloud storage solutions and reduces the SAN bottleneck in the Cloud  Greatly benefits video application: TIMMES’ compression and network efficient technology can be deployed for use in video transfer and storage of H.264/MPEG4 data 11/21/2013 11
  12. 12. Disclosure Statement TIMMES CONFIDENTIAL Copyright © 2013 by TIMMES All rights reserved. This document, which includes the information contained herein,: (i) is the exclusive property of TIMMES Corporation; (ii) constitutes TIMMES confidential information; (iii) may not be disclosed by you to third parties; (iv) may only be used by you for the exclusive purpose of facilitating your internal TIMMES-authorized use of the TIMMES product(s) described in this document to the extent that you have separately acquired a written license from TIMMES for such product(s); and (v) is provided to you solely on an ―AS-IS‖ basis. In no case will you cause this document or its contents to be disseminated to any third party, reproduced or copied by any means (in whole or in part) without TIMMES’s prior written consent. Any copy of this document, or portion thereof, must include this notice, and all other restrictive legends appearing in this document. Note that any product, process or technology described in this document may be the subject of other intellectual property rights reserved by TIMMES and are not licensed hereunder. No license rights will be implied. Use, duplication, or disclosure by the United States government is subject to the restrictions set forth in DFARS 252.227-7013©(1)(ii) and FAR 52.227-19. Other brand and product names used herein are for identification purposes only and may be trademarks of their respective companies. 11/21/2013 12

×