Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
ClearSight Video and Audio Quality Evaluation Seminar -- Triple Play Analysis -- ClearSight Networks, Inc. ClearSight Netw...
Sehedule <ul><li>10:00 - 10:20    ClearSight Analyzer  </li></ul><ul><li>・   ClearSight Networks Overview </li></ul><ul><l...
At the Seminar Start  ( background ) <ul><li>You have not established the method to evaluate video quality </li></ul><ul><...
ClearSight Networks and Analyzer
ClearSight Introduction ClearSight Networks, Inc. Start    2002 Location    Fremont, CA, US
Media and Awards
Customer (in US)
<ul><li>Top to down Analysis Process of </li></ul><ul><li>ClearSight Analyzer </li></ul>
STEP1.  Classify Application ・ Top to down analysis process of ClearSight Analyzer The number of servers, flows, problems,...
STEP2.  Ladder View ・ It shows application flow ladder view between server and client. It will show fault in red or yellow...
STEP3.  Decode Screen Only the packet in ladder view will be filtered to show in Decode screen Protocol Decode Details
STEP4.  Application Content Placyback HTTP reassemble Audio/Video Playback User activity and content of FTP, Telnet, E-mai...
・ Triple-Play Distribution Step5.  Report Ration of application data, audio and video is shown in this graph. When trouble...
  ClearSight  Product Line
ClearSight Analyzer Product Line  with Triple-play <ul><li>ClearSight  Analyzer Series </li></ul><ul><ul><li>10/100M  Soft...
ClearSight  Analyzer Series   10/100M  Software Version ClearSight <ul><li>   Application Drill-down Analysis </li></ul><u...
10/100/Gigabit  Portable PC version <ul><li>The traffic on duplex gigabit ethernet will be separated into ChA/ChB to analy...
10/100M  Full Duplex Laptop Version <ul><li>Bidirectional traffic on 10/100M full duplex ethernet will be separated when f...
ClearSight  Analyzer Series 10Gb Analyzer ■ Full wire-rate capture    2GB capture capacity is available at full wire rate ...
ClearSight Network Time Machine  Series Rack-mounted Version ○ ○ × Capture Filter ○ ○ × Slicing Up to 9.9 TB - - Expandabi...
ClearSight Network Time Machine  Series Portable Version New ○ Capture Filter ○ Slicing 42.7cm(W) x 29.1cm(H) x 11.2cm(D) ...
VoIP  Audio Quality Evaluation
VoIP  Ladder View ・ Ladder View Screen
Major cause audio quality decreased ・ Packet loss ・ Out of sequence ・ Jitter ・ Delay and so on Audio quality evaluation me...
Statistics ・ RTP  Statistic Screen
Alert ・ RTP  related threshold ・ Alarm Indication
Call Log Browser <ul><li>Report Item </li></ul><ul><ul><li>Call Status </li></ul></ul><ul><ul><li>Number of Calls </li></u...
Report (Quality Report) ・ Audio Quality Report for each Call
Report (History Report) ・ History Report ・ MOS  Summary History Report
Audio Playback ・ ClearSight  support Codecs
Video Quality Evaluation
Video Data <ul><li>・ TV  Meeting </li></ul><ul><li>・ IPTV </li></ul><ul><li>  -  IP Broadcast Service </li></ul><ul><li>  ...
・ Packet loss -RTP - IPv6 fragment packet ・ Out of sequence ・ Jitter ・ Delay Video Quality Measurement
Video Quality Measurement Statistics ・ Statisitics  
Video Quality Measurement Methods <ul><li>R-value and MOS are for Audio, what is for Video…? </li></ul><ul><li>MDI ( Media...
MDI ( Media Delivery Index ) <ul><li>DF ( Delay Factor ) buffer estimation </li></ul><ul><li>DF ( per unit time ) =( max (...
VQFactor The  VQFactor , whose  highest value is 5 , considers the following causes of quality deterioration. ・ Bandwidth ...
Technology Comparison   Low High Accuracy ( consideration ) N Y Video MOS Value N Y Codec reference Y Y Packet loss refere...
Video Quality Measurement VQFactor  and MDI Statistics   ・ Statistics
MPEG  Statistics <ul><li>MPEG  Statistics </li></ul><ul><ul><li>3 -type frames </li></ul></ul><ul><ul><ul><li>I- frame  – ...
MPEG Stats I-Frame Stat P-Frame Stat B-Frame Stat
Video Codec <ul><li>Codecs </li></ul><ul><ul><li>To encode and decode video steam </li></ul></ul><ul><ul><li>Individual st...
Video Codec <ul><li>ClearSight playback supports codecs : </li></ul><ul><ul><li>H.264 (Baseline, Main, Extend) </li></ul><...
Video Quality Alarm <ul><li>Alarm </li></ul><ul><ul><li>Several  deterioration   causes can be set </li></ul></ul><ul><ul>...
Video Quality Report <ul><li>Video Quality Report </li></ul><ul><ul><li>IPTV video steam report can be editted just like V...
Move connecting point
Demo Environment
Delay Generating Device Summary <ul><li>■   Features </li></ul><ul><li>*  Even in the emulate environment (64byte 100%), i...
ANUE  circuit fault device ( Packet loss, Delay ) SIP  Server 192.168.6.1 Demo Environment Client 192.168.7.2 Telephone   ...
Video quality problem solving steps <ul><li>The normal standard VQFactor measured such as measuring result in lab environm...
Thank You!
Upcoming SlideShare
Loading in …5
×

ClearSight Video and Audio Quality Evaluation Seminar

621 views

Published on

  • Be the first to comment

  • Be the first to like this

ClearSight Video and Audio Quality Evaluation Seminar

  1. 1. ClearSight Video and Audio Quality Evaluation Seminar -- Triple Play Analysis -- ClearSight Networks, Inc. ClearSight Networks, Inc.
  2. 2. Sehedule <ul><li>10:00 - 10:20   ClearSight Analyzer </li></ul><ul><li>・ ClearSight Networks Overview </li></ul><ul><li>・   Product Overview </li></ul><ul><li>10:20 – 10:45 Audio and Video quality measurement </li></ul><ul><li> ・ Audio quality measurement </li></ul><ul><li> ・  Video quality measurement </li></ul><ul><li> ・ MDI and VQFactor </li></ul><ul><li>  </li></ul><ul><li>10:45 - 11:30 Audio/Video in actual environment         </li></ul><ul><li>        ClearSight Analyzer measures audio/video quality when connection fault (delay, packet loss) occurs. </li></ul><ul><li>11:30 - 11:45   IPTV analysis method </li></ul><ul><li>11:45 - 12:00 Question and Answer </li></ul>
  3. 3. At the Seminar Start ( background ) <ul><li>You have not established the method to evaluate video quality </li></ul><ul><li>Video service has begun </li></ul><ul><ul><li>IPTV, VOD and TV meeting, [sekiyuriitei] supervisory camera ...... </li></ul></ul><ul><li>It is necessary to analyze audio and video simultaneously. </li></ul><ul><ul><li>Video data record needs large storage HDD </li></ul></ul><ul><ul><li>Long time monitor is needed when there is intermittent fault. </li></ul></ul>It is difficult to troubleshooting
  4. 4. ClearSight Networks and Analyzer
  5. 5. ClearSight Introduction ClearSight Networks, Inc. Start    2002 Location    Fremont, CA, US
  6. 6. Media and Awards
  7. 7. Customer (in US)
  8. 8. <ul><li>Top to down Analysis Process of </li></ul><ul><li>ClearSight Analyzer </li></ul>
  9. 9. STEP1. Classify Application ・ Top to down analysis process of ClearSight Analyzer The number of servers, flows, problems, issues and throughput in each application
  10. 10. STEP2. Ladder View ・ It shows application flow ladder view between server and client. It will show fault in red or yellow when communication error occurs.
  11. 11. STEP3. Decode Screen Only the packet in ladder view will be filtered to show in Decode screen Protocol Decode Details
  12. 12. STEP4. Application Content Placyback HTTP reassemble Audio/Video Playback User activity and content of FTP, Telnet, E-mail, Database, VoIP application etc. can be played back.
  13. 13. ・ Triple-Play Distribution Step5. Report Ration of application data, audio and video is shown in this graph. When troubleshooting, you can grasp the change of respective application distribution at a glance. ・ HTTP Report
  14. 14.   ClearSight Product Line
  15. 15. ClearSight Analyzer Product Line with Triple-play <ul><li>ClearSight Analyzer Series </li></ul><ul><ul><li>10/100M Software Analyzer </li></ul></ul><ul><ul><li>10/100M Full Duplex Laptop Analyzer </li></ul></ul><ul><ul><li>10/100/Gigabit Portable PC Analyzer </li></ul></ul><ul><ul><li>10G Portable PC Analyzer </li></ul></ul><ul><li>ClearSight Network Time Machine Series </li></ul><ul><ul><li>Rack-mounted </li></ul></ul><ul><ul><li>Portable </li></ul></ul>
  16. 16. ClearSight Analyzer Series 10/100M Software Version ClearSight <ul><li>   Application Drill-down Analysis </li></ul><ul><li>   Ladder view   </li></ul><ul><li>    Real time application flow analysis </li></ul><ul><li>   Japanese support !!   </li></ul><ul><li>    The user interface is intuitive and easy to know </li></ul><ul><li>   Playback   </li></ul><ul><li>   Playing back application content from packet </li></ul><ul><li>   Sniffer , Ethereal trace file compatibility </li></ul>
  17. 17. 10/100/Gigabit Portable PC version <ul><li>The traffic on duplex gigabit ethernet will be separated into ChA/ChB to analyze. </li></ul><ul><li>Real time application flow analysis (Ladder view) can be used </li></ul><ul><li>10 nsec time stamp resolution </li></ul>
  18. 18. 10/100M Full Duplex Laptop Version <ul><li>Bidirectional traffic on 10/100M full duplex ethernet will be separated when flowing over TAP with 2 NIC monitoring simultaneously. </li></ul><ul><li>The bidirectional application traffic which is taken from 2 NICs dividing into ChA/ChB can be integrated to display and analyze. </li></ul><ul><li>ClearSight individual real time application flow analysis (ladder view) can be used </li></ul>
  19. 19. ClearSight Analyzer Series 10Gb Analyzer ■ Full wire-rate capture   2GB capture capacity is available at full wire rate by using analyzer exclusive onboard memory for NIC. ■ Filter Trigger   The onboard filter trigger can be used in wire-rate environment. The trigger can be defined as Mac address, IP address or Pattern match. ■ Statistic   Number of frames, number of bytes, various environment error data, VLAN and other statistics are offered. ■ The powerful ClearSight analysis function   You can analyze captured data with ClearSight Analyzer.   ClearSight individual Ladder view, Application playback and Triple-play analysis functions can be used. New
  20. 20. ClearSight Network Time Machine Series Rack-mounted Version ○ ○ × Capture Filter ○ ○ × Slicing Up to 9.9 TB - - Expandability Image RAID 50 RAID 0 RAID 0 HDD Sstructure 3.3 TB ( packet storage ) 300 GB ( meta data * storage ) 1.5 TB ( OS and packet storage 、 meta data * storage ) 0.7 TB ( OS and packet storage 、 meta data * storage ) HDD Capacity Analysis Function OS Memory CPU Product Name Post analysis/Real-time analysis Post analysis/Real-time analysis Post analysis Windows Server 2003 Windows Server 2003 Windows Server 2003 4 GB RAM 4 GB RAM 4 GB RAM Dual 3.0 GHz Xeon Dual 3.0 GHz Xeon Single 3.0 GHz Xeon Premium(CSR-4431) Standard(CSR-4430) Economy(CSR-4420)
  21. 21. ClearSight Network Time Machine Series Portable Version New ○ Capture Filter ○ Slicing 42.7cm(W) x 29.1cm(H) x 11.2cm(D) 、 8.8Kg   ( with tote case ) Size/Weight RAID 0 HDD Structure ・ 10/100/1000Base-T ×2 ・ SFP connector (multi mode / single mode ) ×2 Monitor port ・ Capture capacity : 370GB ・ OS/Statistic capacity : 100GB HDD Capacity Analysis Function OS Memory CPU Product Name Post analysis / Real time analysis Microsoft Windows XP Professional SP2 4 GB RAM Dual-Core AMD Opteron™ Processor 2.2GHz Network Time Machine Portable (CSR-4530HR)
  22. 22. VoIP Audio Quality Evaluation
  23. 23. VoIP Ladder View ・ Ladder View Screen
  24. 24. Major cause audio quality decreased ・ Packet loss ・ Out of sequence ・ Jitter ・ Delay and so on Audio quality evaluation method ・ R -Value ( Max : 93.2 ) ・ MOS ( Max : 5 ) Audio Quality Measurement
  25. 25. Statistics ・ RTP Statistic Screen
  26. 26. Alert ・ RTP related threshold ・ Alarm Indication
  27. 27. Call Log Browser <ul><li>Report Item </li></ul><ul><ul><li>Call Status </li></ul></ul><ul><ul><li>Number of Calls </li></ul></ul><ul><ul><li>Call Duration </li></ul></ul><ul><ul><li>MOS Summary </li></ul></ul><ul><ul><li>MOS Distribution </li></ul></ul><ul><ul><li>R-Value Distribution </li></ul></ul>・ Call Information
  28. 28. Report (Quality Report) ・ Audio Quality Report for each Call
  29. 29. Report (History Report) ・ History Report ・ MOS Summary History Report
  30. 30. Audio Playback ・ ClearSight support Codecs
  31. 31. Video Quality Evaluation
  32. 32. Video Data <ul><li>・ TV Meeting </li></ul><ul><li>・ IPTV </li></ul><ul><li>  - IP Broadcast Service </li></ul><ul><li>  - VOD Service </li></ul>・ Internet TV and so on
  33. 33. ・ Packet loss -RTP - IPv6 fragment packet ・ Out of sequence ・ Jitter ・ Delay Video Quality Measurement
  34. 34. Video Quality Measurement Statistics ・ Statisitics  
  35. 35. Video Quality Measurement Methods <ul><li>R-value and MOS are for Audio, what is for Video…? </li></ul><ul><li>MDI ( Media Delivery Index ) </li></ul><ul><li>  - Stipulated by RFC4445 </li></ul><ul><li>VQFactor </li></ul><ul><li>  - ClearSight specific factor </li></ul>
  36. 36. MDI ( Media Delivery Index ) <ul><li>DF ( Delay Factor ) buffer estimation </li></ul><ul><li>DF ( per unit time ) =( max ( X ) -min ( X )) / Media rate X=byte media rate=byte/second </li></ul><ul><li>MLR ( Media Loss Rate ) </li></ul><ul><li>MLR ( per unit time ) = ( packet loss + out of sequence ) / elapse time </li></ul>
  37. 37. VQFactor The VQFactor , whose highest value is 5 , considers the following causes of quality deterioration. ・ Bandwidth ( Depend on Codec ) E.g. H.263   Low : 20kbps High : 192kbps H.264   Low : 20kbps High : 768kbps MPEG4 Low : 28 kbps High : 1024kbps MPEG2   Low : 1Mbps High : 12Mbps ・ Packet loss ・ Network delay ・ Jitter
  38. 38. Technology Comparison Low High Accuracy ( consideration ) N Y Video MOS Value N Y Codec reference Y Y Packet loss reference Y Y Passive Video Quality MDI VQ-Factor
  39. 39. Video Quality Measurement VQFactor and MDI Statistics   ・ Statistics
  40. 40. MPEG Statistics <ul><li>MPEG Statistics </li></ul><ul><ul><li>3 -type frames </li></ul></ul><ul><ul><ul><li>I- frame – Image the whole screen is included </li></ul></ul></ul><ul><ul><ul><li>P– frame – It is estimated from the last I frame or the P frame </li></ul></ul></ul><ul><ul><ul><li>B– frame – It is estimated from the last and the next I frame or the P frame </li></ul></ul></ul>
  41. 41. MPEG Stats I-Frame Stat P-Frame Stat B-Frame Stat
  42. 42. Video Codec <ul><li>Codecs </li></ul><ul><ul><li>To encode and decode video steam </li></ul></ul><ul><ul><li>Individual stream bandwidth is decided by the using codec </li></ul></ul><ul><ul><li>Sensitivity of Jitter and Packet loss is decided by the codec </li></ul></ul>
  43. 43. Video Codec <ul><li>ClearSight playback supports codecs : </li></ul><ul><ul><li>H.264 (Baseline, Main, Extend) </li></ul></ul><ul><ul><li>MPEG2-TS </li></ul></ul><ul><ul><li>MPEG2 layer II </li></ul></ul><ul><ul><li>MPEG4 </li></ul></ul><ul><ul><li>iLBC (internet Low Bit Rate Codec) </li></ul></ul><ul><ul><li>JPEG (411, 422, 111) </li></ul></ul><ul><ul><li>H.263 (Mode A Mode B) </li></ul></ul><ul><ul><li>ASF (Windows Media Advanced System format) </li></ul></ul>
  44. 44. Video Quality Alarm <ul><li>Alarm </li></ul><ul><ul><li>Several deterioration causes can be set </li></ul></ul><ul><ul><ul><li>RTP packet loss </li></ul></ul></ul><ul><ul><ul><li>IPv6 fragment loss </li></ul></ul></ul><ul><ul><ul><li>Out of sequence </li></ul></ul></ul><ul><ul><ul><li>Jitter </li></ul></ul></ul><ul><ul><ul><li>VQFactor </li></ul></ul></ul><ul><ul><ul><li>MD I and so on </li></ul></ul></ul>・ Alarm threshold setting ・ Alarm Screen
  45. 45. Video Quality Report <ul><li>Video Quality Report </li></ul><ul><ul><li>IPTV video steam report can be editted just like VoIP quality report. </li></ul></ul><ul><ul><li>The report is useful although faults classification is specified </li></ul></ul>・ Jitter Report ・ VQFactor Report
  46. 46. Move connecting point
  47. 47. Demo Environment
  48. 48. Delay Generating Device Summary <ul><li>■   Features </li></ul><ul><li>* Even in the emulate environment (64byte 100%), it can ensure full wire rate capture. </li></ul><ul><li>* Delay can be set by 1 bit ( 0.1ns @ 10Gbps ) </li></ul><ul><li>* Usually we support delay from 250ms to 1s, and additional delay can be optional. </li></ul><ul><li>* Support various error types (Bit Error, Packet Loss, Fluctuation (Jitter), Order Replacement, Data Rewriting, LOS, Link Down and so on) </li></ul><ul><li>■ Application </li></ul><ul><li>* Network device efficiency and function evaluation </li></ul><ul><li>* Video transport quality verification (IPTV and streaming) </li></ul><ul><li>* Quality verification for VoIP delay, fluctuation and packet loss. </li></ul>
  49. 49. ANUE circuit fault device ( Packet loss, Delay ) SIP Server 192.168.6.1 Demo Environment Client 192.168.7.2 Telephone 111 Client 192.168.7.3 Telephone 222 ClearSight Analyzer HUB HUB ClearSight Measurement
  50. 50. Video quality problem solving steps <ul><li>The normal standard VQFactor measured such as measuring result in lab environment </li></ul><ul><li>Measuring VQFactor at user’s place </li></ul><ul><li>Jitter, Packet loss, Delay verification </li></ul><ul><ul><li>It can separate network data other than above </li></ul></ul><ul><li>Problem Reason Investigation </li></ul><ul><ul><li>Network </li></ul></ul><ul><ul><li>Video </li></ul></ul><ul><ul><li>Receive device </li></ul></ul>ClearSight Best Solution
  51. 51. Thank You!

×