Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Real-time video processing at a glance — Yurii Monastyrshin (Looksery, Tech Stage)


Published on

Real-time video processing is an area that requires highly efficient algorithms and optimisations.

Despite some task-specific algorithms there are a common steps in each video-processing framework.

The most critical steps will be described along with the applicable optimizations.

Published in: Technology
  • Be the first to comment

Real-time video processing at a glance — Yurii Monastyrshin (Looksery, Tech Stage)

  1. 1. Real-time video processing Sep 2015
  2. 2. 2 What we do
  3. 3. 3 Realtime HD video processing 30 FPS 33ms per frame 5ms is ~15% of all available time
  4. 4. 4 IOS Hardware accelerated video recorder AVAssetWriter works with CVPixelB glReadPixels will help us! Wait, why there is only 10 FPS… It woks 9 ms at iPhone 5S almost 30% of available time!!!
  5. 5. 5 Direct access to the texture data with some restrictions. HOWTO: 3ms instead of 9ms at iPhone 5S 3 times faster! CVOpenGLESTextureCache
  6. 6. 6 Couple of benchmarks fullHDHDSD16x9 3 ms for HD 6 ms for FullHD
  7. 7. 7
  8. 8. 8 Android There is no TextureCache at the Android, but there is Android Graphic B
  9. 9. 9
  10. 10. 10 glReadPixels Summary for FullHD Fastest glReadPixels iOS: 20.7 ms iPhone 5S Fastest glReadPixelsAndroid: 11.5 ms Samsung S5(Adreno 330) Fastest TextureCache read(iOS): 5.4 ms iPhone 5S Fastest GraphicBuffer read(Android): 8.8 ms Nexus 7(Adreno 320) Slowest glReadPixels: 106 ms Nexus 6(Adreno 420) Biggest difference: 106 vs 9.5 Nexus 6
  11. 11. 11 THANK YOU