Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Multicore ware applications of machine learning for video encoding
Similar to Multicore ware applications of machine learning for video encoding (20)
More from Ganesan Narayanasamy
More from Ganesan Narayanasamy (20)
Recently uploaded
Recently uploaded (20)
Multicore ware applications of machine learning for video encoding
- 1. Video
- 2. Changchun Beijing Taipei Chennai - Started up 8 years ago - 150+ engineers worldwide - 7 locations - 4 Business Units - Video - Imaging - Machine Learning - Compiler Technologies MulticoreWare Champaign St. Louis Saratoga
- 3. Cloud video services and broadcast system operators have a strong preference for open source. Most are using FFMPEG, x264 and x265. • Open source is naturally more robust – Massive adoption means that bugs are identified quickly, reported and tracked publicly – More users, running on more systems with widest variety of conditions – All x265 code changes are public, allowing independent code review • Licensees have the right to create and distribute modified code • Open source enables adopters to trace any bugs • Open Source Development model attracts external contributors, • Cross platform – runs on x86, ARM, POWER • Lower long-term costs Most Leading Video Services Built on Open Source 3
- 4. Open Source model • Faster, higher quality development – Changes are published and peer reviewed – Many contributors worldwide • More robust – x265 is integrated in FFMPEG, Handbrake, VLC – Wider usage than any other HEVC encoder, on every hardware platform with the widest variety of content • Bugs are usually identified within hours – Rigorous daily and weekly regression testing by MulticoreWare 4
- 5. Chosen by leading… • Video Streaming Services • Cloud Media Services Providers • Movie Studios • Post Production Companies • Video Equipment Vendors • Video Software Developers MulticoreWare, Inc. 5
- 6. • Maintain and update your core video processing libraries – Private shared repository with the latest stable builds • Custom build of FFMPEG and all necessary libraries • If needed, custom patches applied and maintained • Tested to your specific requirements on your platforms – Top level expertise at a lower cost than using in-house developers – We support multiple Tier 1 cloud services – Frees your team up to build and deliver new features FFMPEG, x264, x265, VP9 Support 6
- 7. x264 @ 400 kbps 7
- 8. @ 400 kbps 8
- 9. • Commercial AVC and HEVC encoding library • Can run multiple instances of x264 or x265 simultaneously, enabling higher throughput and compute efficiency • Fully and effectively utilize many-core servers – Latest dual Xeon servers have up to 56 cores, 112 threads – Once instance of x265 can’t use more than 20 threads efficiently • Adds advanced analysis and pre-filtering in front of the encoder 9
- 10. Encoders use block-based analysis to do intra and inter prediction (find matching blocks in the same frame or in other frames). Typically, encoders are naïve with respect to the content they are encoding. Typical Video Encoding MulticoreWare, Inc. 10 UHDkit Encode Uncompressed Video Frames HEVC Bitstream
- 11. By performing more sophisticated content analysis we can give the encoder hints, helping it encode more optimally. Analysis Driven Encoding MulticoreWare, Inc. 11 Advanced Analysis Selective Prefiltering UHDkit Encode Uncompressed Video Frames Analysis HEVC Bitstream
- 12. • We developed a ML-based text detection engine, allowing us to optimize video encoding in the areas where text appears. • A “heat map” of the text is provided to the encoder, letting it know where the text is, and whether it has changed from the previous frame. • Sharpen filters can also be used prior to encoding. Machine Learning Text Detection MulticoreWare, Inc. 12 Advanced Analysis Selective Prefiltering UHDkit Encode Uncompressed Video Frames Analysis HEVC Bitstream