This document discusses 3D video encoding and delivery standards for Android devices. It covers 3D video formats like side-by-side and top-bottom, support in H.264 profiles and HDMI standards, and how to configure the encoder on TI and Qualcomm processors to add 3D signaling information to the encoded video stream. By inserting frame packing and stereo metadata, devices can automatically detect 3D content and display it correctly without user intervention.
Video coding is an essential component of video streaming, digital TV, video chat and many other technologies. This presentation, an invited lecture to the US Patent and Trade Mark Office, describes some of the key developments in the history of video coding.
Many of the components of present-day video codecs were originally developed before 1990. From 1990 onwards, developments in video coding were closely associated with industry standards such as MPEG-2, H.264 and H.265/HEVC.
The presentation covers:
- Basic concepts of video coding
- Fundamental inventions prior to 1990
- Industry standards from 1990 to 2014
- Video coding patents and patent pools.
Subjective quality evaluation of the upcoming HEVC video compression standard Touradj Ebrahimi
Slides of my presentation at SPIE Optics+Photonics 2012 Applications of Digital Image Processing XXXV, San Diego, August 12-16, 2012
Paper available at: http://infoscience.epfl.ch/record/180494
Video coding is an essential component of video streaming, digital TV, video chat and many other technologies. This presentation, an invited lecture to the US Patent and Trade Mark Office, describes some of the key developments in the history of video coding.
Many of the components of present-day video codecs were originally developed before 1990. From 1990 onwards, developments in video coding were closely associated with industry standards such as MPEG-2, H.264 and H.265/HEVC.
The presentation covers:
- Basic concepts of video coding
- Fundamental inventions prior to 1990
- Industry standards from 1990 to 2014
- Video coding patents and patent pools.
Subjective quality evaluation of the upcoming HEVC video compression standard Touradj Ebrahimi
Slides of my presentation at SPIE Optics+Photonics 2012 Applications of Digital Image Processing XXXV, San Diego, August 12-16, 2012
Paper available at: http://infoscience.epfl.ch/record/180494
Excerpts from the HEVC / H265 Hands-on course.
This parts of the course explains how to download the reference code (HM) compile it configure it and analyze the video output
Requiring only half the bitrate of its predecessor, the new standard – HEVC or H.265 – will significantly reduce the need for bandwidth and expensive, limited spectrum. HEVC (H.265) will enable the launch of new video services and in particular ultra HD television (UHDTV).
State-of-the-art video compression techniques – HEVC/H.265 – can reduce the size of raw video by a factor of about 100 without any noticeable reduction in visual quality. With estimates indicating that compressed real-time video accounts for more than 50 percent of current network traffic, and this figure is set to rise to 90 percent within a few years, HEVC/H.265 will be a welcome relief for network operators.
New services, devices and changing viewing patterns are among the factors contributing to the growth in video traffic as people watch more and more traditional TV and video-streaming services on their mobile devices.
Ericsson has been heavily involved in the standardization of HEVC since it began in 2010, and this Ericsson Review article highlights some of the contributions that have led to the compression efficiency offered by HEVC.
.
(A presentation given at Velocity Conference, London 2012)
Mobile Optimization is complicated, and there’s no single silver bullet. Many different bottlenecks take their toll along the way, and while some have a huge impact, others still add up. In this presentation, we’ll take a website and optimize it step by step. In each step we’ll touch on a problem, discuss how to solve it – perhaps in multiple ways – and show the effect of the solution. In the process, we’ll also touch on topics such as measuring mobile performance, differences between browsers, and which pitfalls are common
Excerpts from the HEVC / H265 Hands-on course.
This parts of the course explains how to download the reference code (HM) compile it configure it and analyze the video output
Requiring only half the bitrate of its predecessor, the new standard – HEVC or H.265 – will significantly reduce the need for bandwidth and expensive, limited spectrum. HEVC (H.265) will enable the launch of new video services and in particular ultra HD television (UHDTV).
State-of-the-art video compression techniques – HEVC/H.265 – can reduce the size of raw video by a factor of about 100 without any noticeable reduction in visual quality. With estimates indicating that compressed real-time video accounts for more than 50 percent of current network traffic, and this figure is set to rise to 90 percent within a few years, HEVC/H.265 will be a welcome relief for network operators.
New services, devices and changing viewing patterns are among the factors contributing to the growth in video traffic as people watch more and more traditional TV and video-streaming services on their mobile devices.
Ericsson has been heavily involved in the standardization of HEVC since it began in 2010, and this Ericsson Review article highlights some of the contributions that have led to the compression efficiency offered by HEVC.
.
(A presentation given at Velocity Conference, London 2012)
Mobile Optimization is complicated, and there’s no single silver bullet. Many different bottlenecks take their toll along the way, and while some have a huge impact, others still add up. In this presentation, we’ll take a website and optimize it step by step. In each step we’ll touch on a problem, discuss how to solve it – perhaps in multiple ways – and show the effect of the solution. In the process, we’ll also touch on topics such as measuring mobile performance, differences between browsers, and which pitfalls are common
Unsure of the aspect ratio for your iPhone? Can’t tell a bit rate from a frame rate? At a loss when it comes to lossy and lossless codecs? Don’t worry, we’re here to help.
This quick PPT is meant to educate user on the Decimator by understanding all the techs ins and outs of the system and also some self study video to show you a step by step instruction on how to accomplish some of the many action the decimator can accomplish.
review of factors affecting IoT system selection. for MVP phase and later phases. Computation, price, connectivity, open source support, development SDKs
Autonomous car teleportation architectureYoss Cohen
Suggestion for a generic architecture of teleoperation system (remote control by video) for autonomous cars or drones. such a system requires transport of several video streams in extremely low latency
Slides from "hands on video" course
explains the color model as well as YUV decimation and packing in theory and practice using FFMPEG, FFPROBE and YUV player
Review of video over IP testing tools including: video syntax analyzer, pixel based measurement indexes like PSNR and SSIM and the tools to measure them, IP based video quality testing.
Mobile Computer Vision requires deep SoC-based optimization and extensive amount of development resources. This presentation reviews the challenges of mobile computer vision optimization, the vision for a cross-platform API and the current solution of using FastCV
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™UiPathCommunity
In questo evento online gratuito, organizzato dalla Community Italiana di UiPath, potrai esplorare le nuove funzionalità di Autopilot, il tool che integra l'Intelligenza Artificiale nei processi di sviluppo e utilizzo delle Automazioni.
📕 Vedremo insieme alcuni esempi dell'utilizzo di Autopilot in diversi tool della Suite UiPath:
Autopilot per Studio Web
Autopilot per Studio
Autopilot per Apps
Clipboard AI
GenAI applicata alla Document Understanding
👨🏫👨💻 Speakers:
Stefano Negro, UiPath MVPx3, RPA Tech Lead @ BSP Consultant
Flavio Martinelli, UiPath MVP 2023, Technical Account Manager @UiPath
Andrei Tasca, RPA Solutions Team Lead @NTT Data
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
The Metaverse and AI: how can decision-makers harness the Metaverse for their...Jen Stirrup
The Metaverse is popularized in science fiction, and now it is becoming closer to being a part of our daily lives through the use of social media and shopping companies. How can businesses survive in a world where Artificial Intelligence is becoming the present as well as the future of technology, and how does the Metaverse fit into business strategy when futurist ideas are developing into reality at accelerated rates? How do we do this when our data isn't up to scratch? How can we move towards success with our data so we are set up for the Metaverse when it arrives?
How can you help your company evolve, adapt, and succeed using Artificial Intelligence and the Metaverse to stay ahead of the competition? What are the potential issues, complications, and benefits that these technologies could bring to us and our organizations? In this session, Jen Stirrup will explain how to start thinking about these technologies as an organisation.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
2. Content
Intro to 3D Video
3D Video in H.264
3D Video in HDMI 1.4a
Android 3D Video encoding
TI OMAP4 Configuration
Qualcomm Configuration
2
4. What is 3D Video
3d content is made by showing a separate image (video) to
each eye.
3D Glasses based technologies:
ANAGLYPH
POLARIZATION
ECLIPSE METHOD
3D Glass-free technologies:
GUIDED LIGHT
LENTICULAR SCREEN
PARALLAX BARRIER
This presentation does not discuss the presentation
technologies, ,instead we focus on how to compress and
deliver the video to the screen.
4
6. Legacy 3D Video Delivery
Different devices delivered 3D Video as one video
stream with the two R/L screens merged into one
rectangle:
1. DirectTV uses Side-by-Side layout
2. PlayStation uses Top-Bottom layout
3. Blue-Ray Player FULL-HD Side-by-Side
User should manually set the TV to 3D
and Configure the right packing mode
6
8. 3D Video in HDMI 1.3
Delivery of 3D Video in packing of
1 and 2 was possible in HDMI:
Side-by-Side 3D in HDMI
Top-Bottom 3D in HDMI
Problems
User should manually configure
TV to the correct mode
3D is not viewed as Full-HD. Each eye receives “Half-HD”
Quality.
Duo to Bandwidth constraints no support for 3D-Full-HD 8
9. 3D in HDMI 1.4a and HDMI 2+
In Advance HDMI standards, HDMI include Header fields
which signals the frame packing mode
Example: 3D SBS transmission in HDMI 1.4
9
11. H.264 3D Profiles
Encoding of one stream video slices halved into
R/L screens can be done in ANY H.264 Profile.
Alternative encoding are:
MVC
Stereo-High
11
12. H.264 AVC 3D encoding mode
There are two options for 3D H.264 AVC encoding:
Regular encoding of a single video stream with
two L/R frames packed into one Frame
Codec is unaware that the video is 3D
No signaling information is sent
Informing the Encoder the video is 3D
Encoder will insert Frame-Packing information
TV / Sink should switch automatically to 3D correct frame
packing according to signaled information
12
13. H.264 3D Signaling
H264 Signals 3D Video and the type of Frame
Packing (Side-by-Side, Top-Bottom, Interlaced…)
by Frame Packing Arrangement structure
FPA is an optional message inside the SEI NAL
Frame Packing Agreement structure was added to
the standard in 2010.
A device receiving H.264 stream with SEI-FPA
could automatically change its mode to the correct
3D Mode (if it understands those headers and has
3D capabilities).
13
14. Example of 3D Configuration
There are two types of FPA extensions 2004 & 2010
2004 states the frame arrangement SBS, Top-Bottom etc
2010 is more detailed as described below
14
15. MVC – Multi View Coding
MVC is a standard for compression of multiple
video streams into one encoded streams
All streams are encoded as differences (deltas)
from the first stream (like SVC)
MVC with 2 video streams is 3D stereo
15
17. Wireless 3D Video transmission
Automatic 3D Video
H.264 3D Video
Encoder over HDMI
1.4a
Wireless Dongle
H.264 HDMI
Decoder Converter
H.264 with SEI FPA
over Wireless
17
19. TI 3D Configuration
For all platforms (Nvidia, TI, QCOM), in the Encoder OMX
input pin configuration add the appropriate code according
to the processor
19
22. Thank you!
More About me:
Video Expert
Yossi Cohen
Lectures on Video / Android / VoIP
yossicohen19@gmail.com
Android Native Developer http://www.mobilevideotech.com
+972-545-313092
22
23. Resources
Overview of the Stereo and Multiview Video Coding Extensions of the
H.264/MPEG-4 AVC Standard
http://www.practical-home-theater-guide.com/3d-tv-formats.html
High-Definition Multimedia Interface Specification Version 1.4a Extraction of 3D
Signaling Portion
23