The document provides an introduction to video compression. It discusses key concepts such as lossy vs lossless compression, encoders, decoders, and codecs. It also covers techniques used in video compression like sampling, quantization, model-based transforms, how the human visual system is used as a model, and color space transforms. Common video compression standards like MPEG are also mentioned. The document is serving as an introductory overview of fundamental video compression concepts and techniques.
This presentation is meant to discuss the basics of video compression like DCT, Color space conversion, Motion Compensation etc. It also discusses the standards like H.264, MPEG2, MPEG4 etc.
Synchronization is The Co-ordination of The Events To Operate A System in Unison .
Systems operating with all their parts in synchrony are said to be synchronous or in sync.
This presentation is meant to discuss the basics of video compression like DCT, Color space conversion, Motion Compensation etc. It also discusses the standards like H.264, MPEG2, MPEG4 etc.
Synchronization is The Co-ordination of The Events To Operate A System in Unison .
Systems operating with all their parts in synchrony are said to be synchronous or in sync.
This presentation explains the Transform coding in easiest method possible. The graphics and diagrammatic representations are worth looking for. Simple language is another pro.
This is the subject slides for the module MMS2401 - Multimedia System and Communication taught in Shepherd College of Media Technology, Affiliated with Purbanchal University.
What is Video Compression?, Introduction of Video Compression. Motivation, Working Methodology of Video Compression., Example, Applications, Needs of Video Compression, Advantages & Disadvantages
Introduction to Digital Videos, Motion Estimation: Principles & Compensation. Learn more in IIT Kharagpur's Image and Video Communication online certificate course.
This presentation explains the Transform coding in easiest method possible. The graphics and diagrammatic representations are worth looking for. Simple language is another pro.
This is the subject slides for the module MMS2401 - Multimedia System and Communication taught in Shepherd College of Media Technology, Affiliated with Purbanchal University.
What is Video Compression?, Introduction of Video Compression. Motivation, Working Methodology of Video Compression., Example, Applications, Needs of Video Compression, Advantages & Disadvantages
Introduction to Digital Videos, Motion Estimation: Principles & Compensation. Learn more in IIT Kharagpur's Image and Video Communication online certificate course.
Color me intrigued: A jaunt through color technology in videoVittorio Giovara
Here are my slides from Demuxed 2017.
This talk aims to shed light on colorspaces - what they are, how and why they work, why we should care about handling edge cases properly. Starting with historical design choices, venturing through current standards such as BT.709, and arriving at modern times with High Dynamic Range, the focus will be on practical applications on the web and in broadcast.
review of factors affecting IoT system selection. for MVP phase and later phases. Computation, price, connectivity, open source support, development SDKs
Autonomous car teleportation architectureYoss Cohen
Suggestion for a generic architecture of teleoperation system (remote control by video) for autonomous cars or drones. such a system requires transport of several video streams in extremely low latency
Slides from "hands on video" course
explains the color model as well as YUV decimation and packing in theory and practice using FFMPEG, FFPROBE and YUV player
Review of video over IP testing tools including: video syntax analyzer, pixel based measurement indexes like PSNR and SSIM and the tools to measure them, IP based video quality testing.
Excerpts from the HEVC / H265 Hands-on course.
This parts of the course explains how to download the reference code (HM) compile it configure it and analyze the video output
Sudheer Mechineni, Head of Application Frameworks, Standard Chartered Bank
Discover how Standard Chartered Bank harnessed the power of Neo4j to transform complex data access challenges into a dynamic, scalable graph database solution. This keynote will cover their journey from initial adoption to deploying a fully automated, enterprise-grade causal cluster, highlighting key strategies for modelling organisational changes and ensuring robust disaster recovery. Learn how these innovations have not only enhanced Standard Chartered Bank’s data infrastructure but also positioned them as pioneers in the banking sector’s adoption of graph technology.
Pushing the limits of ePRTC: 100ns holdover for 100 daysAdtran
At WSTS 2024, Alon Stern explored the topic of parametric holdover and explained how recent research findings can be implemented in real-world PNT networks to achieve 100 nanoseconds of accuracy for up to 100 days.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Climate Impact of Software Testing at Nordic Testing DaysKari Kakkonen
My slides at Nordic Testing Days 6.6.2024
Climate impact / sustainability of software testing discussed on the talk. ICT and testing must carry their part of global responsibility to help with the climat warming. We can minimize the carbon footprint but we can also have a carbon handprint, a positive impact on the climate. Quality characteristics can be added with sustainability, and then measured continuously. Test environments can be used less, and in smaller scale and on demand. Test techniques can be used in optimizing or minimizing number of tests. Test automation can be used to speed up testing.
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfPaige Cruz
Monitoring and observability aren’t traditionally found in software curriculums and many of us cobble this knowledge together from whatever vendor or ecosystem we were first introduced to and whatever is a part of your current company’s observability stack.
While the dev and ops silo continues to crumble….many organizations still relegate monitoring & observability as the purview of ops, infra and SRE teams. This is a mistake - achieving a highly observable system requires collaboration up and down the stack.
I, a former op, would like to extend an invitation to all application developers to join the observability party will share these foundational concepts to build on:
UiPath Test Automation using UiPath Test Suite series, part 5DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 5. In this session, we will cover CI/CD with devops.
Topics covered:
CI/CD with in UiPath
End-to-end overview of CI/CD pipeline with Azure devops
Speaker:
Lyndsey Byblow, Test Suite Sales Engineer @ UiPath, Inc.
Alt. GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using ...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...Neo4j
Leonard Jayamohan, Partner & Generative AI Lead, Deloitte
This keynote will reveal how Deloitte leverages Neo4j’s graph power for groundbreaking digital twin solutions, achieving a staggering 100x performance boost. Discover the essential role knowledge graphs play in successful generative AI implementations. Plus, get an exclusive look at an innovative Neo4j + Generative AI solution Deloitte is developing in-house.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024Neo4j
Neha Bajwa, Vice President of Product Marketing, Neo4j
Join us as we explore breakthrough innovations enabled by interconnected data and AI. Discover firsthand how organizations use relationships in data to uncover contextual insights and solve our most pressing challenges – from optimizing supply chains, detecting fraud, and improving customer experiences to accelerating drug discoveries.
PHP Frameworks: I want to break free (IPC Berlin 2024)Ralf Eggert
In this presentation, we examine the challenges and limitations of relying too heavily on PHP frameworks in web development. We discuss the history of PHP and its frameworks to understand how this dependence has evolved. The focus will be on providing concrete tips and strategies to reduce reliance on these frameworks, based on real-world examples and practical considerations. The goal is to equip developers with the skills and knowledge to create more flexible and future-proof web applications. We'll explore the importance of maintaining autonomy in a rapidly changing tech landscape and how to make informed decisions in PHP development.
This talk is aimed at encouraging a more independent approach to using PHP frameworks, moving towards a more flexible and future-proof approach to PHP development.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
2. Compression
p
• Compression – Representing information by less
bit than the original information
• Lossless Compression – Original information
and compressed information are identical
identical.
example LZ, TAR and other compression
techniques.
techniques
• Lossy Compression – Compressed info is not the
same as uncompressed info E ample MP3
ncompressed info. Example: MP3,
JPEG etc
•LLossy compression is often MODEL B
i i ft Based d
Compression
Fast Forward Your Development www.dsp-ip.com
3. Compression terms
p
• Encoder – Module which compress the
information
• Decoder – Module which decompress the
information
• CODEC – (en)CODer / DEcoder
• Channel – the medium which the information is
passed through for example ADSL line or disk
Channel Decoder
Encoder
Disk
Fast Forward Your Development www.dsp-ip.com
4. Sampling
p g
• Digitization of analog signal
• Voice - Sampling in time only The number of
only.
samples per second is the Frequency – F. in
telephony,
telephony voice sampling frequency is 8KHz to
transfer 4KHz of sound.
•IImage - SSampling in 2D space - F F O thi
li i Fx, Fy. On this
screen the images are sampled 1024x768
• Vid - S
Video Sampling i 2D space and ti
li in D d time – F F
Fx, Fy,
Fn. On TV Fn is 25 or 30 fps (frames per second)
Fast Forward Your Development www.dsp-ip.com
5. Quantization
• Lowering the number of bits needed to describe
an object
object.
• For example I scored 66 in the test an object with
100 steps need 7 description bits
bits.
• How is she looking ? 10 ! Needs only 5 bits for
description.
d i ti
• Could we lower the number of bits more? What
is th
i the minimum?
i i ?
• Quantization is not always linear - ADPCM
Fast Forward Your Development www.dsp-ip.com
7. Model Base Transform - example
• Transforming the information from a
representation of similar importance
to all variables to a representation of
varying importance
• Th “poor sheriff” problem
The “ h iff” bl
▫ The sheriff needs to telegram the
dangers criminal profile t
d i i l fil to
headquarters.
▫ A telegram costs a cent for each
bit.
▫ Sending it bit by bit would finish
the poor sheriff salary.
Fast Forward Your Development www.dsp-ip.com
8. Solution
• The sheriff and headquarters
agree on a b
base that would
h ld
describe images according to a
base known to both sides.
• The transformation base is:
▫ Mouth
▫ Nose
▫ Eyes
▫ Ears
• The values are the sizes of each
item quantized to millimeters
• Mad Max will be transmitted as:
8,14,12,17
8 14 12 17
Fast Forward Your Development www.dsp-ip.com
9. Model Based Compression (Multimedia)
Pre- Model Based Quantize / Entropy
Processing Transform Prioritize Reorder Codingg
Fast Forward Your Development www.dsp-ip.com
10. Human Visual System
• The human eye has two basic light receptors:
▫ Rods – Light Intensity receptors
▫ Cons – Colored light receptors
•
Fast Forward Your Development www.dsp-ip.com
11. The Human Eye
• Rods Concentration >> Cons Concentration
• Green Discrimination << Red, Blue
Red
Discrimination
•LLow Frequency > High Frequency
F Hi h F
Fast Forward Your Development www.dsp-ip.com
12. Model Based transformations
• RGB (3 equally quantized colors) ->
>
• YUV (Light Intensity + two color channels)
• Pi l based d
Pixel b d domain -> F
i > Frequency d domain
i
Fast Forward Your Development www.dsp-ip.com
13. Speech coding
• In speech coding, the vocal tract is used as a
model:
Fast Forward Your Development www.dsp-ip.com
14. Audio / Music Coding
• In general Audio Coding, the ear is used as a
model:
• Frequencies -> Frequency bands
• Masking and Temporal Masking are used
Fast Forward Your Development www.dsp-ip.com
16. What is a digital image?
• Audio PCM
▫ One 1-D array of
sample
• BMP Image
▫ Three 2-D arrays of
2D
numbers
representing Red,
Green and Blue
values
Fast Forward Your Development www.dsp-ip.com
17. Image Compression? Why?
• Image size = 720*580
720 580
• 3 Image Layers RGB =720*580*3
• 8 Bits per pixel 720*580*3*8
720 580 3 8
= 10022400 bits
• L t of bit f one L
Lots f bits for Lena
Fast Forward Your Development www.dsp-ip.com
18. Color matching
• How can we compare
colors so that the
content creators and
consumers know what
kno hat
they are seeing?
•MMany diff
different ways
t
including CIE
chromacity di
h it diagram
Fast Forward Your Development www.dsp-ip.com
19. Video Color Transforms
• Largely derived from older analog methods of coding
color for TV. Luminance is separated from color
TV
information.
• YIQ is used to transmit TV signals in North America and
Japan.This coding also makes its way into VHS video
tape coding in these countries since video tape
technologies also use YIQ.
• In Europe, video tape uses the PAL or SECAM codings,
which are based on TV that uses a matrix transform
hi h b d h i f
called YUV.
• Finally digital video mostly uses a matrix transform
Finally,
called YCbCr that is closely related to YUV
Fast Forward Your Development www.dsp-ip.com
20. YUV Separation
Fast Forward Your Development www.dsp-ip.com
21. YUV Color Model
•YUV codes a luminance signal (for gamma-corrected
signals) equal to Y , the “luma".
•Chrominance refers to the difference between a color
and a reference white at the same luminance. (U and V)
The transform is:
Fast Forward Your Development www.dsp-ip.com
23. YIQ Color Model
YIQ is used in NTSC color TV broadcasting.
broadcasting
Again, gray pixels generate zero (I;Q)
chrominance signal.
g
I and Q are a rotated version of U and V .
The transform is:
Th t f i
Fast Forward Your Development www.dsp-ip.com
24. YCbCr Color Model
1. The Rec. 601 standard for digital video uses
another color space YCbCr which closely
related to the YUV transform.
2. The YCbCr transform is used in JPEG image
compression and MPEG video compression.
For 8-bit coding:
Fast Forward Your Development www.dsp-ip.com
25. Sampling
p g
• Digitization of analog signal
• Voice - Sampling in time only The number of
only.
samples per second is the Frequency – F. in
telephony,
telephony voice sampling frequency is 8KHz to
transfer 4KHz of sound.
•IImage - SSampling in 2D space - F F O thi
li i Fx, Fy. On this
screen the images are sampled 1024x768
• Vid - S
Video Sampling i 2D space and ti
li in D d time – F F
Fx, Fy,
Fn. On TV Fn is 25 or 30 fps (frames per second)
Fast Forward Your Development www.dsp-ip.com
26. Quantization
• Lowering the number of bits needed to describe
an object
object.
• For example I scored 66 in the test an object with
100 steps need 7 description bits
bits.
• How is she looking ? 10 ! Needs only 5 bits for
description.
d i ti
• Could we lower the number of bits more? What
is th
i the minimum?
i i ?
• How to describe an object with one bit?
Fast Forward Your Development www.dsp-ip.com
27. Color based decimation
• Our eyes have better resolution and scaling for
luminance then for color
color.
• Compress color by using 4:2:0 method
Fast Forward Your Development www.dsp-ip.com
28. Counting the bits
• How much can we save by color compression?
▫ 3*Image size in RGB 24 bit color representation
representation.
▫ 1 + 2*1/4 Image size in 4:2:0 YUV representation.
▫ Compression ratio is 2 !!
• Actual saving is bigger due to different Y and UV
quantization.
quantization
Fast Forward Your Development www.dsp-ip.com
29. Linear Transform
• If the signal is formatted as a
g • Energy compaction p p y
gy p property:
vector, a linear transform can The transformed signal vector
be formulated as a matrix- has few, large coefficients and
vector product that transform many nearly zero small
the signal into a different coefficients. These few large
domain. coefficients can be encoded
• Examples: efficiently with few bits while
▫ K-L Transform retaining the majority of
▫ Discrete Fourier Transform energy of the original signal.
▫ Discrete cosine transform
▫ Discrete wavelet transform
Fast Forward Your Development www.dsp-ip.com
30. Block-based Image Coding
• Block-based image
Block based • Advantages:
coding scheme: ▫ Parallel processing can
partitions the entire be applied to p
pp process
image into 8 by 8 or individual blocks in
parallel.
16 by 16 (or other
▫ Redundant information
size) blocks. in close proximity (like
• The coding algorithm cache)
is applied to
individual blocks
independently.
Fast Forward Your Development www.dsp-ip.com
31. Transform - DCT
• The DCT transform the data from pixel intensity
to frequency intensity
intensity.
• Low frequency are important high frequency less
1 7 7 (2m 1)u (2n 1)v
• (You’ll F (u, v) cos even if you don’t remember the
4 get launch
u 0 v 0 16
cos
16
m n 0;
f (m, n) 7 7
IDCT1f
formula above) 1)u (2n 1)v
l b (2m)
8
F (u , v) cos cos 0 m, n 7; m n 0.
u 0 v 0 16 16
Fast Forward Your Development www.dsp-ip.com
33. AC Coefficients
• AC coefficients are first
weighted with a quantization
i h d ih i i 1 2 6 7 15 16 28 29
matrix: 3 5 8 14 17 27 30 43
C(i,j)/q(i,j)
C(i j)/q(i j) = Cq(i j)
(i,j) 4 9 13 18 26 31 42 44
Then quantized. 10 12 19 25 32 41 45 54
• Then they are scanned in a 11 20 24 33 40 46 53 55
zig-zag order into a 1D 21 23 34 39 47 52 56 61
sequence to be subject to AC 22 35 38 48 51 57 60 62
Huffman encoding.
ff di
36 37 49 50 58 59 63 64
• Question: Given a 8 by 8
array,
array how to convert it into a
Zig-Zag scan order
vector according to the zig-
zag scan order? What is the
g
algorithm?
Fast Forward Your Development www.dsp-ip.com
39. JPEG Image Coding Algorithms
Q
Quantization DC
8x8 Matrix DC DPCM Huffman
block
DCT Q
Zig Zag AC
AC Scan Huffman
Code books
JPEG Encoding Process
Fast Forward Your Development www.dsp-ip.com
40. Generalization of JPEG Coding
Transform Entropy
Color,
Color Frequency Quantize Reorder Coding
JPEG Encoding Process
Fast Forward Your Development www.dsp-ip.com
42. Video Coding
• Video coding is often implemented as encoding
a sequence of i
f images.Motion compensation
i i
is used to exploit temporal redundancy between
successive f
i frames.
• Examples: MPEG-I, MPEG-II, MPEG-IV,
H.263, H.263+, H264
• Existing video coding standards are based on
JPEG image compression as well as motion
compensation.
Fast Forward Your Development www.dsp-ip.com
43. Video Coding Standardization
Scope
• Only restrictions on the Bitstream, Syntax, and
Decoder are standardized:
▫ Permits the optimization of encoding
▫ Permits complexity reduction
p y
▫ Provides no guarantees on quality
Fast Forward Your Development www.dsp-ip.com
44. Video Encoding
Buffer control
Current
frame x(t) r Bit stream
+ DCT Q VLC Buffer
Q-1 This is a simplified block
diagram where the
encoding of intra coded
IDCT frames is not shown.
Xp(t): predicted ^ reconstructed residue
r(t):
frame
+
^(t)
x(t): reconstructed
t t d
Motion ^ current frame
x(t) x(t-1) Frame
Estimation &
Compensation Buffer
Motion vectors
Fast Forward Your Development www.dsp-ip.com
45. Video Encoding
Color Frequency
Transform Buffer control
Transform
+ Q Reorder Entropy
Q-1 This is a simplified block
diagram where the
encoding of intra coded
Tf-1 frames is not shown.
Xp(t): predicted ^ reconstructed residue
r(t):
frame
+
^(t)
x(t): reconstructed
t t d
Motion ^ current frame
x(t) x(t-1) Frame
Estimation &
Compensation Buffer
Motion vectors
Fast Forward Your Development www.dsp-ip.com
46. Forward Motion Estimation
1 2 3 4 1 2 4
3
5 6 7 8 5 7 8
6
9 10 11 12 9 11 12
10
0
13 15 16
13 14 15 16 14
Current frame constructed From
different parts of reference frame Reference frame
Fast Forward Your Development www.dsp-ip.com
47. Video sequence : Tennis frame 0, 1
previous frame current frame
50 50
100 100
150 150
200 200
50 100 150 200 250 300 350 50 100 150 200 250 300 350
Fast Forward Your Development www.dsp-ip.com
48. Frame Difference
Frame Difference :frame 0 and 1
Fast Forward Your Development www.dsp-ip.com
49. What is motion estimation?
Motion Vector Field of frame 1
50
0
-50
-100
-150
-200
-250
0 50 100 150 200 250 300 350 400
Fast Forward Your Development www.dsp-ip.com
50. What is motion compensation ?
Motion compensated frame
50
100
150
200
50 100 150 200 250 300 350
Fast Forward Your Development www.dsp-ip.com
51. Motion Compensated Frame Difference
p
Motion Compensated Frame Difference :frame 0 and 1
Frame Difference :frame 0 and 1
Fast Forward Your Development www.dsp-ip.com
52. Frame Types
• Three types of frames:
yp
▫ Intra (I): the frame is coded as if it is an image
▫ Predicted (P): predicted from an I or P frame
▫ Bi-directional (B): forward and backward predicted
from a pair of I or P frames.
• A typical f
i l frame arrangement i is:
I1 B1 B2 P1 B3 B4 P2 B5 B6 I2
• P1, P2 are b h f
both forward-predicted f
d di d from I1. B1, B2 are
interpolated from I1 and P1, B3, B4 are interpolated
from P1, P2, and B5, B6 are interpolated from P2, I2.
• New Coding standards added other frame types: SP,
SI, D
Fast Forward Your Development www.dsp-ip.com
53. Macro-blocks and Blocks
Y(16x16) Cr (8x8)
RGB
Cb (8x8)
16x16x3
Fast Forward Your Development www.dsp-ip.com