My presentation slides at 2013 IEEE iCAST & UMEDIA conference.

1. Computer Communications Laboratory
Adaptive Surveillance System
using HTTP Streaming
Duc V.Nguyen, Hung T.Le, Anh T.Pham,
Truong Cong Thang
The University of Aizu

2. Computer Communications Laboratory
OUTLINE
 Motivation
 HTTP Adaptive Streaming
 General architecture
 Resource Allocation Problem
 Problem formulation
 Solution
 Experiments and Results
 Conclusions and future works
10/30/2013 Duc V.Nguyen 2

3. Computer Communications Laboratory
MOTIVATION
 Requirements of today’s Home Surveillance System
 High level of automation
 Deals with a large number of cameras
 Operates on limited communication bandwidth
 New technologies
 Intelligent camera
 Dynamic Adaptive Streaming over HTTP (DASH)
 Goal
Developing a Home Surveillance System that satisfy the
above requirements by taking advantages of smart camera
and DASH
10/30/2013 Duc V.Nguyen 3

4. Computer Communications Laboratory
HTTP ADAPTIVE STREAMING
 Decision Engine is located at client side
 Dynamic adaptation to bandwidth fluctuation
 Cost-effective deployment and high scalability
10/30/2013 Duc V.Nguyen 4
Quality
Timeseg #3seg #2seg #1
High
Medium
Low
Video content at HTTP server
Divided into
small segments
Encoded into
multiple versions
Internet
Time
Available Bandwidth
Timeseg #3seg #2seg #1
Playout of video at the client

5. Computer Communications Laboratory
General architecture
10/30/2013 Duc V.Nguyen 5

6. Computer Communications Laboratory
10/30/2013 Duc V.Nguyen 6

7. Computer Communications Laboratory
END-TO-END DELAY AND GOP
 End-to-end delay De2e in HTTP live streaming [1]
De2e = 4 ∗ Dseg + Dnet
where
Dseg: segment duration
Dnet: network delay
 Group of Picture (GOP)
 starts with an I-frame that contains the entire image
following by a sequence of B-frames and/or P-frames.
 GOPs as video segments
10/30/2013 Duc V.Nguyen 7

8. Computer Communications Laboratory
RESOURCE ALLOCATION PROBLEM
10/30/2013 Duc V.Nguyen 8
(R11, D11)
(R12, D12)
R11 < R12
D11 < D12
w1
w2
Rc Dc
At a given time, under a throughput constraint Rc , delay constraint Dc
max OU = wi ∗ U(Oij)M
i=1
s.t.
Rij ≤ RcM
i=1
Dij ≤ Dc for all i,j.
Formulation
Which video versions
should be requested
from which cameras ?
Utility of a video stream

9. Computer Communications Laboratory
UTILITY MODEL OF A VIDEO STREAM
10/30/2013 Duc V.Nguyen 9
Perceptual quality – bitrate
Initial delay – GOP size
𝐔 𝐎𝐢𝐣 = 𝐚 𝟏 ∗ 𝐔 𝐪 𝐎𝐢𝐣 + 𝐚 𝟐 ∗ 𝐔 𝐝 𝐎𝐢𝐣
Proposed model
delay – MOS
mapping[2]
Tradeoff
between
throughput and
delay

10. Computer Communications Laboratory
SOLUTION
 Home network
• Full-search procedure
 Large scale network (e.g. smart city networks)
• Lagrangian multiplier
• Integer programing
• Dynamic programing
10/30/2013 Duc V.Nguyen 10

11. Computer Communications Laboratory
EXPERIMENT SETTINGS
 4 camera sensors.
 Video content
 5 GOP sizes: 1, 2, 4, 8 and 16
 16 bitrate levels: 64Kbps – 2048Kbps, step size: 128 Kbps
 Frame rate: 30fps
 Resolution: 177 x 144
 Utility model parameters
 a1 = 0.8; a2 = 0.2
 Delay constraint: Dc
= 3𝑠𝑒𝑐
10/30/2013 Duc V.Nguyen 11

12. Computer Communications Laboratory
OVERALL UTILITY
10/30/2013 Duc V.Nguyen 12

13. Computer Communications Laboratory
CONTEXT-AWARENESS BEHAVIOR
10/30/2013 Duc V.Nguyen 13

14. Computer Communications Laboratory
CONCLUSIONS AND FUTURE WORKS
 Conclusions
 Studied the use of HTTP streaming in home surveillance
system
 Proposed a novel utility model for a video stream that
combines perceptual quality with initial delay.
 Formulated and resolved the resource allocation problem
in multi-camera surveillance system.
 Make it possible for the client to dynamically adapt to
changes in surveillance context
 Future works
 Extends the problem to large scale networks
 Framework for bandwidth sharing among connections
10/30/2013 Duc V.Nguyen 14

15. Computer Communications Laboratory
REFERENCES
[1] Lohmar, T.; Einarsson, T.; Frojdh, P.; Gabin, F.;
Kampmann, M., "Dynamic adaptive HTTP streaming of
live content," World of Wireless, Mobile and
Multimedia Networks (WoWMoM), 2011 IEEE
International Symposium on a , vol., no., pp.1,8, 20-24
June 2011
[2] R. Kooij, K. Ahmed, K. Brunnstrom, “Perceived
quality of channel zapping”, in Fifth IAESTED Intern
Conference on Communication Systems and Networks,
Aug. 2006.
10/30/2013 Duc V.Nguyen 15

16. Computer Communications Laboratory
Thank you for your attention
Any questions, comments ?
10/23/2013 16Duc V.Nguyen