The document discusses the design challenges for unmanned vehicular video streaming. It proposes using multiple low-power microprocessors in parallel to achieve high processing speeds while minimizing power consumption. Test results show that combining horizontal and vertical image scanning provides the best video quality. The document also describes the architecture of a low-power camera designed by GenieView for unmanned vehicle applications.

1. The Design Challenges for
Unmanned Vehicular Video Streaming
The Design Challenges for
Unmanned Vehicular Video Streaming
Hong Xuan Qian
GenieView Inc
Reno NV 89503
USA
hong.qian@genie
view.com
Jun Steed Huang
School of
Information
Technology
and Engineering
University of Ottawa
Canada
steedhuang@ujs.edu.
cn
Lin Lin Ma
School of Computer
Science and
Telecommunication
Engineering
Jiangsu University
Zhenjiang 212013
P.R.China
mll.gly@hotmail.co
m
Presented by
Mary Opokua
Ansong
Computer Science
Section
Kumasi Polytechnic.
Ghana
ansongm@yahoo.c
om
2011 IEEE International Conference on Vehicular
Electronics and Safety July 12, 2011,
Beijing, P.R.China

2. Where we from?Where we from?

3. ContentContent
1.1.1.1. INTRODUCTION1.1.1.1. INTRODUCTION
2. LOW POWER FAST SOLUTION2. LOW POWER FAST SOLUTION
3. CAMERA DESIGN ANALYSIS3. CAMERA DESIGN ANALYSIS
4. CONCLUSION & FUTURE WORK4. CONCLUSION & FUTURE WORK

4. 1. INTRODUCTION1. INTRODUCTION
• This paper studies the design challenges for unmanned
vehicular video streaming.
• The major challenge in this area is providing fast image
processing with low latency, under limited space, limited
weight, limited power and limited link bandwidth
constrains. This paper offers the fundamental design
choices and rule of thumb.
• And situational awareness with UXV platforms imposes
some requirements on the video handling sub-system.
• This paper studies the design challenges for unmanned
vehicular video streaming.
• The major challenge in this area is providing fast image
processing with low latency, under limited space, limited
weight, limited power and limited link bandwidth
constrains. This paper offers the fundamental design
choices and rule of thumb.
• And situational awareness with UXV platforms imposes
some requirements on the video handling sub-system.

5. In order to decrease power
consumption ,we adopted
96 small Micro Processors,
as shown in Figure , each
one runs at 96MHz, drain
1mW, total 96mW; however,
the amount of computation
that can be done is almost
equivalent to
96×96=9216MHz single
high speed CPU, which
would otherwise drain
96×96×96= 884736mW
power, by theory!
In order to decrease power
consumption ,we adopted
96 small Micro Processors,
as shown in Figure , each
one runs at 96MHz, drain
1mW, total 96mW; however,
the amount of computation
that can be done is almost
equivalent to
96×96=9216MHz single
high speed CPU, which
would otherwise drain
96×96×96= 884736mW
power, by theory!
2. LOW POWER FAST SOLUTION2. LOW POWER FAST SOLUTION
A. Main Issues of Our
Industry
A. Main Issues of Our
Industry
DLL Power Mgnt JTAG
Memory &
Peripheral IF
AUDIO
USART
16 GPIO
2 Timers
Video IF
Camera
interface
Array
Processor
96 CPU
Sys Memo
ARM 9

6. B. Main Challenge for the Vehicle
• In this chapter, we have done a number of
tests near an intersection where a fatal
accident occurred - a high school girl was
killed by a speeding car, slipped through the
traffic light.
• The following figures show a car-accident-cyclists,
percentage of victims killed in speed crashes by
crash type and percentage of pedestrians killed in
intersection crashes by age.
B. Main Challenge for the Vehicle
• In this chapter, we have done a number of
tests near an intersection where a fatal
accident occurred - a high school girl was
killed by a speeding car, slipped through the
traffic light.
• The following figures show a car-accident-cyclists,
percentage of victims killed in speed crashes by
crash type and percentage of pedestrians killed in
intersection crashes by age.
PROBLEMSPROBLEMS

7. 1) a car-accident-cyclists1) a car-accident-cyclists
WHY THE RESEARCH?WHY THE RESEARCH?

8. 2) percentage of victims killed 3) percentage of pedestrians
in speed crashes by crash type killed in intersection by age
crashes
2) percentage of victims killed 3) percentage of pedestrians
in speed crashes by crash type killed in intersection by age
crashes
WHO GETS KILLED WHEREWHO GETS KILLED WHERE

9. In general, we have something to do to
save life. For that , we have done a number of
tests to make a difference between the
progressive scan and the interlaced scan, the
horizontal interlaced scan and the vertical
interlaced scan.
The following figures show the difference
among horizontal scan, vertical scan and
horizontal-vertical scan,
In general, we have something to do to
save life. For that , we have done a number of
tests to make a difference between the
progressive scan and the interlaced scan, the
horizontal interlaced scan and the vertical
interlaced scan.
The following figures show the difference
among horizontal scan, vertical scan and
horizontal-vertical scan,
FAST IMAGE SOLUTIONFAST IMAGE SOLUTION

10. • horizontal interlaced scan vertical interlaced scan
1 2 3 4
9 10 11 12
5 6 7 8
13 14 15 16
13 5 9 1
14 6 10
117
2
315
16 8 12 4
6 CPU handles 1 block within 2ms, detect the object
48 CPU handles 8 blocks within 16 ms, detect the people
96 CPU handles 16 Blocks within 32 ms, update the frame

11. • Horizontal-Vertical Scan
1 15 2 13
9 7 10 5
3 16 4 14
11 128 6
O E O
OE
E
EO
O E
EO
E O E O
L R
U
D
O-Odd, E-Even, U-Up, D-Down, L-Left, R-Right.

12. ROAD TEST RESULTS
1. Figure 1 is Picture Took with Vehicle Still .
2. Figure 2 is Picture with Vehicle in Motion by
Horizontal Scan.
3. Figure 3 is Picture with Vehicle by Vertical Scan
Moving the Same Way.
4. Figure 4 is Picture with Vehicle by Vertical Scan the
Opposite Way.
5. Figure 5 is Picture with Vehicle by Horizontal-
Vertical Scan.

13. 1) Picture Took with Vehicle Still 2) Picture with Vehicle in Motion by Horizontal Scan
3) Picture with Vehicle by Vertical Scan Moving the Same Way
4) Picture with Vehicle by Vertical Scan the Opposite Way

14. • 5) Picture with Vehicle by Horizontal-Vertical
Scan
From detail comparisons, we can see that the
best picture among the different scan is when
both horizontal and vertical scan is used.

15. 3. FAST CAMERA DESIGN3. FAST CAMERA DESIGN
• GenieView camera detailed structure of the system:
Low Power SRAM
2Mbit*16
CY62138CV25
Audio Codec
TLV320AIC26
FLASH 8Mbit*16
RC28F800C3BD7
J2210 VIDEO
PROCESSOR
NTSC/PAL Converter
TVP 5150AMI
RF Module interface
PWR
JACK
BATTERY
CELL
UART
TL16C55
0DRHB
Audio BUS
Video BUS
USART
Power Supply
12V/5V/3.5V/2.5V/
1.8V/1.2V
RS232/485
Transceiver
MAX3160
Button
Battery
Tamper Ecryption
key Keep NVRAM
M41S787WMX6
USART
12C

16. DESIGN FLEXIBLE ANALYSISDESIGN FLEXIBLE ANALYSIS
• Flexibility is shown below：
• According to the table in the paper, GenieView offers the
lowest power consumption for vehicular application.

17. 4. CONCLUSION4. CONCLUSION
• Due to the green environment pressure, the big,
heavy and power hungry rear, side or front view
cameras are becoming less acceptable.
• The challenges for the on-board cameras is providing
fast image processing with low latency, under limited
space, limited weight, limited power and limited link
bandwidth constrains.
• GenieView offers the lowest power consumption for
vehicular application. And the solution of GenieView
deployed on the field for Unmanned Ford and GM
vehicles was revealed.

18. FUTURE WORKFUTURE WORK
• For future work, combining image recognition
function, on-board cameras should be used to
identify the animals and human-beings
suddenly appear around manned cars to avoid
accident. By using the on-board cameras, we
can save life.