2. Multimedia Embedded System
Application as 3D
game, video, audio, animation, text, image are
prevailing in people’s daily life due to affordable
multimedia Embedded devices.
3. Aspects that customers value
Power consumption(How long the power can sustain)
Performance(How fast an application can run)
Quality of Service(quality of image, audio, frame)
Volume(If it’s portable enough)
Life time(How long a device can be used)
Cost(Even though consumer electronics is far more
cheap today, people are still eager to do price match)
4. Aspects that designers value
Power consumption(How to minimize dynamic and
static power consumption)
Performance(If processor resources are fully used)
Quality of Service(Make improvement to meet real
time constrain)
Volume(Minimize hardware size as memory，Which
results in limited design area budget)
Life time(How to minimize transistor degradation
effect)
Cost(How to make hardware component efficient to
reduce redundant design)
5. Design flow for ES
Concept
HW
Component
Specification
HW/SW partition
HW
Implementation
Synthesize
Product
SW
Component
Verification
SW
Implementation
6. Increase productivity
Productivity means vitality for any company that design
embedded system, especially for multimedia embedded
system which is so involved in people’s life,and facing fierce
competition.
With different type of processor, memory ,communication
architecture, etc,the complexity of a system is increasing.
Therefore efficient method need to be adopted to increase
productivity to save cost and design period.
CAD!
7. Simulation environment
PeaCE
• Transaction Level Model(TLM)
• Synchronous dataflow graph (SDF)
• Fractional rate dataflow (FRDF) and Synchronous
piggybacked dataflow (SPDF) model
Ha, Soonhoi, et al. "PeaCE: A hardware-software codesign environment for multimedia embedded
systems." ACM Transactions on Design Automation of Electronic Systems (TODAES) 12.3 (2007): 24.
9. Scheduling
Hard real-time scheduling：Tasks need to be accomplished
before deadline!
•
•
•
•
•
Pfair class algorithm
earliest deadline first (EDF)
least laxity first(LLF)
Latest Deadline First (LDF)
Distance Based Priority(DBP)
algorithm
Wu, Tong, and Shiyao Jin. "Weakly hard real-time scheduling algorithm for multimedia embedded system on
multiprocessor platform." Ubi-Media Computing, 2008 First IEEE International Conference on. IEEE, 2008.
10. Scheduling(continue)
Soft real-time scheduling：Certain amount of deadline can be
missed.
Hua, Shaoxiong, Gang Qu, and Shuvra S. Bhattacharyya. "Probabilistic design of multimedia embedded
systems." ACM Transactions on Embedded Computing Systems (TECS) 6.3 (2007): 15.
11. Memory
Dynamic data type(DDT)
implementation
Chanllenges
• Extend iterator-based DDTs profiling library to profile at runtime
• Genetic Algorithm to lauch a subject oriented optimization
On chip communication
• Network on chip
File system
• FAT file system
• LFS
• MNFS
Kim, Hyojun, Youjip Won, and Sooyong Kang. "Embedded NAND flash file system for mobile multimedia devices."
Consumer Electronics, IEEE Transactions on 55.2 (2009): 545-552.
David Atienza, Christos Baloukas, Lazaros Papadopoulos, Christophe Poucet,Stylianos Mamagkakis, Jose I.
Hidalgo, Francky Catthoor, Dimitrios Soudris and Juan Lanchares, “Optimization of Dynamic Data Structures in
Multimedia Embedded Systems Using Evolutionary Computation”
12. Other challenges
•
•
•
•
Saving power by reducing unnecessary power consumption
Computer architecture(RISC or CISC or neigher?)
Minimize static power(leakage power)
Environmental issue(tens of Gt CO2)
Leakage
CISC
ADD M(R1) R2 M(R3)
RISC
LD R4 M(R3)
ADD R5 R2 R4
ST M(R1) R5
Zhang, Jiucai, Song Ci, and Xueyi Wang. "Battery energy consumption footprint of embedded multimedia systems." Green
Computing Conference, 2010 International. IEEE, 2010.
Donohoo, Brad, et al. "Exploiting spatiotemporal and device contexts for energy-efficient mobile embedded systems."
Proceedings of the 49th Annual Design Automation Conference. ACM, 2012
