Multimedia Framework
Maemo Summit Berlin 2008
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

MMFs Delivery
●
MM APIs: GStreamer, Helix, OpenMAX, ...
●
Codecs on ARM and DSP
●
PulseAudio
●
A few UIs for settings
●
Accessory detection
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

Usage
●
existing
– Media Player
– VoIP/Video Call and Skype
●
new
– Metadata
– Media Capture
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

GStreamer
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

MMF Challenges
●
Hardware acceleration for codecs
●
Reuse for new hardware
●
Multimedia Policy & Routing
●
Stable & coherent middleware
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

Past Architecture
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

Issues & Problems
●
Audio on DSP Video on ARM
– Not so good for power-management
– Not enough processing power on arm side for video
●
Combined decoder sinks / encoder sources
– dspmp3sink, dspilbcsrc
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

New Architecture
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

OMAP 3430
●
500 MHz
●
Can be up to 3 times faster
●
http://www.ti.com/omap3430
140
120
100
80
omap 2
60
omap 3
40
20
0
MPEG4 h264
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

New Software I
●
OpenMAX
– Used for codecs
– No more dsp sinks and sources
●
PulseAudio
– Audio routing & policy
– Audio pre- & postprocessing
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

New Software II
●
gst-qa-system : insanity
– Improved testing
●
Camera-bin
– High level api for still-image and video capture
– GStreamer plugin
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

Developer Support
●
TI DSP Bridge, OpenMAX, DSP examples
●
https://omapzoom.org/gf/
●
BeagleBoard wiki
●
http://elinux.org/BeagleBoard
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

Demos
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras

Thank you!
Questions?
Multimedia Framework / Maemo SW 19.Sep.2008
Maemo Summit Berlin Dr. Stefan Kost, Luc Pionchon, Felipe Contreras