NUBOMEDIA is an elastic PaaS cloud platform that aims to simplify the development of interactive multimedia applications. It provides a rich toolbox of elements for multimedia, computer vision, augmented reality and other capabilities that can be connected by developers to create applications without needing extensive technical expertise. The platform is open source and its architecture includes development APIs, a client framework, and a server platform to deploy and scale applications in the cloud.
Powerpoint exploring the locations used in television show Time Clash
NUBOMEDIA: an elastic Platform as a Service (PaaS) cloud for interactive social multimedia
1. An elastic Platform as a Service (PaaS)
cloud for interactive social multimedia
http://www.nubomedia.eu
FP7-ICT-2013-1.6, GA-610576 – http://www.nubomedia.eu
2. Problem statement: interactive
multimedia development is hard
Wow, I’ve got an innovative
idea for an interactive media
app. Can I develop it?
No way. It’s too complex.
I don’t have the required
time and resources.
FP7-ICT-2013-1.6, GA-610576 – http://www.nubomedia.eu
3. With NUBOMEDIA developing is just a
Lego game
Sink
SRC
SRC
PointerDetectorFilter
SRC
MirrorFilter
Sink
Sink
WebRTC full
duplex client
video applica on
SRC
Sink
WebRtcEndpoint
FaceOverlayFilter
SRC
Sink
ChromaFilter
Sink
Hey, with NUBOMEDIA
I can create applications
just connecting
pieces of a toolbox
Media Pipeline
It’s simpler and faster.
I don’t need to understand
the low level details.
FP7-ICT-2013-1.6, GA-610576 – http://www.nubomedia.eu
Upload to
Youtube
4. NUBOMEDIA provides a rich toolbox
of innovative capabilities
The toolbox is very rich
and provides elements
implementing latest trends
in multimedia
Group
Communications
Multisensory
Multimedia
IPTVConnector
Mixer
DataChannelEndpoint
Sink
SRC
IPTV
Integration
HttpEndpoint
CdnUpload
SRC
Sink
HeartRateBlender
Sink
SRC
Sink
Sink
FaceDetector
Protocols
& Codecs
FaceOverlay
FP7-ICT-2013-1.6, GA-610576 – http://www.nubomedia.eu
Augmented
Reality
SRC
Sink
RecorderEndpoint
SRC
Sink
BarCodeReader
Computer
Vision
PlayerEndpoint
SRC
Sink
SRC
Sink
ChromaFilter
SRC
Sink
SRC
WebRtcEndpoint
PointerTracker
Sink
Sink
SRC
RtpEndpoint
Media
Repository
5. NUBOMEDIA applications are just
pipelines of toolbox elements
IPTV
Integra on
Mixer
DataChannelEndpoint
SRC$
Sink%
Mul sensory
Mul media
IPTVConnector
I can freely choose the
toolbox elements I connect
to create applications
Group
Communica ons
H pEndpoint
CdnUpload
SRC%
Sink%
HeartRateBlender
Sink%
SRC%
Sink%
Sink%
FaceDetector
Protocols
& Codecs
Computer
Vision
PlayerEndpoint
SRC$
SRC%
Sink%
FaceOverlay
Sink%
RecorderEndpoint
Sink%
SRC%
SRC%
Sink%
ChromaFilter
BarCodeReader
SRC%
Sink%
SRC%
WebRtcEndpoint
PointerTracker
Sink%
Sink%
SRC%
RtpEndpoint
Augmented
Reality
Media
Repository
Choose the elements
you want and connect them
Application 1
Application 3
Sink
Sink
Application 2
Sink
SRC
SRC
Sink
SRC
Sink
SRC
Sink
Sink
SRC
Sink
SRC
Sink
SRC
Sink
Sink
SRC
SRC
Sink
Sink
SRC
Sink
FP7-ICT-2013-1.6, GA-610576 – http://www.nubomedia.eu
6. NUBOMEDIA really shines as a
scalable deployment platform
Powerful idea, I
develop thinking in the small,
but deploy thinking in
the large.
3
NUBOMEDIA
developer portal
Deploy into the NUBOMEDIA cloud
Sink
SRC
Sink
SRC
Sink
Sink
SRC
2
1
Develop your app using a simple API
FP7-ICT-2013-1.6, GA-610576 – http://www.nubomedia.eu
Scale
7. NUBOMEDIA: an end-to-end
architecture
How do the pieces
fit together?
Live interac ve mul media applica ons
NUBOMEDIA
WWW
Developer
Portal
NUBOMEDIA
Development API
(NUBO-DAPI)
NUBOMEDIA
Client Framework
(NUBO-C)
NUBOMEDIA
Development API
(NUBO-DAPI)
NUBOMEDIA
Client Framework
(NUBO-C)
NUBOMEDIA
NUBOMEDIA
Development API
(NUBO-DAPI)
NUBOMEDIA
Client Framework
(NUBO-C)
pla orm
interface
NUBOMEDIA Pla orm API (NUBO-PAPI)
Mobile phone networks
• POTS
• IMS
• Etc.
NUBOMEDIA
LIMaaS Server Pla orm
(NUBO-S)
Augmented
Computer
Reality
Vision
Capabili es Interac ve Capabili es
Media
FP7-ICT-2013-1.6, GA-610576 – http://www.nubomedia.eu Capabili es
Internet infrastructures
• Smart TV
• Social networks
• Etc.
8. NUBOMEDIA is Open Source Software
This looks interesting.
How can I access
NUBOMEDIA technologies?
LGPL
Free as in Freedom
Use NUBOMEDIA freely
Fork NUBOMEDIA freely
Extend NUBOMEDIA freely
Distribute NUBOMEDIA freely
Experiment with NUBOMEDIA freely
Access NUBOMEDIA source code freely
Add your media capabilities to NUBOMEDIA
using the licensing scheme of your preference
FP7-ICT-2013-1.6, GA-610576 – http://www.nubomedia.eu
9. NUBOMEDIA: research challenges
But does NUBOMEDIA
really go beyond current
state-of-the-art?
Research challenges on
media infrastructures.
Research challenges on
media capabilities and APIs
•
•
•
•
•
•
•
•
•
•
•
Multisensory multimedia
Really social group communications
Computer Vision simple integration
Augmented reality integration
5G ready media framework
Structured group communications
Multimedia communication security
Zero documentation APIs
Integrated multiflow synchronization
Visual development of services
Intelligent media mixing
FP7-ICT-2013-1.6, GA-610576 – http://www.nubomedia.eu
•
•
•
•
•
•
•
•
•
•
•
Software defined Networks for QoS
Social topology aware infrastructures
Intelligent cloud placement
Content aware networks
Unlimited group sizes
Seamless IMS integration
Unlimited content storage
Event driven architecture
Self-reconfiguration / management
Plug & play hardware architecture
End-to-end infrastructure
10. NUBOMEDIA: interactive
communications for the long tail
In which application areas
can NUBOMEDIA be
exploited?
Number of users
NUBOMEDIA exploitation plan is targeted to long-tail vertical
markets having special communication requirements
Phone-like
video-conferencing
Services
Phone-like
video-conferencing
APIs
Long tail beyond phone-like
video-conferencing
- e-Health
- Security
- Defense
- Insurance
- e-Learning
FP7-ICT-2013-1.6, GA-610576 – http://www.nubomedia.eu
- Emergencies
- Logistics
- Games
- TV
- etc.
R
11. NUBOMEDIA roadmap
01/2016
•Release of
development
APIs for WWW
and
smartphone
platforms.
•Release of
NUBOMEDIA
developer
portal.
01/2015
•First
operational
version of the
platform
•Connectivity
manager
02/2014
•Project startup
09/2016
•Project closing
•Final reports
09/2014
09/2015
05/2016
•Architecture
•Definition of
advanced
media features
(CVA, AR)
•Stable
operational
version of the
platform
•PaaS manager
•Release of
business
oriented
demonstrators
•Launch of FOSS
community
FP7-ICT-2013-1.6, GA-610576 – http://www.nubomedia.eu