Media Streams in IOT
Girls in Technology , powered By @altanai
In collaboration with
Campus Diaries , Workbench Projects & Lean In chapter
Hello!
4 Years in Telecom Industry
1 Year in R&D on Media Codecs ,IOT and Robotics
Inventor of Ramudroid and author of WebRTC Integrator’s Guide.
Frequently write , discuss and contribute to Open source software.
Website : http://altanaitelecom.wordpress.com
You can find me at @altanai
I am Altanai
“
Contents
1. Impact of IOT
2. Timeline
3. Enablers
4. Streaming Multimedia
5. WebRTC
6. Building Home surveillance
7. Ramudroid
8. Bottlenecks for media Streaming
Impact of IOT
Monitoring
Control
Optimization
Automation
It can be part of engineering , manufacturing , field
services , from plants to oil fields , from roadways
and smart cities to utilities
Timeline
Journey and statistics
I T @altanai
RADIO, WIRELESS AND REMOTE CONTROL
Nikola Tesla created a basic design for radio and on November 8,
1898 he patented a wireless radio controlled robot-boat
Source : teslasociety.com
Only 47 years ago , on 29 October 1969 ,the
first message was sent over the ARPANET,
the predecessor of the Internet.
Nov. 26, 1974: Liberty Bank offers ATM demonstrations
In retrospect ATM machines
were one of the first IOT
devices in 1974.
source:http://history.
buffalonews.com/
“1999 , British entrepreneur Kevin Ashton
used the term Internet Of Things, while
working at Auto-ID Labs (originally called
Auto-ID centers, referring to a global network
of objects connected to radio-frequency
identification, or RFID).
Today 2016
Connected Vehicle
Google Self driven cars
Tesla spark Wearable Tech
Watches ( fitbit , apple watch )
Smart Glasses
BLE tags
GPS shoes
Home appliances
Smart TV, fridge , washing
machine , lights , etc
Smart Cities
Power grid
Transporation
ecommerce
2020
installed base of the
Internet of Things (IoT)
by category
50 billionThings
$1.5 billionIndia
$19 trillionRevenue
By 2020
Enablers for IOT
Factors that led to onset of Internet of Things
Rapid Manufacturing
IPV6/ 6LoWPAN
Sensors
Protocols
Connectivity
Processors and Moore's Law
Increased Bandwidth
Growth Factors
fields
Manufacturing
Field force
management
Supply chain
management
Home Automation
Streaming Multimedia
Content in IOT over Open
source Standardized Media
Stack ( WebRTC )
Streaming Event data and Multimedia
With IOT , machinery in plants , industries , motor vehicles,
smart cities have sensors emitting enormous streams of
data in real time.
Media capture devices ( surveillance cameras , scanners ,
readers ) and user agents ( smartphones, watches ,
desktops , appliances , kiosks ) can stream audio /video
data.
next generation of applications will see, hear and understand.
Why is WebRTC suited for handling media
streams in IOT ?
No plugins
No installations
of flash or any
other 3rd party
plugins
Royalty free
codec
VP8 , VP9 , OPUS
MIT , GPL
Rapid Support
Community support and
adoption by major
browsers, native SDKs
Javascript
Support for js is
the key to making
it easily
adoptable by
developers
Integrate with any
signalling method
➜ SIP
➜ XMPP
➜ Socketio
➜ websocket
Media Streaming &
WebRTC
Surveillance
and Security
Asset
Manageme
nt
Machine to
Machine
communication
through MEdia
Streaming
data handling
in IOT
Robotics &
remote
navigation
Wearables
Smart
Cities
Power Grid
MAnageme
nt
connected
Vehicle
Place your screenshot
hereBuild your own Home
Surveillance System on IOT
Setting up the Surveillance Device
Camera Hardware : Raspberry Pi 3 or above + camera module
Communication : Dongle with 3G/4G
Encoder : Webm encoder on Rpi uv4l-webrtc
MQTT Broker
Architecture
WebRTC uv4l
driver
Https webserver
WebRTC
browser
Signalling over
wss
@altanai
http://raspberrypi:
9000/stream/webrtc
VP8/VP9
/Opus
Live Streaming on WebRTC Peer 2 peer
Camera Feed
MQTT
JS MQTT
client
websockets
User Console
WebRTC incoming stream is
accessible in almost all
Operating Systems through
chrome browsers . Exception
iphone.
Ramudroid
Bot to clean roads and outdoors
“
Stages of garbage collection
1. Litter comes between rotating
brushes
2. Litter is picked by brushes
and pushed upwards
3. Brushes push it towards the
tray
WebRTC uv4l
driver
Node Js
webserver
WebRTC
browser
Js modules
WebRTC
Server
Signalling over
ws and wss
Webrtc session
@altanai
http://raspberrypi:
9000/stream/webrtc
VP8/VP9
/Opus
HTTP
REST
mongo
Live Streaming on WebRTC Peer 2 peer
Camera Feed
Logs
Recorded
videos
MCU or TURN
Web Control
Dashboard
Temperature Heat Sat , prec , err checksum
Media codecs
● Licensed codecs like flash by
adobe , H264/H264/MPEG by
MPEGLA cannot be freely
used .
● Open source media stacks
(webrtc ) not supported
everywhere.
● Realtime transcoding is very
taxing .
Bottlenecks for Media streaming in IOT
Proprietary protocols
and standards
● IMAP , ICMP , Parley , SOAP ,
GIOP , Javs RMI , IMAP , LDAP
and many more .
● Telcos use proprietary patented
communication protocol stacks
too
Supporting all mobile
OS and web browsers
● Lot of time and resources are
spend on user interface design
● Support and rendering on multiple
end- user devices .
● NAT and Firewall issues
Any questions?
Acknowledgements and Credits
Presentation design Titles: Raleway , Body copy: Karla
Slide Template and Icons : SlidesCarnival
Images: Freepik, Wikipedia
Figures : marketsandmarkets.com ,
Many of the data used here is based on the market reports and self experience , with the fast pace
of change it may be outdated very soon .
Thanks!
Madame Marie Curie (1867–1934)
You can find me at @altanai &
tara181989@gmail.com
Extras
Number of connected devices worldwide
www.google.com/trends

Media Streams in IOT via WebRTC

  • 1.
    Media Streams inIOT Girls in Technology , powered By @altanai In collaboration with Campus Diaries , Workbench Projects & Lean In chapter
  • 2.
    Hello! 4 Years inTelecom Industry 1 Year in R&D on Media Codecs ,IOT and Robotics Inventor of Ramudroid and author of WebRTC Integrator’s Guide. Frequently write , discuss and contribute to Open source software. Website : http://altanaitelecom.wordpress.com You can find me at @altanai I am Altanai
  • 3.
    “ Contents 1. Impact ofIOT 2. Timeline 3. Enablers 4. Streaming Multimedia 5. WebRTC 6. Building Home surveillance 7. Ramudroid 8. Bottlenecks for media Streaming
  • 4.
    Impact of IOT Monitoring Control Optimization Automation Itcan be part of engineering , manufacturing , field services , from plants to oil fields , from roadways and smart cities to utilities
  • 5.
  • 6.
    RADIO, WIRELESS ANDREMOTE CONTROL Nikola Tesla created a basic design for radio and on November 8, 1898 he patented a wireless radio controlled robot-boat Source : teslasociety.com
  • 7.
    Only 47 yearsago , on 29 October 1969 ,the first message was sent over the ARPANET, the predecessor of the Internet.
  • 8.
    Nov. 26, 1974:Liberty Bank offers ATM demonstrations In retrospect ATM machines were one of the first IOT devices in 1974. source:http://history. buffalonews.com/
  • 9.
    “1999 , Britishentrepreneur Kevin Ashton used the term Internet Of Things, while working at Auto-ID Labs (originally called Auto-ID centers, referring to a global network of objects connected to radio-frequency identification, or RFID).
  • 10.
    Today 2016 Connected Vehicle GoogleSelf driven cars Tesla spark Wearable Tech Watches ( fitbit , apple watch ) Smart Glasses BLE tags GPS shoes Home appliances Smart TV, fridge , washing machine , lights , etc Smart Cities Power grid Transporation ecommerce
  • 11.
    2020 installed base ofthe Internet of Things (IoT) by category
  • 12.
  • 13.
    Enablers for IOT Factorsthat led to onset of Internet of Things
  • 14.
    Rapid Manufacturing IPV6/ 6LoWPAN Sensors Protocols Connectivity Processorsand Moore's Law Increased Bandwidth Growth Factors fields Manufacturing Field force management Supply chain management Home Automation
  • 15.
    Streaming Multimedia Content inIOT over Open source Standardized Media Stack ( WebRTC )
  • 16.
    Streaming Event dataand Multimedia With IOT , machinery in plants , industries , motor vehicles, smart cities have sensors emitting enormous streams of data in real time. Media capture devices ( surveillance cameras , scanners , readers ) and user agents ( smartphones, watches , desktops , appliances , kiosks ) can stream audio /video data. next generation of applications will see, hear and understand.
  • 17.
    Why is WebRTCsuited for handling media streams in IOT ? No plugins No installations of flash or any other 3rd party plugins Royalty free codec VP8 , VP9 , OPUS MIT , GPL Rapid Support Community support and adoption by major browsers, native SDKs Javascript Support for js is the key to making it easily adoptable by developers Integrate with any signalling method ➜ SIP ➜ XMPP ➜ Socketio ➜ websocket
  • 18.
    Media Streaming & WebRTC Surveillance andSecurity Asset Manageme nt Machine to Machine communication through MEdia Streaming data handling in IOT Robotics & remote navigation Wearables Smart Cities Power Grid MAnageme nt connected Vehicle
  • 20.
    Place your screenshot hereBuildyour own Home Surveillance System on IOT
  • 21.
    Setting up theSurveillance Device Camera Hardware : Raspberry Pi 3 or above + camera module Communication : Dongle with 3G/4G Encoder : Webm encoder on Rpi uv4l-webrtc
  • 22.
    MQTT Broker Architecture WebRTC uv4l driver Httpswebserver WebRTC browser Signalling over wss @altanai http://raspberrypi: 9000/stream/webrtc VP8/VP9 /Opus Live Streaming on WebRTC Peer 2 peer Camera Feed MQTT JS MQTT client websockets
  • 23.
    User Console WebRTC incomingstream is accessible in almost all Operating Systems through chrome browsers . Exception iphone.
  • 24.
    Ramudroid Bot to cleanroads and outdoors
  • 25.
  • 26.
    Stages of garbagecollection 1. Litter comes between rotating brushes 2. Litter is picked by brushes and pushed upwards 3. Brushes push it towards the tray
  • 28.
    WebRTC uv4l driver Node Js webserver WebRTC browser Jsmodules WebRTC Server Signalling over ws and wss Webrtc session @altanai http://raspberrypi: 9000/stream/webrtc VP8/VP9 /Opus HTTP REST mongo Live Streaming on WebRTC Peer 2 peer Camera Feed Logs Recorded videos MCU or TURN
  • 29.
    Web Control Dashboard Temperature HeatSat , prec , err checksum
  • 31.
    Media codecs ● Licensedcodecs like flash by adobe , H264/H264/MPEG by MPEGLA cannot be freely used . ● Open source media stacks (webrtc ) not supported everywhere. ● Realtime transcoding is very taxing . Bottlenecks for Media streaming in IOT Proprietary protocols and standards ● IMAP , ICMP , Parley , SOAP , GIOP , Javs RMI , IMAP , LDAP and many more . ● Telcos use proprietary patented communication protocol stacks too Supporting all mobile OS and web browsers ● Lot of time and resources are spend on user interface design ● Support and rendering on multiple end- user devices . ● NAT and Firewall issues
  • 32.
  • 33.
    Acknowledgements and Credits Presentationdesign Titles: Raleway , Body copy: Karla Slide Template and Icons : SlidesCarnival Images: Freepik, Wikipedia Figures : marketsandmarkets.com , Many of the data used here is based on the market reports and self experience , with the fast pace of change it may be outdated very soon .
  • 34.
    Thanks! Madame Marie Curie(1867–1934) You can find me at @altanai & tara181989@gmail.com
  • 35.
  • 36.
    Number of connecteddevices worldwide
  • 37.