Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
An Ad-hoc Smart Gateway Platform for
the Web of Things
Darren Carlson1
, Bashar Altakrouri2
and Andreas Schrader2
1
Felicitous Computing Institute / National University of Singapore
2
Ambient Computing Group / University of Luebeck
This presentation includes graphics from the Crystal Project, which is released under the LGPL license.
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Motivation 1/2
Local Link Communications
Locked
Web Proxy
Web-proxied
Devices
Locked
Web Proxy
Dual-mode
Devices
Wireless
Sensors
INTERNET
WLAN, PAN
Networked Media
Devices
Sensor/Actor
Networks
Non-Web Non-Web, Prop. I/OProp. I/O Prop. I/O, Web locked Web locked
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Motivation 2/2
DLNA
Projector
Local Media
Server
CDNs
Router
Internet
Local link
Streaming
Servers
Nexus 7
Browser-based Web App Media Center
Laptop
Web
Browser
Apple
TV
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Context-awareness Challenges
4
Social Proximity
and Networks
Advanced Context Sensing and Actuations
User
Activity
Unproxied
Sensor Networks
Biotelemetry
Data
Indoor
Positioning
Others…
Ad-hoc
Interactions
External
Sensors
Sensor
Fusion
Browser-based Web Apps Can’t see the Internet of Things
IoT
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Introducing Ambient Dynamix
5
Dynamix adapts the
user’s device to the
environment using
plug-ins
Dynamix provides
simple means for
apps to request
context support
Dynamix is a plug-and-play context framework that helps applications sense and adapt to
the user’s continuously evolving situation and requirements
Community-based approach with 3rd
party API support
Plug-ins are provisioned
to the device at runtime
(network or file system)
Includes a scalable
infrastructure for
sharing plug-ins
Domain experts
create context
plug-ins
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Ambient Dynamix Overview (1/2)
6
Context domain expertise is
packaged into plug-ins
Plug-ins are dynamically
provisioned at runtime
A Dynamix app
requests context
support
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Ambient Dynamix Overview (2/2)
77
Browser-based Apps
Dynamix WebDynamix Web
Web Server
Dynamix Plug-in
Repository
Plug-ins
HTML, CSS,
JavaScript
Dynamix Web Extension
Browser
Based!
Context-aware
Web apps
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Example Dynamix Plug-ins
Context Plug-in
Power-aware Location, NFC, Beacon, Orientation, and Photodetector Plug-ins
ArtNet Plug-in (ad-hoc discovery/control of DMX automation equipment)
Acoustic Fingerprint Plug-in (Native Code Integration)
Speech Recognition Plug-in
Sound Pressure Level Plug-in (Ambient Sound Detector)
Sleep State Plug-in (Zeo Mobile)
Heart-rate Biotelemetry Plug-in (Zephyr Sensors)
OpenSocial Profile Data with Sensor-network Monitoring Plug-in (SmartAssist)
Barcode Scanner Plug-in (ZXing port)
Ambient Media Device Discovery and Control (UPnP & AirPlay)
Weight and BMI Measurement Plug-in (Supports Withings Wireless Scales)
Pedometer with Step Force Plug-in 8
Many more plug-ins in development!Many more plug-ins in development!
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Dynamix Device
Towards an Ad-hoc Smart Gateway Platform 1/2
9
Ambient Media
Plug-in
Unified Interface (RTSP-based)
Addressing: DHCP/IPv4LL
Discovery: SSDP
Description: XML
Control: XML/SOAP
Addressing: DHCP/IPv4LL
Discovery: mDNS/DNS-SD
Description: DNS SRV, TXT,
PTR
Control: REST
Service Protocol Domain 1 Service Protocol Domain 2
Runtime Installation
Web app Support
Ad-hoc Protocol
Gateway
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Towards an Ad-hoc Smart Gateway Platform 2/2
10
UPnP
Device
AirPlay
Device
Device (AirPlay):
97069172aa702ca8f0
9ba68715cfcb90f
Device (AirPlay):
97069172aa702ca8f0
9ba68715cfcb90f
Play URI: http://test.com/image.jpg
Target Device (AirPlay):
97069172aa702ca8f09ba68715cfcb90f
Play URI: http://test.com/image.jpg
Target Device (AirPlay):
97069172aa702ca8f09ba68715cfcb90f
Device (UPnP):
a4a4960f401821f31c0
6813ba3d09b78
Device (UPnP):
a4a4960f401821f31c0
6813ba3d09b78
Request Routing
97069172aa702ca8f09ba687
15cfcb90f
Protocol-specific
Request Handling
Unified Interface
Media
Playback
Future Work:
Split Protocol
Support into
Multiple Plug-ins
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Enhanced Share to Screen Web Application
11
Dynamix Framework
Background Service
UPnP & Airplay Devices
Facebook
Servers
App Server
Plug-in
Repository
Web Content and
Image Content
Web Content and
Dynamix JavaScript
Dynamix Plug-ins:
Ambient Media
and ArtNet
Tapping Dims the Lights
& Displays Media on the
Selected Media Device
ArtNet Light System
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Demo Scenario and Testbed
12
Demo Scenario and Testbed
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Evaluation 1/3
13
CPU Performance During Dynamix Binding, Plug-in Installation and Plug-in Initialization
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Evaluation 2/3
14
Heap Performance During Dynamix Binding, Plug-in Installation and Plug-in Initialization
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Evaluation 3/3
15
Overview of OSGi Memory Usage Before and
After Plug-in Installation and Initialization
Steady-state Performance (CPU & Heap)
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
Join Us!
16
Plug-in Development
App Development
Framework Development
Native Apps Web Apps
• Inter Plug-in Communications
• Mobile Security
• Client Interface
• Advanced Topics (Ambient Web)
Institut für Beispielsysteme | Forschungsgruppe Systembeispiele
Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute
An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013)
17
Thank You!
Q&A

An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013 Best Paper)

  • 1.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) An Ad-hoc Smart Gateway Platform for the Web of Things Darren Carlson1 , Bashar Altakrouri2 and Andreas Schrader2 1 Felicitous Computing Institute / National University of Singapore 2 Ambient Computing Group / University of Luebeck This presentation includes graphics from the Crystal Project, which is released under the LGPL license.
  • 2.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Motivation 1/2 Local Link Communications Locked Web Proxy Web-proxied Devices Locked Web Proxy Dual-mode Devices Wireless Sensors INTERNET WLAN, PAN Networked Media Devices Sensor/Actor Networks Non-Web Non-Web, Prop. I/OProp. I/O Prop. I/O, Web locked Web locked
  • 3.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Motivation 2/2 DLNA Projector Local Media Server CDNs Router Internet Local link Streaming Servers Nexus 7 Browser-based Web App Media Center Laptop Web Browser Apple TV
  • 4.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Context-awareness Challenges 4 Social Proximity and Networks Advanced Context Sensing and Actuations User Activity Unproxied Sensor Networks Biotelemetry Data Indoor Positioning Others… Ad-hoc Interactions External Sensors Sensor Fusion Browser-based Web Apps Can’t see the Internet of Things IoT
  • 5.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Introducing Ambient Dynamix 5 Dynamix adapts the user’s device to the environment using plug-ins Dynamix provides simple means for apps to request context support Dynamix is a plug-and-play context framework that helps applications sense and adapt to the user’s continuously evolving situation and requirements Community-based approach with 3rd party API support Plug-ins are provisioned to the device at runtime (network or file system) Includes a scalable infrastructure for sharing plug-ins Domain experts create context plug-ins
  • 6.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Ambient Dynamix Overview (1/2) 6 Context domain expertise is packaged into plug-ins Plug-ins are dynamically provisioned at runtime A Dynamix app requests context support
  • 7.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Ambient Dynamix Overview (2/2) 77 Browser-based Apps Dynamix WebDynamix Web Web Server Dynamix Plug-in Repository Plug-ins HTML, CSS, JavaScript Dynamix Web Extension Browser Based! Context-aware Web apps
  • 8.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Example Dynamix Plug-ins Context Plug-in Power-aware Location, NFC, Beacon, Orientation, and Photodetector Plug-ins ArtNet Plug-in (ad-hoc discovery/control of DMX automation equipment) Acoustic Fingerprint Plug-in (Native Code Integration) Speech Recognition Plug-in Sound Pressure Level Plug-in (Ambient Sound Detector) Sleep State Plug-in (Zeo Mobile) Heart-rate Biotelemetry Plug-in (Zephyr Sensors) OpenSocial Profile Data with Sensor-network Monitoring Plug-in (SmartAssist) Barcode Scanner Plug-in (ZXing port) Ambient Media Device Discovery and Control (UPnP & AirPlay) Weight and BMI Measurement Plug-in (Supports Withings Wireless Scales) Pedometer with Step Force Plug-in 8 Many more plug-ins in development!Many more plug-ins in development!
  • 9.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Dynamix Device Towards an Ad-hoc Smart Gateway Platform 1/2 9 Ambient Media Plug-in Unified Interface (RTSP-based) Addressing: DHCP/IPv4LL Discovery: SSDP Description: XML Control: XML/SOAP Addressing: DHCP/IPv4LL Discovery: mDNS/DNS-SD Description: DNS SRV, TXT, PTR Control: REST Service Protocol Domain 1 Service Protocol Domain 2 Runtime Installation Web app Support Ad-hoc Protocol Gateway
  • 10.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Towards an Ad-hoc Smart Gateway Platform 2/2 10 UPnP Device AirPlay Device Device (AirPlay): 97069172aa702ca8f0 9ba68715cfcb90f Device (AirPlay): 97069172aa702ca8f0 9ba68715cfcb90f Play URI: http://test.com/image.jpg Target Device (AirPlay): 97069172aa702ca8f09ba68715cfcb90f Play URI: http://test.com/image.jpg Target Device (AirPlay): 97069172aa702ca8f09ba68715cfcb90f Device (UPnP): a4a4960f401821f31c0 6813ba3d09b78 Device (UPnP): a4a4960f401821f31c0 6813ba3d09b78 Request Routing 97069172aa702ca8f09ba687 15cfcb90f Protocol-specific Request Handling Unified Interface Media Playback Future Work: Split Protocol Support into Multiple Plug-ins
  • 11.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Enhanced Share to Screen Web Application 11 Dynamix Framework Background Service UPnP & Airplay Devices Facebook Servers App Server Plug-in Repository Web Content and Image Content Web Content and Dynamix JavaScript Dynamix Plug-ins: Ambient Media and ArtNet Tapping Dims the Lights & Displays Media on the Selected Media Device ArtNet Light System
  • 12.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Demo Scenario and Testbed 12 Demo Scenario and Testbed
  • 13.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Evaluation 1/3 13 CPU Performance During Dynamix Binding, Plug-in Installation and Plug-in Initialization
  • 14.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Evaluation 2/3 14 Heap Performance During Dynamix Binding, Plug-in Installation and Plug-in Initialization
  • 15.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Evaluation 3/3 15 Overview of OSGi Memory Usage Before and After Plug-in Installation and Initialization Steady-state Performance (CPU & Heap)
  • 16.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Join Us! 16 Plug-in Development App Development Framework Development Native Apps Web Apps • Inter Plug-in Communications • Mobile Security • Client Interface • Advanced Topics (Ambient Web)
  • 17.
    Institut für Beispielsysteme| Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) 17 Thank You! Q&A