An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013 Best Paper)

651 views

Published on

The Web of Things (WoT) aims to extend the Web into the physical world by promoting the adoption of Web protocols by situated services and smart objects (ambient artifacts). However, real-world ambient artifacts often adopt proprietary and/or non-Web protocols, making them invisible to Web search engines and inaccessible to conventional Web agents. Smart Gateways have been proposed as a way to “Web-enable” proprietary ambient artifacts through intermediary proxy nodes; however, the requisite infrastructure is difficult to deploy at Web scale. To address such challenges, we are developing Ambient Dynamix (Dynamix): a plug-and-play context framework for mobile devices, which enables Web agents to interoperate with non-Web ambient artifacts – directly from the browser. In this paper, we describe how Dynamix can be used to transform the user’s device into an ad-hoc Smart Gateway in-situ, enabling Web applications (in the device’s browser) to seamlessly interact with non-Web ambient artifacts in the physical environment. We describe an operational prototype implementation, which enables Web apps to discover and control nearby UPnP and AirPlay media devices uniformly. We also present a performance evaluation that indicates the prototype imposes low processing and memory overhead, and is suitable for deployment on many commodity mobile devices.

0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
651
On SlideShare
0
From Embeds
0
Number of Embeds
183
Actions
Shares
0
Downloads
0
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013 Best Paper)

  1. 1. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) An Ad-hoc Smart Gateway Platform for the Web of Things Darren Carlson1 , Bashar Altakrouri2 and Andreas Schrader2 1 Felicitous Computing Institute / National University of Singapore 2 Ambient Computing Group / University of Luebeck This presentation includes graphics from the Crystal Project, which is released under the LGPL license.
  2. 2. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Motivation 1/2 Local Link Communications Locked Web Proxy Web-proxied Devices Locked Web Proxy Dual-mode Devices Wireless Sensors INTERNET WLAN, PAN Networked Media Devices Sensor/Actor Networks Non-Web Non-Web, Prop. I/OProp. I/O Prop. I/O, Web locked Web locked
  3. 3. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Motivation 2/2 DLNA Projector Local Media Server CDNs Router Internet Local link Streaming Servers Nexus 7 Browser-based Web App Media Center Laptop Web Browser Apple TV
  4. 4. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Context-awareness Challenges 4 Social Proximity and Networks Advanced Context Sensing and Actuations User Activity Unproxied Sensor Networks Biotelemetry Data Indoor Positioning Others… Ad-hoc Interactions External Sensors Sensor Fusion Browser-based Web Apps Can’t see the Internet of Things IoT
  5. 5. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Introducing Ambient Dynamix 5 Dynamix adapts the user’s device to the environment using plug-ins Dynamix provides simple means for apps to request context support Dynamix is a plug-and-play context framework that helps applications sense and adapt to the user’s continuously evolving situation and requirements Community-based approach with 3rd party API support Plug-ins are provisioned to the device at runtime (network or file system) Includes a scalable infrastructure for sharing plug-ins Domain experts create context plug-ins
  6. 6. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Ambient Dynamix Overview (1/2) 6 Context domain expertise is packaged into plug-ins Plug-ins are dynamically provisioned at runtime A Dynamix app requests context support
  7. 7. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Ambient Dynamix Overview (2/2) 77 Browser-based Apps Dynamix WebDynamix Web Web Server Dynamix Plug-in Repository Plug-ins HTML, CSS, JavaScript Dynamix Web Extension Browser Based! Context-aware Web apps
  8. 8. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Example Dynamix Plug-ins Context Plug-in Power-aware Location, NFC, Beacon, Orientation, and Photodetector Plug-ins ArtNet Plug-in (ad-hoc discovery/control of DMX automation equipment) Acoustic Fingerprint Plug-in (Native Code Integration) Speech Recognition Plug-in Sound Pressure Level Plug-in (Ambient Sound Detector) Sleep State Plug-in (Zeo Mobile) Heart-rate Biotelemetry Plug-in (Zephyr Sensors) OpenSocial Profile Data with Sensor-network Monitoring Plug-in (SmartAssist) Barcode Scanner Plug-in (ZXing port) Ambient Media Device Discovery and Control (UPnP & AirPlay) Weight and BMI Measurement Plug-in (Supports Withings Wireless Scales) Pedometer with Step Force Plug-in 8 Many more plug-ins in development!Many more plug-ins in development!
  9. 9. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Dynamix Device Towards an Ad-hoc Smart Gateway Platform 1/2 9 Ambient Media Plug-in Unified Interface (RTSP-based) Addressing: DHCP/IPv4LL Discovery: SSDP Description: XML Control: XML/SOAP Addressing: DHCP/IPv4LL Discovery: mDNS/DNS-SD Description: DNS SRV, TXT, PTR Control: REST Service Protocol Domain 1 Service Protocol Domain 2 Runtime Installation Web app Support Ad-hoc Protocol Gateway
  10. 10. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Towards an Ad-hoc Smart Gateway Platform 2/2 10 UPnP Device AirPlay Device Device (AirPlay): 97069172aa702ca8f0 9ba68715cfcb90f Device (AirPlay): 97069172aa702ca8f0 9ba68715cfcb90f Play URI: http://test.com/image.jpg Target Device (AirPlay): 97069172aa702ca8f09ba68715cfcb90f Play URI: http://test.com/image.jpg Target Device (AirPlay): 97069172aa702ca8f09ba68715cfcb90f Device (UPnP): a4a4960f401821f31c0 6813ba3d09b78 Device (UPnP): a4a4960f401821f31c0 6813ba3d09b78 Request Routing 97069172aa702ca8f09ba687 15cfcb90f Protocol-specific Request Handling Unified Interface Media Playback Future Work: Split Protocol Support into Multiple Plug-ins
  11. 11. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Enhanced Share to Screen Web Application 11 Dynamix Framework Background Service UPnP & Airplay Devices Facebook Servers App Server Plug-in Repository Web Content and Image Content Web Content and Dynamix JavaScript Dynamix Plug-ins: Ambient Media and ArtNet Tapping Dims the Lights & Displays Media on the Selected Media Device ArtNet Light System
  12. 12. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Demo Scenario and Testbed 12 Demo Scenario and Testbed
  13. 13. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Evaluation 1/3 13 CPU Performance During Dynamix Binding, Plug-in Installation and Plug-in Initialization
  14. 14. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Evaluation 2/3 14 Heap Performance During Dynamix Binding, Plug-in Installation and Plug-in Initialization
  15. 15. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Evaluation 3/3 15 Overview of OSGi Memory Usage Before and After Plug-in Installation and Initialization Steady-state Performance (CPU & Heap)
  16. 16. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) Join Us! 16 Plug-in Development App Development Framework Development Native Apps Web Apps • Inter Plug-in Communications • Mobile Security • Client Interface • Advanced Topics (Ambient Web)
  17. 17. Institut für Beispielsysteme | Forschungsgruppe Systembeispiele Dr.-Ing. Darren Carlson | Senior Research Fellow | Felicitous Computing Institute An Ad-hoc Smart Gateway Platform for the Web of Things (IEEE iThings 2013) 17 Thank You! Q&A

×