SlideShare a Scribd company logo
Early Lessons from Building Sensor.Network:
An Open Data Exchange for the Web of Things
Vipul Gupta, Poorna Udupi, Arshan Poursohi
{vipul.x.gupta, poorna.udupi, arshan.poursohi}@oracle.com




                      First International Workshop on the Web of Things (WoT 2010), PerCom 2010
                                                                                                  1
Overview

• The Internet is now the Internet of Things ...




                            data storage




                                                   2
Overview

• The Internet is now the Internet of Things ...




                            data analysis




                                                   2
Overview

• The Internet is now the Internet of Things ...




                              insights




                                                   2
Overview

• The Internet is now the Internet of Things ...




                                actions




                                                   2
Overview

• The Internet is now the Internet of Things ...




       Sensor.Network: an open data-exchange for the Web of Things
                                                                     2
Motivation

• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
  Warren Wilson College, USGS, Vodafone


• Common set of issues:
  - Data collection
  - Sharing
  - Privacy
  - Search
  - Collaborative analysis
  - Notifications




• Bring social networking technologies (e.g. tags, annotations, fine-grained
  access control, web-hooks) to this problem space
                                                                              3
Motivation

• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
  Warren Wilson College, USGS, Vodafone


• Common set of issues:
  - Data collection
  - Sharing
  - Privacy
  - Search
  - Collaborative analysis
  - Notifications




• Bring social networking technologies (e.g. tags, annotations, fine-grained
  access control, web-hooks) to this problem space
                                                                              3
Motivation

• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
  Warren Wilson College, USGS, Vodafone


• Common set of issues:
  - Data collection
  - Sharing
  - Privacy
  - Search
  - Collaborative analysis
  - Notifications




• Bring social networking technologies (e.g. tags, annotations, fine-grained
  access control, web-hooks) to this problem space
                                                                              3
Motivation

• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
  Warren Wilson College, USGS, Vodafone


• Common set of issues:
  - Data collection
  - Sharing
  - Privacy
  - Search
  - Collaborative analysis
  - Notifications




• Bring social networking technologies (e.g. tags, annotations, fine-grained
  access control, web-hooks) to this problem space
                                                                              3
Benefits

• Enables investigations into correlations that would otherwise be missed


• Enables easy sharing of data and analytical algorithms


• Enables data-centric collaboration: editing, annotation, discussion


• Frees up domain experts from the chore of setting up and managing an IT
  infrastructure




                                                                            4
Sensor.Network Overview

• Embrace heterogenous
  devices


• Lower barrier to usage


   • Easy, RESTful API


   • Fine-grained access
     control


• General platform for
  specialized applications



                             5
“Datastream” Abstraction

                           • A time-series of sensor values
                             sampled together.


                           • Decouples physical sensor from
                             high-level phenomenon of interest.


                           • A datastream may be fed by
                             different sensors at different times


                           • Has associated metadata and
                             privacy controls




                                                                    6
REST-based API

• Sensor.Network operations may be accessed via a browser or
  programmatically using HTTP operations


• Most operations require authentication--either password or API Key

Datastream creation example:

% curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” –request POST –header “Content-
type: application/xml” –data-binary “@Datastream.xml” “http://sensor.network.com/rest/resources/datastreams/”




<?xml version=”1.0”?>
<datastream>
  <name>My Pothos Plant</name>
  <description>Light and temperature readings from my office plant. </description>
  <tag>light</tag>
  <tag>temperature</tag>
  <value><name>light</name> <type>int</type> <units>lumen</units></value>
  <value><name>temperature</name> <type>float</type> <units>celsius</units> <min>-50.0</min>
<max>50.0</max></value>
</datastream>                                                                                                   7
REST-based API (more examples)

• Data insertion

 % curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” –request POST –header “Content-
 type: application/xml” –data-binary “@Data.xml” “http://sensor.network.com/rest/resources/datastreams/id/data”



                <?xml version=”1.0”?>
                <sampleData>
                  <sensorNodeId>0014.4F01.0000.01AB</sensorNodeId>
                  <timestamp>2009-07-30T13:31:37.459Z</timestamp>
                  <value>700</value>
                  <value>29.4</value>
                </sampleData>



• Data retrieval

 % curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” “http://sensor.network.com/rest/
 resources/datastreams/id/data” –header “Accept: text/plain”



                                                                                                                  8
Security

• Authentication


   • username/password for browser-based access


   • API key for programmatic access


• Authorization uses UNIX-like model based on user classes and access types




• HTTPS for confidentiality


• Target verification to avoid “alert spamming”

                                                                              9
“Task specific” Views (Dashboard)

• At-a-glance information on datastreams -- health, permissions




                                                                  10
“Task specific” Views (Map)

• Identifies geographical location with additional information in tabbed windows




                                                                              11
Visualizations
• LivePlots: Interactive visualizations, embeddable
  in external web pages


• Includes standard visualization types: line plots,
  bar charts, scatter plots


• Support for custom visualizations, e.g. dynamic
  map trace




                                                       12
Visualization (cont’d)

• Investigating


   • “Composite” visualizations


   • Privacy-enhanced visualizations
     (time-delayed, low-fidelity)




                                       13
Event Notifications

                     • Provides “push” functionality


                     • User can receive email, SMS or
                       HTTP Post (webhook) on events of
                       interest


                     • Events need not be data related,
                       e.g. “alert me when someone adds
                       me to a group”


                     • POST to .../notifications creates a
                       subscription request and returns Id


                     • Target verification
                                                        14
Ongoing Work

• Data-centric collaboration:
  - richer, privacy-aware visualizations,
  - visual annotation and editing


• Integration of statistical packages (e.g. R) as pluggable analysis modules


• Expansion of “bi-directional” capabilities:
  - Device management
  - General m2m communication, sleep-proxy (IETF CoRE)


• Sensor.Network as an application platform: third-party access to user data
  (delegated authorization)



                                                                               15
Lessons Learned

• Enable investigations into correlations that would otherwise be missed

      • Support device heterogeneity

      • Open API. Support both PUSH/PULL

• Enable easy sharing of data and analytical algorithms

      • Address privacy concerns

      • Provide tools for data-centric collaboration, sharing

• Lower barrier to usage by domain experts

      • Hide complex IT infrastructure behind a simple API

      • Provide simple abstractions
                                                                           16
Sun SPOT Giveaway

• 2 Sun SPOT kits (see http://www.sunspotworld.com) available


• Email a short (less than 2 pages) proposal to
  sensor.network@sun.com with the title
  “PerCom Giveaway” before noon Mar 31, 2010


   • Describe your project


   • Why Sun SPOTs would be a good match


   • How you’d share the results (e.g. report,
     open source, post on http://sunspotworld.com/forums)


• What would you do with the kit long term, e.g. rotate among members of a JUG,
  use to teach a class etc.
                                                                                  17
Q&A




      18

More Related Content

Similar to Early Lessons from Building Sensor.Network: An Open Data Exchange for the Web of Things

Dist sniffing & scanning project
Dist sniffing & scanning projectDist sniffing & scanning project
Dist sniffing & scanning project
Rishu Seth
 
Building the Web of Things with Sun SPOTs
Building the Web of Things with Sun SPOTsBuilding the Web of Things with Sun SPOTs
Building the Web of Things with Sun SPOTs
benaam
 
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
Globus
 
Intro to RDM
Intro to RDMIntro to RDM
Intro to RDM
Sarah Jones
 
Continuum Analytics and Python
Continuum Analytics and PythonContinuum Analytics and Python
Continuum Analytics and Python
Travis Oliphant
 
Lecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdfLecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdf
ahmedibrahimghnnam01
 
Research Data (and Software) Management at Imperial: (Everything you need to ...
Research Data (and Software) Management at Imperial: (Everything you need to ...Research Data (and Software) Management at Imperial: (Everything you need to ...
Research Data (and Software) Management at Imperial: (Everything you need to ...
Sarah Anna Stewart
 
Simplified Research Data Management with the Globus Platform
Simplified Research Data Management with the Globus PlatformSimplified Research Data Management with the Globus Platform
Simplified Research Data Management with the Globus Platform
Globus
 
The Big Data Stack
The Big Data StackThe Big Data Stack
The Big Data StackZubair Nabi
 
DOXLON November 2016 - Data Democratization Using Splunk
DOXLON November 2016 - Data Democratization Using SplunkDOXLON November 2016 - Data Democratization Using Splunk
DOXLON November 2016 - Data Democratization Using Splunk
Outlyer
 
Analytics&IoT
Analytics&IoTAnalytics&IoT
Analytics&IoT
Selvaraj Kesavan
 
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004
Jason Hong
 
Week 1 lecture material cc
Week 1 lecture material ccWeek 1 lecture material cc
Week 1 lecture material cc
Ankit Gupta
 
Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...
David Wallom
 
_Cloud_Computing_Overview.pdf
_Cloud_Computing_Overview.pdf_Cloud_Computing_Overview.pdf
_Cloud_Computing_Overview.pdf
TyStrk
 
Week 1 Lecture_1-5 CC_watermark.pdf
Week 1 Lecture_1-5 CC_watermark.pdfWeek 1 Lecture_1-5 CC_watermark.pdf
Week 1 Lecture_1-5 CC_watermark.pdf
John422973
 
Convergence Best Poster Award
Convergence Best Poster AwardConvergence Best Poster Award
Convergence Best Poster Award
Rethinking Audiovisual Archives
 
Prototype Design of Open Access Institutional Repository
Prototype Design of Open Access Institutional RepositoryPrototype Design of Open Access Institutional Repository
Prototype Design of Open Access Institutional Repository
DMR (Directorate of Mushroom Research), ICAR, GOI
 
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
Mihai Criveti
 
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Grid Protection Alliance
 

Similar to Early Lessons from Building Sensor.Network: An Open Data Exchange for the Web of Things (20)

Dist sniffing & scanning project
Dist sniffing & scanning projectDist sniffing & scanning project
Dist sniffing & scanning project
 
Building the Web of Things with Sun SPOTs
Building the Web of Things with Sun SPOTsBuilding the Web of Things with Sun SPOTs
Building the Web of Things with Sun SPOTs
 
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
Facilitating Collaboration with Globus (GlobusWorld Tour - STFC)
 
Intro to RDM
Intro to RDMIntro to RDM
Intro to RDM
 
Continuum Analytics and Python
Continuum Analytics and PythonContinuum Analytics and Python
Continuum Analytics and Python
 
Lecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdfLecture 1-big data engineering (Introduction).pdf
Lecture 1-big data engineering (Introduction).pdf
 
Research Data (and Software) Management at Imperial: (Everything you need to ...
Research Data (and Software) Management at Imperial: (Everything you need to ...Research Data (and Software) Management at Imperial: (Everything you need to ...
Research Data (and Software) Management at Imperial: (Everything you need to ...
 
Simplified Research Data Management with the Globus Platform
Simplified Research Data Management with the Globus PlatformSimplified Research Data Management with the Globus Platform
Simplified Research Data Management with the Globus Platform
 
The Big Data Stack
The Big Data StackThe Big Data Stack
The Big Data Stack
 
DOXLON November 2016 - Data Democratization Using Splunk
DOXLON November 2016 - Data Democratization Using SplunkDOXLON November 2016 - Data Democratization Using Splunk
DOXLON November 2016 - Data Democratization Using Splunk
 
Analytics&IoT
Analytics&IoTAnalytics&IoT
Analytics&IoT
 
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004
 
Week 1 lecture material cc
Week 1 lecture material ccWeek 1 lecture material cc
Week 1 lecture material cc
 
Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...Utilising Cloud Computing for Research through Infrastructure, Software and D...
Utilising Cloud Computing for Research through Infrastructure, Software and D...
 
_Cloud_Computing_Overview.pdf
_Cloud_Computing_Overview.pdf_Cloud_Computing_Overview.pdf
_Cloud_Computing_Overview.pdf
 
Week 1 Lecture_1-5 CC_watermark.pdf
Week 1 Lecture_1-5 CC_watermark.pdfWeek 1 Lecture_1-5 CC_watermark.pdf
Week 1 Lecture_1-5 CC_watermark.pdf
 
Convergence Best Poster Award
Convergence Best Poster AwardConvergence Best Poster Award
Convergence Best Poster Award
 
Prototype Design of Open Access Institutional Repository
Prototype Design of Open Access Institutional RepositoryPrototype Design of Open Access Institutional Repository
Prototype Design of Open Access Institutional Repository
 
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...
 
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016
 

Recently uploaded

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Jeffrey Haguewood
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
Elena Simperl
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
Product School
 

Recently uploaded (20)

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 
Knowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and backKnowledge engineering: from people to machines and back
Knowledge engineering: from people to machines and back
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdfFIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf
 
How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...How world-class product teams are winning in the AI era by CEO and Founder, P...
How world-class product teams are winning in the AI era by CEO and Founder, P...
 

Early Lessons from Building Sensor.Network: An Open Data Exchange for the Web of Things

  • 1. Early Lessons from Building Sensor.Network: An Open Data Exchange for the Web of Things Vipul Gupta, Poorna Udupi, Arshan Poursohi {vipul.x.gupta, poorna.udupi, arshan.poursohi}@oracle.com First International Workshop on the Web of Things (WoT 2010), PerCom 2010 1
  • 2. Overview • The Internet is now the Internet of Things ... data storage 2
  • 3. Overview • The Internet is now the Internet of Things ... data analysis 2
  • 4. Overview • The Internet is now the Internet of Things ... insights 2
  • 5. Overview • The Internet is now the Internet of Things ... actions 2
  • 6. Overview • The Internet is now the Internet of Things ... Sensor.Network: an open data-exchange for the Web of Things 2
  • 7. Motivation • Interactions with many SPOTs customers - Sun Modular Data Center, MIT, Warren Wilson College, USGS, Vodafone • Common set of issues: - Data collection - Sharing - Privacy - Search - Collaborative analysis - Notifications • Bring social networking technologies (e.g. tags, annotations, fine-grained access control, web-hooks) to this problem space 3
  • 8. Motivation • Interactions with many SPOTs customers - Sun Modular Data Center, MIT, Warren Wilson College, USGS, Vodafone • Common set of issues: - Data collection - Sharing - Privacy - Search - Collaborative analysis - Notifications • Bring social networking technologies (e.g. tags, annotations, fine-grained access control, web-hooks) to this problem space 3
  • 9. Motivation • Interactions with many SPOTs customers - Sun Modular Data Center, MIT, Warren Wilson College, USGS, Vodafone • Common set of issues: - Data collection - Sharing - Privacy - Search - Collaborative analysis - Notifications • Bring social networking technologies (e.g. tags, annotations, fine-grained access control, web-hooks) to this problem space 3
  • 10. Motivation • Interactions with many SPOTs customers - Sun Modular Data Center, MIT, Warren Wilson College, USGS, Vodafone • Common set of issues: - Data collection - Sharing - Privacy - Search - Collaborative analysis - Notifications • Bring social networking technologies (e.g. tags, annotations, fine-grained access control, web-hooks) to this problem space 3
  • 11. Benefits • Enables investigations into correlations that would otherwise be missed • Enables easy sharing of data and analytical algorithms • Enables data-centric collaboration: editing, annotation, discussion • Frees up domain experts from the chore of setting up and managing an IT infrastructure 4
  • 12. Sensor.Network Overview • Embrace heterogenous devices • Lower barrier to usage • Easy, RESTful API • Fine-grained access control • General platform for specialized applications 5
  • 13. “Datastream” Abstraction • A time-series of sensor values sampled together. • Decouples physical sensor from high-level phenomenon of interest. • A datastream may be fed by different sensors at different times • Has associated metadata and privacy controls 6
  • 14. REST-based API • Sensor.Network operations may be accessed via a browser or programmatically using HTTP operations • Most operations require authentication--either password or API Key Datastream creation example: % curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” –request POST –header “Content- type: application/xml” –data-binary “@Datastream.xml” “http://sensor.network.com/rest/resources/datastreams/” <?xml version=”1.0”?> <datastream> <name>My Pothos Plant</name> <description>Light and temperature readings from my office plant. </description> <tag>light</tag> <tag>temperature</tag> <value><name>light</name> <type>int</type> <units>lumen</units></value> <value><name>temperature</name> <type>float</type> <units>celsius</units> <min>-50.0</min> <max>50.0</max></value> </datastream> 7
  • 15. REST-based API (more examples) • Data insertion % curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” –request POST –header “Content- type: application/xml” –data-binary “@Data.xml” “http://sensor.network.com/rest/resources/datastreams/id/data” <?xml version=”1.0”?> <sampleData> <sensorNodeId>0014.4F01.0000.01AB</sensorNodeId> <timestamp>2009-07-30T13:31:37.459Z</timestamp> <value>700</value> <value>29.4</value> </sampleData> • Data retrieval % curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” “http://sensor.network.com/rest/ resources/datastreams/id/data” –header “Accept: text/plain” 8
  • 16. Security • Authentication • username/password for browser-based access • API key for programmatic access • Authorization uses UNIX-like model based on user classes and access types • HTTPS for confidentiality • Target verification to avoid “alert spamming” 9
  • 17. “Task specific” Views (Dashboard) • At-a-glance information on datastreams -- health, permissions 10
  • 18. “Task specific” Views (Map) • Identifies geographical location with additional information in tabbed windows 11
  • 19. Visualizations • LivePlots: Interactive visualizations, embeddable in external web pages • Includes standard visualization types: line plots, bar charts, scatter plots • Support for custom visualizations, e.g. dynamic map trace 12
  • 20. Visualization (cont’d) • Investigating • “Composite” visualizations • Privacy-enhanced visualizations (time-delayed, low-fidelity) 13
  • 21. Event Notifications • Provides “push” functionality • User can receive email, SMS or HTTP Post (webhook) on events of interest • Events need not be data related, e.g. “alert me when someone adds me to a group” • POST to .../notifications creates a subscription request and returns Id • Target verification 14
  • 22. Ongoing Work • Data-centric collaboration: - richer, privacy-aware visualizations, - visual annotation and editing • Integration of statistical packages (e.g. R) as pluggable analysis modules • Expansion of “bi-directional” capabilities: - Device management - General m2m communication, sleep-proxy (IETF CoRE) • Sensor.Network as an application platform: third-party access to user data (delegated authorization) 15
  • 23. Lessons Learned • Enable investigations into correlations that would otherwise be missed • Support device heterogeneity • Open API. Support both PUSH/PULL • Enable easy sharing of data and analytical algorithms • Address privacy concerns • Provide tools for data-centric collaboration, sharing • Lower barrier to usage by domain experts • Hide complex IT infrastructure behind a simple API • Provide simple abstractions 16
  • 24. Sun SPOT Giveaway • 2 Sun SPOT kits (see http://www.sunspotworld.com) available • Email a short (less than 2 pages) proposal to sensor.network@sun.com with the title “PerCom Giveaway” before noon Mar 31, 2010 • Describe your project • Why Sun SPOTs would be a good match • How you’d share the results (e.g. report, open source, post on http://sunspotworld.com/forums) • What would you do with the kit long term, e.g. rotate among members of a JUG, use to teach a class etc. 17
  • 25. Q&A 18