The document describes Sensor.Network, an open data exchange platform for the Internet of Things. It discusses lessons learned from interactions with customers that highlighted common issues like data collection, sharing, and analysis. Sensor.Network aims to address these issues by providing an open API and tools for data-centric collaboration inspired by social networks. These include tags, annotations, access controls, and event notifications. The platform supports heterogeneous devices and data insertion/retrieval through a REST API. It provides views, visualizations, and the ability to integrate statistical analysis packages to enable insights from sensor data.
Hashtag Conversations,Eventgraphs, and User Ego Neighborhoods: Extracting So...Shalin Hai-Jew
This introduces methods for extracting and analyzing social network data from Twitter for hashtag conversations (and emergent events), event graphs, search networks, and user ego neighborhoods (using NodeXL). There will be direct demonstrations and discussions of how to analyze social network graphs. This information may be extended with human- and / or machine-based sentiment analysis.
g-Social - Enhancing e-Science Tools with Social Networking FunctionalityNicholas Loulloudes
Presentation of "g-Social - Enhancing e-Science Tools with Social Networking Functionality" given at the Workshop on Analyzing and Improving Collaborative eScience with Social Networks, Chicago October 8th, 2012. Co-located with IEEE eScience 2012.
Hashtag Conversations,Eventgraphs, and User Ego Neighborhoods: Extracting So...Shalin Hai-Jew
This introduces methods for extracting and analyzing social network data from Twitter for hashtag conversations (and emergent events), event graphs, search networks, and user ego neighborhoods (using NodeXL). There will be direct demonstrations and discussions of how to analyze social network graphs. This information may be extended with human- and / or machine-based sentiment analysis.
g-Social - Enhancing e-Science Tools with Social Networking FunctionalityNicholas Loulloudes
Presentation of "g-Social - Enhancing e-Science Tools with Social Networking Functionality" given at the Workshop on Analyzing and Improving Collaborative eScience with Social Networks, Chicago October 8th, 2012. Co-located with IEEE eScience 2012.
In just a few years, the number of Internet-connected "things" (home appliances, smart energy meters, health monitors, sensors) is predicted to be orders of magnitude larger than the number of users and traditional computers. The Web of Things is a vision where everyday objects are seamlessly integrated into the World Wide Web (WWW) using well-known standards and blueprints (e.g. URIs, HTTP and REST). This hands-on lab (presented at JavaOne 2010) introduces participants to the motivation, key concepts and relevant technologies behind this vision. Lab attendees will use the Sun SPOT wireless device (www.sunspotworld.com) developed at Sun Labs to learn how physical resources (e.g. light sensor, LEDs) can be exposed as web resources and manipulated via HTTP commands.
Additional lab materials may be accessed at http://www.sunspotworld.com/S314730_Sun_SPOTs_Web_Of_Things/index.html.
Research Data (and Software) Management at Imperial: (Everything you need to ...Sarah Anna Stewart
A presentation on research data management tools, workflows and best practices at Imperial College London with a focus on software management. Presented at the 2017 session of the HPC Summer School (Dept. of Computing).
Simplified Research Data Management with the Globus PlatformGlobus
Overview of the Globus research data management platform, as presented at the Fall 2018 Membership Meeting of the Coalition for Networked Information (CNI), held in Washington, D.C., December 10-11, 2018
DOXLON November 2016 - Data Democratization Using SplunkOutlyer
In this session, Neil Roy Chowdhury - Lead Splunk Consultant @ Strft - looks at Splunk to foster collaboration between dev and ops teams in a safe and secure way. We focus on the need for semantic logging and what part data models can play in everyone speaking the same language, not just for dev and ops teams, but for information security and other business areas too.
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004Jason Hong
Some older research I did looking at one way of building privacy-sensitive apps for ubiquitous computing environments. The core idea is to focus on locality, where all of the data is sensed and processed locally as much as possible.
Privacy is the most often-cited criticism of ubiquitous computing, and may be the greatest barrier to its long-term success. However, developers currently have little support in designing software architectures and in creating interactions that are effective in helping end-users manage their privacy. To address this problem, we present Confab, a toolkit for facilitating the development of privacy-sensitive ubiquitous computing applications. The requirements for Confab were gathered through an analysis of privacy needs for both end-users and application developers. Confab provides basic support for building ubiquitous computing applications, providing a framework as well as several customizable privacy mechanisms. Confab also comes with extensions for managing location privacy. Combined, these features allow application developers and end-users to support a spectrum of trust levels and privacy needs.
Authors are Jason Hong and James Landay
Site up an open access-ICAR
Institutional Repository-Hardware, Software, Policies and Personnel.
ICAR Initiatives
Under NATP Project – Integrated National Agricultural Resources Information System INARIS (Rai et. Al., 2007). A Central Data warehouse (CWD) of agricultural resources was established at IASRI
This project having collaborations with 13 other organizations of ICAR.
In this view 13 different data marts were designed.
This Project was available under this link (http://agdw.iasri.res.in)
My outlook Country should have agri-search engine
Agri-Search Engine should be developed in country to aggregate information from the internet and provide it to farmers in meaningful manner through using ICT tools.
Agri-Search Engine be coordinated with Govt. of India’s Agricultural Websites to monitor each website per day.
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...Mihai Criveti
Automate your Data Science pipeline with Ansible, Python and Kubernetes - ODSC Talk
What is Data Science and the Data Science Landscape
Process and Flow
Understanding Data
The Data Science Toolkit
The Big Data Challenge
Cloud Computing Solutions
The rise of DevOps in Data Science
Automate your data pipeline with Ansible
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016Grid Protection Alliance
The exponential increase in data available to analyze power system events is universally recognized, but in many cases the approach to using this data is to do what we already do but do it faster, or get more people to do it. Unfortunately, spinning the hamster wheel faster is not keeping up with the demand to make decisions faster in support of grid modernization. Open source software (OSS) tools offer tremendous opportunity for collaboration that encourages innovation, and the speed and flexibility of development to keep pace with these demands.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
More Related Content
Similar to Early Lessons from Building Sensor.Network: An Open Data Exchange for the Web of Things
In just a few years, the number of Internet-connected "things" (home appliances, smart energy meters, health monitors, sensors) is predicted to be orders of magnitude larger than the number of users and traditional computers. The Web of Things is a vision where everyday objects are seamlessly integrated into the World Wide Web (WWW) using well-known standards and blueprints (e.g. URIs, HTTP and REST). This hands-on lab (presented at JavaOne 2010) introduces participants to the motivation, key concepts and relevant technologies behind this vision. Lab attendees will use the Sun SPOT wireless device (www.sunspotworld.com) developed at Sun Labs to learn how physical resources (e.g. light sensor, LEDs) can be exposed as web resources and manipulated via HTTP commands.
Additional lab materials may be accessed at http://www.sunspotworld.com/S314730_Sun_SPOTs_Web_Of_Things/index.html.
Research Data (and Software) Management at Imperial: (Everything you need to ...Sarah Anna Stewart
A presentation on research data management tools, workflows and best practices at Imperial College London with a focus on software management. Presented at the 2017 session of the HPC Summer School (Dept. of Computing).
Simplified Research Data Management with the Globus PlatformGlobus
Overview of the Globus research data management platform, as presented at the Fall 2018 Membership Meeting of the Coalition for Networked Information (CNI), held in Washington, D.C., December 10-11, 2018
DOXLON November 2016 - Data Democratization Using SplunkOutlyer
In this session, Neil Roy Chowdhury - Lead Splunk Consultant @ Strft - looks at Splunk to foster collaboration between dev and ops teams in a safe and secure way. We focus on the need for semantic logging and what part data models can play in everyone speaking the same language, not just for dev and ops teams, but for information security and other business areas too.
An Architecture for Privacy-Sensitive Ubiquitous Computing at Mobisys 2004Jason Hong
Some older research I did looking at one way of building privacy-sensitive apps for ubiquitous computing environments. The core idea is to focus on locality, where all of the data is sensed and processed locally as much as possible.
Privacy is the most often-cited criticism of ubiquitous computing, and may be the greatest barrier to its long-term success. However, developers currently have little support in designing software architectures and in creating interactions that are effective in helping end-users manage their privacy. To address this problem, we present Confab, a toolkit for facilitating the development of privacy-sensitive ubiquitous computing applications. The requirements for Confab were gathered through an analysis of privacy needs for both end-users and application developers. Confab provides basic support for building ubiquitous computing applications, providing a framework as well as several customizable privacy mechanisms. Confab also comes with extensions for managing location privacy. Combined, these features allow application developers and end-users to support a spectrum of trust levels and privacy needs.
Authors are Jason Hong and James Landay
Site up an open access-ICAR
Institutional Repository-Hardware, Software, Policies and Personnel.
ICAR Initiatives
Under NATP Project – Integrated National Agricultural Resources Information System INARIS (Rai et. Al., 2007). A Central Data warehouse (CWD) of agricultural resources was established at IASRI
This project having collaborations with 13 other organizations of ICAR.
In this view 13 different data marts were designed.
This Project was available under this link (http://agdw.iasri.res.in)
My outlook Country should have agri-search engine
Agri-Search Engine should be developed in country to aggregate information from the internet and provide it to farmers in meaningful manner through using ICT tools.
Agri-Search Engine be coordinated with Govt. of India’s Agricultural Websites to monitor each website per day.
DevOps for Data Engineers - Automate Your Data Science Pipeline with Ansible,...Mihai Criveti
Automate your Data Science pipeline with Ansible, Python and Kubernetes - ODSC Talk
What is Data Science and the Data Science Landscape
Process and Flow
Understanding Data
The Data Science Toolkit
The Big Data Challenge
Cloud Computing Solutions
The rise of DevOps in Data Science
Automate your data pipeline with Ansible
Advanced Automated Analytics Using OSS Tools, GA Tech FDA Conference 2016Grid Protection Alliance
The exponential increase in data available to analyze power system events is universally recognized, but in many cases the approach to using this data is to do what we already do but do it faster, or get more people to do it. Unfortunately, spinning the hamster wheel faster is not keeping up with the demand to make decisions faster in support of grid modernization. Open source software (OSS) tools offer tremendous opportunity for collaboration that encourages innovation, and the speed and flexibility of development to keep pace with these demands.
Similar to Early Lessons from Building Sensor.Network: An Open Data Exchange for the Web of Things (20)
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Generating a custom Ruby SDK for your web service or Rails API using Smithyg2nightmarescribd
Have you ever wanted a Ruby client API to communicate with your web service? Smithy is a protocol-agnostic language for defining services and SDKs. Smithy Ruby is an implementation of Smithy that generates a Ruby SDK using a Smithy model. In this talk, we will explore Smithy and Smithy Ruby to learn how to generate custom feature-rich SDKs that can communicate with any web service, such as a Rails JSON API.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
How world-class product teams are winning in the AI era by CEO and Founder, P...
Early Lessons from Building Sensor.Network: An Open Data Exchange for the Web of Things
1. Early Lessons from Building Sensor.Network:
An Open Data Exchange for the Web of Things
Vipul Gupta, Poorna Udupi, Arshan Poursohi
{vipul.x.gupta, poorna.udupi, arshan.poursohi}@oracle.com
First International Workshop on the Web of Things (WoT 2010), PerCom 2010
1
6. Overview
• The Internet is now the Internet of Things ...
Sensor.Network: an open data-exchange for the Web of Things
2
7. Motivation
• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
Warren Wilson College, USGS, Vodafone
• Common set of issues:
- Data collection
- Sharing
- Privacy
- Search
- Collaborative analysis
- Notifications
• Bring social networking technologies (e.g. tags, annotations, fine-grained
access control, web-hooks) to this problem space
3
8. Motivation
• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
Warren Wilson College, USGS, Vodafone
• Common set of issues:
- Data collection
- Sharing
- Privacy
- Search
- Collaborative analysis
- Notifications
• Bring social networking technologies (e.g. tags, annotations, fine-grained
access control, web-hooks) to this problem space
3
9. Motivation
• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
Warren Wilson College, USGS, Vodafone
• Common set of issues:
- Data collection
- Sharing
- Privacy
- Search
- Collaborative analysis
- Notifications
• Bring social networking technologies (e.g. tags, annotations, fine-grained
access control, web-hooks) to this problem space
3
10. Motivation
• Interactions with many SPOTs customers - Sun Modular Data Center, MIT,
Warren Wilson College, USGS, Vodafone
• Common set of issues:
- Data collection
- Sharing
- Privacy
- Search
- Collaborative analysis
- Notifications
• Bring social networking technologies (e.g. tags, annotations, fine-grained
access control, web-hooks) to this problem space
3
11. Benefits
• Enables investigations into correlations that would otherwise be missed
• Enables easy sharing of data and analytical algorithms
• Enables data-centric collaboration: editing, annotation, discussion
• Frees up domain experts from the chore of setting up and managing an IT
infrastructure
4
12. Sensor.Network Overview
• Embrace heterogenous
devices
• Lower barrier to usage
• Easy, RESTful API
• Fine-grained access
control
• General platform for
specialized applications
5
13. “Datastream” Abstraction
• A time-series of sensor values
sampled together.
• Decouples physical sensor from
high-level phenomenon of interest.
• A datastream may be fed by
different sensors at different times
• Has associated metadata and
privacy controls
6
14. REST-based API
• Sensor.Network operations may be accessed via a browser or
programmatically using HTTP operations
• Most operations require authentication--either password or API Key
Datastream creation example:
% curl –dump-header hdrs.txt –header “X-SensorNetworkAPIKey: apiKey” –request POST –header “Content-
type: application/xml” –data-binary “@Datastream.xml” “http://sensor.network.com/rest/resources/datastreams/”
<?xml version=”1.0”?>
<datastream>
<name>My Pothos Plant</name>
<description>Light and temperature readings from my office plant. </description>
<tag>light</tag>
<tag>temperature</tag>
<value><name>light</name> <type>int</type> <units>lumen</units></value>
<value><name>temperature</name> <type>float</type> <units>celsius</units> <min>-50.0</min>
<max>50.0</max></value>
</datastream> 7
16. Security
• Authentication
• username/password for browser-based access
• API key for programmatic access
• Authorization uses UNIX-like model based on user classes and access types
• HTTPS for confidentiality
• Target verification to avoid “alert spamming”
9
17. “Task specific” Views (Dashboard)
• At-a-glance information on datastreams -- health, permissions
10
18. “Task specific” Views (Map)
• Identifies geographical location with additional information in tabbed windows
11
19. Visualizations
• LivePlots: Interactive visualizations, embeddable
in external web pages
• Includes standard visualization types: line plots,
bar charts, scatter plots
• Support for custom visualizations, e.g. dynamic
map trace
12
21. Event Notifications
• Provides “push” functionality
• User can receive email, SMS or
HTTP Post (webhook) on events of
interest
• Events need not be data related,
e.g. “alert me when someone adds
me to a group”
• POST to .../notifications creates a
subscription request and returns Id
• Target verification
14
22. Ongoing Work
• Data-centric collaboration:
- richer, privacy-aware visualizations,
- visual annotation and editing
• Integration of statistical packages (e.g. R) as pluggable analysis modules
• Expansion of “bi-directional” capabilities:
- Device management
- General m2m communication, sleep-proxy (IETF CoRE)
• Sensor.Network as an application platform: third-party access to user data
(delegated authorization)
15
23. Lessons Learned
• Enable investigations into correlations that would otherwise be missed
• Support device heterogeneity
• Open API. Support both PUSH/PULL
• Enable easy sharing of data and analytical algorithms
• Address privacy concerns
• Provide tools for data-centric collaboration, sharing
• Lower barrier to usage by domain experts
• Hide complex IT infrastructure behind a simple API
• Provide simple abstractions
16
24. Sun SPOT Giveaway
• 2 Sun SPOT kits (see http://www.sunspotworld.com) available
• Email a short (less than 2 pages) proposal to
sensor.network@sun.com with the title
“PerCom Giveaway” before noon Mar 31, 2010
• Describe your project
• Why Sun SPOTs would be a good match
• How you’d share the results (e.g. report,
open source, post on http://sunspotworld.com/forums)
• What would you do with the kit long term, e.g. rotate among members of a JUG,
use to teach a class etc.
17