Real-Time Analysis of Streaming Sensor Data

1,624 views

Published on

Demo at SSN2011 Workshop at ISWC2011.

Demo at: http://www.youtube.com/watch?v=_ews4w_eCpg

Published in: Business, Technology
1 Comment
0 Likes
Statistics
Notes
  • Be the first to like this

No Downloads
Views
Total views
1,624
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
17
Comments
1
Likes
0
Embeds 0
No embeds

No notes for slide
  • Web data evolved over time from Static documents -> dynamic user generated content (Web 2.0) -> streaming (real-time) dataSo what is real-time data and what are its properties
  • Properties of streaming sensor data
  • Social media is the dominant source of streaming data now, however in future sensors would …Data needs to be reduced
  • Hence analyzing data in real-time becomes important
  • Define a feature and introduce what do we mean by a feature
  • So when we say Real-Time semantic analysis of streaming sensor data, we mean analyzing huge amount of lower level heterogeneous sensor data using background knowledge to create meaningful features (features that humans understand)
  • Abstraction across the temporal dimension over a single stream vs abstraction across the thematic dimension over multiple, multimodal, heterogenous streams using background knowledge
  • High level architecture
  • To walk through the implementation, lets take a sample questionThe question might look trivial, but it contains 3 important parts
  • Get all sensors using well known location names – Problem to be solveAssociate sensor descriptions to well know locations.
  • Convert the data raw sensor data collected and convert to RDF using W3C’s sensor ontology
  • Highlight the query with 3 boxes to show the temp, wind speed and precipitation streamHighlight the feature results too
  • Talk about the observations and features storage
  • Linked Data explodes
  • Online demo – http://knoesis1.wright.edu/?q=rtfs
  • Real-Time Analysis of Streaming Sensor Data

    1. 1. xWEB DATA evolved over time Real-Time Sensor, 2010’s Social, Multi-media data Dynamic User 2000’s Generated Content 1990’s Static Document and files 2
    2. 2. xProperties of Streaming Data Huge Volume Rapid Continuous Information Overload!! Heterogeneous 3
    3. 3. xSome Statistics “A cross-country flight from New York to Los“Sensors Networksbeenproduce in the last the amount “More on a Boeing 737 plane 10-20 times massive will created Angeles data has generates aof generated -bythan in mediasummarize this data” Solution “Meaningfully in the next few years” three years social all the past 40,000 years” 240 terabytes of data” - GigaOmni Media - Teradata - GigaOmni Media 4
    4. 4. 48th ACM Southeast Conference. ACMSE 2010.Oxford, Mississippi. April 15-17, 2010. Real-Time Analysis of Streaming Sensor Data Harshal Patni, Cory Henson, Michael Cooney, AmitSheth, ThirunarayanKrishnaprasad Ohio Center of Excellence in Knowledge enabled Computing (Kno.e.sis) Wright State University, Dayton, OH Semantic Sensor Web @ Kno.e.sis
    5. 5. xRT feature stream Background Knowledge Rain Storm Blizzard ABSTRACTIONHuge amount of Features representingRaw Sensor Data Real-World events 7
    6. 6. x Types of Abstractions Summarization across Thematic DimensionSummarization over the Temporal Dimension 8
    7. 7. xTypes of Abstractions Summarization across Thematic Dimension Select Join Background Knowledge Analyze Features representing Real-World Events 9
    8. 8. System Architecture x 10
    9. 9. An example problem? x “Find the sequence of weather events observed near Dayton James Cox Airport between Jan 13th and Jan 18th?” Thematic Spatial Temporal Technologies required - 1. Linked Sensor Data 2. Feature Streams 11
    10. 10. Sensor Discovery Application Weather Station ID Current Observations from MesoWest Weather Station Coordinates Weather Station Phenomena MesoWest – Project under Department of Meteorology, University of UTAH GeoNames – Geographic dataset Sensors near Dayton James Cox Airport 12
    11. 11. Linked Sensor Data OGC MesoWest Observation and Virtuoso RDF RDF Instance Service Data Measurement store (O&M) O&M2RDFCONVERTER 13
    12. 12. Summarizing Linked Sensor Data Extract Data for the sensor? Find the sensor around Dayton James Cox Airport? procedure location Observation location Location KB Sensor KB KB (Geonames) procedure location 720F Thermometer Dayton Airport • ~2 billion triples • 20,000+ systems • 230,000+ locations • MesoWest • MesoWest •Geonames •Static + Dynamic • ~Static • ~Static
    13. 13. xFeature Composition 15
    14. 14. xSystem Capability 16
    15. 15. xSystem Feature Integration SELECT JOIN 17
    16. 16. Feature x Definition• Rain Storm NOAA definition RainStorm = HighWindSpeed(above 35mph) AND Rain Precipitation AND SPARQL query for Temperature(greater than 32F) RainStorm Temperature Rain Precipitation WindSpeed 18
    17. 17. FeaturexAnalysis RDF Feature Stream 19
    18. 18. Summarizing Feature Streams Feature Streams KB Find sequence of events near Dayton Airport? procedure Observation location Location KB Sensor KB KB (Geonames) procedure location 720F Thermometer Dayton Airport • ~2 billion triples • 20,000+ systems • 230,000+ locations • MesoWest • MesoWest •Geonames •Static + Dynamic • ~Static • ~Static
    19. 19. x Answering the query“Find the sequence of weather events observed near Dayton James Cox Airport between Jan 13th and Jan 18th?” Linked Sensor Data Feature Streams 21
    20. 20. x Demoon-line video: http://www.youtube.com/watch?v=_ews4w_eCpg 22
    21. 21. Related Publications WORKSHOP PAPERS • Harshal Patni, Satya S. Sahoo, Cory Henson, Amit Sheth, Provenance Aware Linked Sensor Data, 2nd Workshop on Trust and Privacy on Social and Semantic Web,Co-Located with ESWC, Heraklion Greece, May 30th - June 3rd 2010 • Harshal Patni, Cory Henson, Amit Sheth, Linked Sensor Data, In: Proceedings of 2010 International Symposium on Collaborative Technologies and Systems (CTS 2010), Chicago, IL, May 17-21, 2010 TECHNICAL REPORT • Harshal Patni, Cory Henson, Amit Sheth, and Pramod Ananthram. From Real Time Sensor Streams to Real Time Feature Streams, Kno.e.sis Center Technical Report, December 2009 • Joshua Pschorr, Cory Henson, Harshal Patni, and Amit Sheth. Sensor Discovery on Linked Data, Kno.e.sis Center Technical Report, December 2009 JOURNAL PAPER (In Progress) • Semantic Sensor Web: Design and Application towards weaving a meaningful sensor web 23
    22. 22. Semantic Sensor Web 24
    23. 23. QUESTIONS Demos, Papers and more at: http://semantic-sensor-web.com Semantic Sensor Web @ Kno.e.sis 25

    ×