Your SlideShare is downloading. ×
  • Like
Slides
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Now you can save presentations on your phone or tablet

Available for both IPhone and Android

Text the download link to your phone

Standard text messaging rates apply
Published

 

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
495
On SlideShare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
8
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • B and e are instance concepts and b_datetime and e_datetimes are actual values.
  • Police indash cam videos posted on YouTube. OCR engine to extract temporal information, generating metadata in SML and semantic annotations based on OWL-time.

Transcript

  • 1.  
  • 2. W3C Video on the Web Workshop 12-13 December 2007, San Jose, California Video on the Semantic Sensor Web Amit Sheth with Cory Henson, Prateek Jain, Josh Pschorr and Terry Rapoch LexisNexis Ohio Eminent Scholar Kno.e.sis Center, Wright State University http:// knoesis.wright.edu
  • 3. Outline
    • Background on the Sensor Web
    • Introducing the Semantic Sensor Web
    • Prototyping the Semantic Sensor Web
  • 4. B ackground on the Sensor Web Sensor Web Enablement
  • 5.
    • Consortium of 330+ companies, government agencies, and academic institutes
    • Open Standards development by consensus process
    • Interoperability Programs provide end-to-end implementation and testing before spec approval
    • Standard encodings , e.g.
      • GeographyML, SensorML , Observations & Measurements , TransducerML , etc.
    • Standard Web Service interfaces, e.g.
      • Web Map Service
      • Web Feature Service
      • Web Coverage Service
      • Catalog Service
      • Sensor Web Enablement Services ( Sensor Observation Service , Sensor Alert Service , Sensor Process Service , etc.)
    OGC Mission To lead in the development, promotion and harmonization of open spatial standards Open Geospatial Consortium http://www.opengeospatial.org/projects/groups/sensorweb
  • 6. Network Services Vast set of users and applications Constellations of heterogeneous sensors Weather Chemical Detectors Biological Detectors Sea State Surveillance Airborne Satellite
    • Distributed self-describing sensors and related services
    • Link sensors to network and network-centric services
    • Common XML encodings, information models, and metadata for sensors and observations
    • Access observation data for value added processing and decision support applications
    • Users on exploitation workstations, web browsers, and mobile devices
    Sensor Web Enablement Sensor Web Enablement http://www.opengeospatial.org/projects/groups/sensorweb
  • 7. GeographyML (GML) Observations & Measurements (O&M) Information Model for Observations and Sensing Sensor and Processing Description Language Multiplexed, Real Time Streaming Protocol Common Model for Geography Systems and Features SensorML (SML) Sam Bacharach, “GML by OGC to AIXM 5 UGM,” OGC, Feb. 27, 2007. SWE Languages and Encodings TransducerML (TML)
  • 8. Access Sensor Description and Data Command and Task Sensor Systems Dispatch Sensor Alerts to registered Users Sam Bacharach, “GML by OGC to AIXM 5 UGM,” OGC, Feb. 27, 2007. SWE Components – Web Services Catalog Service SOS SAS SPS Clients Discover Services, Sensors, Providers, Data Accessible from various types of clients from PDAs and Cell Phones to high end Workstations
  • 9. Introducing the Sem antic Sensor Web
  • 10. Semantic Sensor Web
    • What is the Semantic Sensor Web?
    • Adding semantic annotations to existing standard Sensor Web languages in order to provide semantic descriptions and enhanced access to sensor data
    • This is accomplished with model-references to ontology concepts that provide more expressive concept descriptions
    • By using model-references to link SML annotated sensor data with concepts within an OWL-Time ontology we attain a representation of temporal semantics on sensor data
  • 11. Model Reference
    • XLink
    • Used for describing links between resources in XML documents. 
    • Several  important attributes within XLink include:
      • type : describes the element type of the link (i.e., simple, extended)
      • role : semantic attribute that describes the meaning of resources within the context of a link
      • href : locator attribute that supplies the URI needed to find a remote resource  
    • Other Model Reference Languages
    • SAWSDL : Defines mechanisms to add semantic annotations to WSDL and XML-Schema components ( W3C Recommendation )
    • SA-REST : Defines mechanisms to add semantic annotations to REST-based Web services.
    W3C, XML Linking Language, http://www.w3.org/TR/xlink
  • 12. Model Reference (SensorML) Instant Interval OWL-Time Ontology
  • 13. Semantic Query
    • Semantic Temporal Query
    • Model-references from SML to OWL-Time ontology concepts provides the ability to perform semantic temporal queries
    • Supported semantic query operators include:
      • contains : user-specified interval falls wholly within a sensor reading interval (also called inside )
      • within : sensor reading interval falls wholly within the user-specified interval (inverse of contains or inside )
      • overlaps : user-specified interval overlaps the sensor reading interval
    • Example SPARQL query defining the temporal operator ‘within’
  • 14. Prototyping the Sem antic Sensor Web
  • 15. Storage Query Extraction & Metadata Creation Video Conversion Filtering & OCR SML Annotation Generation Time & Date information SML (Xindice) OWL-Time (Jena) UI SML Interface OWL-Time Interface AVI OWL-Time Annotation Generation Google Maps JSP Architecture Data Collection YouTube Converted Videos
  • 16. Temporal Data Extraction Channel Minimal Suppression 1 8-neighbor median for ‘bad’ pixels 1 Temporal Minimal Suppression 2 Binarization via adaptive threshold 1 Tesseract OCR engine Regular Expression parsing SensorML output
    • https://research.microsoft.com/~xshua/publications/pdf/2002_ISCAS_TimeStampOCR.pdf
    • http://www.informedia.cs.cmu.edu/documents/vocr_ieee98.pdf
  • 17. Prototype Application http:// knoesis.wright.edu/library/demos/ssw/prototype.htm
  • 18. Conclusion
    • Future Work
    • Incorporation of spatial ontology in order to include spatial analytics and query (perhaps with OGC GML Ontology or ontology developed by W3C Geospatial Incubator Group - GeoXG)
    • Thematic query with keyword search through YouTube API and model reference to domain ontology
    • Extension of SPARQL with enhanced spatiotemporal analytics and query
    • Integration of framework with emergent applications, including video on mobile devices running Android OS
    W3C, XML Linking Language, http://www.w3.org/TR/xlink
  • 19.
    • Kno.e.sis project on Semantic Sensor Web: http://knoesis.wright.edu/projects/sensorweb/
    • Open Geospatial Consortium, Sensor Web Enablement WG, http://www.opengeospatial.org/projects/groups/sensorweb
    • W3C, Time Ontology in OWL, http://www.w3.org/TR/owl-time/
    • W3C, Geospatial Incubator Group, http://www.w3.org/2005/Incubator/geo/
    • Amit Sheth et al., SA-REST: Semantically Interoperable and Easier-to-Use Services and Mashups, IEEE Internet Computing, November/December 2007 (Vol.11, No.6) pp.91-94. DOI: http://doi.ieeecomputersociety.org/10.1109/MIC.2007.133
    • W3C, Semantic Annotations for WSDL and XML Schema, http://www.w3.org/TR/sawsdl/
    • W3C, XML Linking Language, http://www.w3.org/TR/xlink/
    • Google Code, Tesseract, http://code.google.com/p/tesseract-ocr /
    References