A Framework of Ontology-Based Knowledge Information Processing for Change Detection in Remote Sensing Data Shutaro Hashimo...
Background <ul><li>Needs for automatic image interpretation </li></ul><ul><ul><li>especially change detection </li></ul></...
Solution <ul><li>Emulating manual interpretation using knowledge information processing </li></ul><ul><li>We propose a fra...
Framework for Change Detection July 28, 2011 IGARSS 2011 TH4.T09.2 Day 1 Satellite Data Inference Results Day 2 Auxiliary ...
Requirements for Knowledge Representation July 28, 2011 IGARSS 2011 TH4.T09.2 “ Vegetation  has high NDVI values” “ Roads ...
Remote Sensing Ontology <ul><li>Heavyweight </li></ul><ul><li>ontology in </li></ul><ul><li>remote sensing </li></ul><ul><...
Knowledge Based on Ontology <ul><li>Describing relations among some concepts </li></ul><ul><li>Using Bayesian probability ...
Analysis of Target & Synthesis of Knowledge (2) July 28, 2011 IGARSS 2011 TH4.T09.2 Bayesian Network (1) p/o 0 p/o 1 soil ...
Change Detection July 28, 2011 IGARSS 2011 TH4.T09.2 Soil Layer Image Object Soil Hue Value Saturation NDVI Satellite Imag...
Experiment <ul><li>To validate cognitive ability & versatility </li></ul><ul><li>Applying to three cases of practical chan...
Case 1: Detection of Mudslides in Yamaguchi City, Japan July 28, 2011 IGARSS 2011 TH4.T09.2 Day 1 (14 June, 2009) Day 2 (3...
Case 1: Detection of Mudslides in Yamaguchi City, Japan - Inference Results - July 28, 2011 IGARSS 2011 TH4.T09.2 Day 1 (1...
Case 1: Detection of Mudslides in Yamaguchi City, Japan - Comparison with Human’s Result -  July 28, 2011 IGARSS 2011 TH4....
Case 1: Mudslide Detection in Yamaguchi City, Japan - Comparison with Survey Data -  July 28, 2011 IGARSS 2011 TH4.T09.2 M...
Case 2: Detection of Flooded Areas in Myanmar July 28, 2011 IGARSS 2011 TH4.T09.2 ©JAXA ©JAXA Day 1 (4 May, 2008) Day 2   ...
Case 2: Detection of Flooded Areas in Myanmar - Comparison with Human’s Result -  July 28, 2011 IGARSS 2011 TH4.T09.2 Our ...
Case 3: Detection of Flooded Areas in Pakistan July 28, 2011 IGARSS 2011 TH4.T09.2 ©JAXA ©JAXA Day 1 (14 Oct., 2009) Day 2...
Discussion <ul><li>About 90% accuracy in mudslide detection </li></ul><ul><li>Our results were better than human’s results...
Conclusions <ul><li>We proposed a framework for change detection  </li></ul><ul><ul><li>using ontology-based knowledge to ...
<ul><li>Thank you! </li></ul>July 28, 2011 IGARSS 2011 TH4.T09.2
Probabilistic Inference with Bayesian Network July 28, 2011 IGARSS 2011 TH4.T09.2 Node: random variable Arc: probabilistic...
July 28, 2011 IGARSS 2011 TH4.T09.2
July 28, 2011 IGARSS 2011 TH4.T09.2 0.3 0.4 0.5 0.6
Upcoming SlideShare
Loading in …5
×

A_Framework_of_Ontology-Based_Knowledge_Information_Processing_for_Change_Detection_in_Remote_Sensing_Data.ppt

362 views

Published on

Published in: Education, Technology
  • Be the first to comment

A_Framework_of_Ontology-Based_Knowledge_Information_Processing_for_Change_Detection_in_Remote_Sensing_Data.ppt

  1. 1. A Framework of Ontology-Based Knowledge Information Processing for Change Detection in Remote Sensing Data Shutaro Hashimoto 1 , Takeo Tadono 1,2 , Masahiko Onosato 1 , Masahiro Hori 1,2 , and Takashi Moriyama 1,2 1 Graduate School of Information Science and Technology, Hokkaido University 2 Earth Observation Research Center, Japan Aerospace Exploration Agency July 28, 2011 IGARSS 2011 TH4.T09.2
  2. 2. Background <ul><li>Needs for automatic image interpretation </li></ul><ul><ul><li>especially change detection </li></ul></ul><ul><ul><li>to handle large amount of data </li></ul></ul><ul><li>Humanlike interpretation requires: </li></ul><ul><ul><li>high cognitive ability </li></ul></ul><ul><ul><li>versatility </li></ul></ul>July 28, 2011 IGARSS 2011 TH4.T09.2 Mudslides Floods ?
  3. 3. Solution <ul><li>Emulating manual interpretation using knowledge information processing </li></ul><ul><li>We propose a framework for change detection </li></ul><ul><ul><li>using ontology-based knowledge to recognize and understand targets </li></ul></ul><ul><ul><li>input data: optical multispectral data </li></ul></ul>July 28, 2011 IGARSS 2011 TH4.T09.2 Knowledge Mudslide
  4. 4. Framework for Change Detection July 28, 2011 IGARSS 2011 TH4.T09.2 Day 1 Satellite Data Inference Results Day 2 Auxiliary Data e.g. DSM Bayesian Network Query for Target e.g. “mudslide” Information Extraction Inference Analysis of Target Pixel-Based/ Object-Based Image Analysis Bayesian Inference Evidences Synthesis of Knowledge Knowledge Based on Ontology
  5. 5. Requirements for Knowledge Representation July 28, 2011 IGARSS 2011 TH4.T09.2 “ Vegetation has high NDVI values” “ Roads are long and narrow” “ Buildings are usually located along Road ” “ Artificial Forests are often located along River ” “ Mountains are often covered by Forest ” <ul><li>Knowledge representation requires: </li></ul><ul><li>uncertainty </li></ul><ul><li>modularity and scalability </li></ul><ul><li>implicit structural definition of concepts </li></ul>Knowledge Based on Ontology
  6. 6. Remote Sensing Ontology <ul><li>Heavyweight </li></ul><ul><li>ontology in </li></ul><ul><li>remote sensing </li></ul><ul><ul><li>420 concepts </li></ul></ul><ul><li>Definition Structures </li></ul><ul><li>Inheritance (B is-a A) </li></ul><ul><li>Slot (B part-of / attribute-of A) </li></ul>July 28, 2011 IGARSS 2011 TH4.T09.2 A B soil p/o 1.. leaf chlorophyll component substance Any water chlorophyll a/o 1 p/o 1.. density density cluster Any component river field slope continuant entity p/o 1.. a/o 1 geographical object component structure structural attr. Any contextual change p/o 1.. subevent change event p/o 0.. p/o 0.. Any before Any after superficial change p/o 1.. component Any geographical feature p/o 1.. soil layer soil component p/o 1.. water layer water component wood p/o 1.. trunk wood component p/o 1.. p/o 1.. tree leaf component trunk component sea mountain occurrent p/o 1 soil appearance soil layer after water appearance p/o 1 water layer after a/o 1 p/o 1 location slope mudslide subevent soil appearance substrate p/o 1.. forest tree component change event Main Categories p/o 1 Slot 1 B Slot 2 C a/o 1 A
  7. 7. Knowledge Based on Ontology <ul><li>Describing relations among some concepts </li></ul><ul><li>Using Bayesian probability to express uncertainty </li></ul>July 28, 2011 IGARSS 2011 TH4.T09.2 (1) Concept-Slot Relation (2) Concept-Evidence Relation (3) Co-Occurrence 2 Concepts 3 Concepts B C A
  8. 8. Analysis of Target & Synthesis of Knowledge (2) July 28, 2011 IGARSS 2011 TH4.T09.2 Bayesian Network (1) p/o 0 p/o 1 soil appearance mudslide soil layer before a/o 1 location slope p/o 1 p/o 1 soil layer after p/o 1 subevent soil component soil component Ontology slope angle slope soil layer soil soil layer soil appearance soil layer soil appearance mudslide slope hue soil saturation soil value soil NDVI soil Knowledge Day 2 soil appearance mudslide slope angle slope Day 1 Auxiliary Data soil layer soil hue value NDVI saturation soil layer soil hue value NDVI saturation (3)
  9. 9. Change Detection July 28, 2011 IGARSS 2011 TH4.T09.2 Soil Layer Image Object Soil Hue Value Saturation NDVI Satellite Image Soil Layer Soil Appearance Day 2 Day 1 Calculate posterior probability of target using Bayesian network Inference of Substance Inference of Object Inference of Change Day 2 soil appearance mudslide slope angle slope Day 1 Auxiliary Data soil layer soil hue value NDVI saturation soil layer soil hue value NDVI saturation
  10. 10. Experiment <ul><li>To validate cognitive ability & versatility </li></ul><ul><li>Applying to three cases of practical change detection without tuning </li></ul><ul><li>Bi-temporal data </li></ul><ul><ul><li>observed by AVNIR-2 onboard ALOS </li></ul></ul><ul><ul><ul><li>3 visible + 1 near-infrared </li></ul></ul></ul><ul><ul><ul><li>10 m spatial resolution </li></ul></ul></ul><ul><ul><li>applied image registration with geometric errors of less than 0.5 pixel </li></ul></ul>July 28, 2011 IGARSS 2011 TH4.T09.2
  11. 11. Case 1: Detection of Mudslides in Yamaguchi City, Japan July 28, 2011 IGARSS 2011 TH4.T09.2 Day 1 (14 June, 2009) Day 2 (30 July, 2009) ©JAXA ©JAXA Mudslides caused by heavy rain in 19-26 July, 2009
  12. 12. Case 1: Detection of Mudslides in Yamaguchi City, Japan - Inference Results - July 28, 2011 IGARSS 2011 TH4.T09.2 Day 1 (14 June, 2009) Day 2 (30 July, 2009) ©JAXA ©JAXA soil on day 1 soil appearance mudslide slope Definition of mudslide soil on day 2 p/o 0 p/o 1 soil appearance mudslide soil layer before a/o 1 location slope p/o 1 p/o 1 soil layer after p/o 1 subevent soil component soil component
  13. 13. Case 1: Detection of Mudslides in Yamaguchi City, Japan - Comparison with Human’s Result - July 28, 2011 IGARSS 2011 TH4.T09.2 small changes => more sensitive than human’s result changes in the flat area => our definition of mudslide doesn’t include changes in flat area
  14. 14. Case 1: Mudslide Detection in Yamaguchi City, Japan - Comparison with Survey Data - July 28, 2011 IGARSS 2011 TH4.T09.2 Mudslides in Our Result Collapsed Slopes Mudflow Traces Debris in Survey Data (investigated by Yamaguchi Pref.)
  15. 15. Case 2: Detection of Flooded Areas in Myanmar July 28, 2011 IGARSS 2011 TH4.T09.2 ©JAXA ©JAXA Day 1 (4 May, 2008) Day 2 ( 19 June, 2008 ) Water (Day 1) Water Disappearance Water (Day 2) Floods caused by Cyclone in 2-3 May, 2008
  16. 16. Case 2: Detection of Flooded Areas in Myanmar - Comparison with Human’s Result - July 28, 2011 IGARSS 2011 TH4.T09.2 Our result not correctly detected due to the existence of clouds Human’s result misdetected edges of clouds
  17. 17. Case 3: Detection of Flooded Areas in Pakistan July 28, 2011 IGARSS 2011 TH4.T09.2 ©JAXA ©JAXA Day 1 (14 Oct., 2009) Day 2 (1 Sept., 2010) Water (Day 1) Water Appearance Water (Day 2) Floods caused by heavy rain since late July, 2010
  18. 18. Discussion <ul><li>About 90% accuracy in mudslide detection </li></ul><ul><li>Our results were better than human’s results </li></ul><ul><ul><li>due to using knowledge specialized on targets </li></ul></ul><ul><li>Fairly good results in all cases without tuning </li></ul><ul><ul><ul><li>due to analyzing essential characteristics of each targets using heavyweight ontology </li></ul></ul></ul><ul><li>Possible to understand and recognize targets as humans do using rich ontology-based knowledge </li></ul>July 28, 2011 IGARSS 2011 TH4.T09.2
  19. 19. Conclusions <ul><li>We proposed a framework for change detection </li></ul><ul><ul><li>using ontology-based knowledge to recognize and understand targets </li></ul></ul><ul><li>The experiment showed: </li></ul><ul><ul><li>accuracy was about 90 % in mudslide detection </li></ul></ul><ul><ul><li>results were better than human’s results without tuning </li></ul></ul><ul><li>More improvements are ongoing </li></ul><ul><ul><li>to extract various information from data, such as spatial information </li></ul></ul><ul><ul><li>to describe more expressive knowledge </li></ul></ul>July 28, 2011 IGARSS 2011 TH4.T09.2
  20. 20. <ul><li>Thank you! </li></ul>July 28, 2011 IGARSS 2011 TH4.T09.2
  21. 21. Probabilistic Inference with Bayesian Network July 28, 2011 IGARSS 2011 TH4.T09.2 Node: random variable Arc: probabilistic relation ・・・ (1) ・・・ (3) ・・・ (2)
  22. 22. July 28, 2011 IGARSS 2011 TH4.T09.2
  23. 23. July 28, 2011 IGARSS 2011 TH4.T09.2 0.3 0.4 0.5 0.6

×