Download to read offline
Uploaded byBeniamino Murgante
Iccsa stankuteha180611
Data conflation is a process that optimizes spatial data quality by automatically merging heterogeneous geospatial datasets. It detects corresponding real-world features represented differently across datasets and combines their geometric and semantic information. For example, conflating datasets can identify a traffic roundabout modeled inconsistently and insert it accurately. By integrating multiple sources, conflation improves data completeness, positional accuracy, and temporal accuracy to produce an optimized dataset for applications.
More Related Content
Similar to Iccsa stankuteha180611
Iccsa stankuteha180611
- 1. Improvement of spatial data quality through data conflation Silvija Stankute, Hartmut Asche Geoinformation Research Group Dept of Geography | University of Potsdam | Germany ICCSA 2011 | GEOG-AN-MOD 2011 | University of Santander | 20-23/06/2011
- 2. Summary Motivation: Spatialdata quality matters Spatial data quality: Definition, indicators Data conflation: Optimising spatial data quality Data conflation at work: Inserting a roundabout Conclusion: What‘s the merit of data conflation?
- 3. Introduction of digitalmapping techniques and GIS in the 1960s made quality of digital spatial data an issue in geoinformation processing (GI) Error and uncertainty in spatial data identified as potential problems in GI processing uncommon in production and use of paper maps Ongoing development from 1980s to design and implement data transfer standards which include data quality information hitherto available on the margins of paper maps only Objective of this work is to present data conflation as one option in GI processing for improvement of spatial data quality 1 Motivation Spatial data quality matters
- 4. OpenStreetMap Analog topo map 1:10K Brandenburg Viewer 1 Motivation Spatial data quality matters Potsdam in different spatial datasets
- 5. Geodata quality ISO8402: totality of characteristics of a product that bear on its ability to satisfy stated or implied needs > fitness-for-use Definition of spatial data quality necessitates information on (a) geodata used, ( b) user requirements Fitness-for-use: data meet requirements of target application Geo data quality indicators Completeness Logical consistency Positional accuracy Temporal accuracy: accuracy of reporting time of data Semantic/thematic/attribute accuracy Information on geodata quality included in metadata 2 Spatial data quality Definition, indicators
- 6. D ata acquisitionDifferent methods for spatial data acquisition developed by spatial data producers result in different data types data formats semantic information of geodata Consequence: multiplicity of spatial data Problem: multiple data use of specific datasets Option: data integration or data conflation applied to existing datasets instead of continuous acquisition of new spatial data with above faults 2 Spatial data quality Data acquisiton
- 7. Objective Automated mergeof heterogenous geodata to application requirements to produce best-fit dataset for any specific application source dataset SDS target dataset TDS output dataset 3 Data conflation Optimising spatial data quality missing data inserted data
- 8. One spatial object,different data models Real world spatial data transformed into computer-readable digital data model representing spatial features as (a) points, (b) lines or (c) areas (polygons) Modelling of real world spatial data can result in different data models of identical real world object: traffic roundabout 3 Data conflation Optimising spatial data quality
- 9. One spatial object,multiple geometry OpenStreet Map TeleAtlas ATKIS 3 Data conflation Optimising spatial data quality
- 10. 4 Dataconflation at work Conceputal framework Substituting roundabout for road crossing Inserting roundabout in dataset where roundabout modelled as road crossing = not defined as roundabout Detecting “missing” roundabout by identifying position of crossings in input datasets: roundabout identified if minimum of 3 edges of road network have identical start and end point When 3 edges are identified which have the same node (start or end point of edge), this intersection is part of roundabout
- 11. 4 Dataconflation at work Automated workflow Producing best-fit dataset dataset 1 dataset 2 pre-processing pre-processing object assignment new dataset data sources
- 12. (a) edge tracingfor identification of roundabout in input data-set 1, (b) search for roundabout access/exits in input dataset 2 Merge access/exits with corresponding points on crossroads 4 Data conflation at work Semantic accuracy Inserting roundabout in target dataset Inserting roundabout
- 13. All access orexits of roundabout found in first input dataset Corresponding edges in second input dataset also detected. Geometrical information about new objects can be assigned to target dataset 4 Data conflation at work Geometric completeness Assigning geometric information Inserting roundabout
- 14. After completion ofmerge process of 2 or more datasets (points, lines, polygons) completeness of input data is always increased Prerequisite: one of the input datasets must have more infor-mation than the other(s) Not all new geometry objects of target dataset include infor-mation on thematic attributes, hence completeness of target dataset can never be complete in terms of thematic information Consequence: Datasets generated by conflation can only be complete in terms of geometrical information 4 Data conflation at work Data quality optimised
- 15. 4 Dataconflation at work Data quality optimised Real world spatial data: 8 buildings Source dataset in-cludes information on 6 buildings (geo-metry, use) Target dataset in-cludes information on 5 buildings (geo-metry, floors) End dataset com-plete with geometric information Geometric objects of both input datasets have 100% thematic completeness
- 16. Conflation methods allowthe improvement of positional and temporal accuracy of spatial data Positional accuracy of a dataset can be increased with the information provided by another input dataset If both datasets show major variance from the corresponding real world objects, arithmetic average of all input datasets can increase this quality element Temporal accuracy can be improved if metadata provide infor-mation about actuality of spatial data Data conflation facilitates multiple use of quality spatial data which can be generated automatically to application require-ments from existing suboptimal datasets 5 Conclusion What‘s the merit of data conflation?
- 17. Thank you for your attention Questions? Comments? Feedback? Contact Hartmut Asche | gislab@uni-potsdam.de Dept of Geography | University of Potsdam | GER Web www.geographie.uni-potsdam.de/geoinformatik ICCSA 2011 | GEOG-AN-MOD 2011 | University of Santander | 20-23/06/2011
Editor's Notes
- #4 With the introduction of digital mapping techniques in the 1960s and then GIS shortly afterwards, researchers realized that error and uncertainty in digital spatial data had the potential to cause problems that had not been experienced with paper maps. An international trend started in the early-1980s to design and implement data transfer standards which would include data quality information that had disappeared from the margins of paper maps with the transformation to digital data products. The main intention of this work is to present the data conflation as one of the options for improvement of spatial data quality.
- #6 In a number of fields, the approach to quality evolved into a definition based on fitness-for-use. ISO 8402 defines the quality as the ‘totality of characteristics of a product that bear on its ability to satisfy stated or implied needs’. This means that to define the quality two information are needed: the information on the data being used and on the users needs. Spatial data is defined to be fitness-for-use if it meets requirements of the target application. Data quality is defined by one or more quality dimensions. Quality dimensions for geographic data are called spatial data quality elements. They include completeness, logical consistency, positional accuracy, temporal accuracy (the accuracy of reporting time associated with the data) and thematical/semantical or attribute accuracy. Typically, metadata for spatial data include descriptions of data quality and include information about these elements.
- #8 During the conflation process information from the source input dataset (SDS) and the target input dataset (TDS) have to be assigned to each other. The SDS is defined as the dataset from where the geospatial information is taken (e.g. thematic information) and the TDS is defined as the dataset to which the geospatial information taken from the SDS is being transferred, i.e. the expanded dataset.
- #9 In order to transmit the real world into the language understandable for the computer, it should be modeled according to specific rules in a simplified form. Such data models represent the objects of reality as points, lines or areas (polygons). Each of these objects is provided with the x -and y-coordinates and contains information on the spatial reference. This example shows the differences of data formats of the same object.
- #10 The different producers of spatial data detected the same object of the real world differently. There are no uniform rules for acquisition of spatial data. According to this the different abstract representations of one and the same object of the real world may arise. This Figure shows an example of alternative geometric representations of the same real world object. Each representation was generated by different spatial data providers.
- #11 The approach presented here improves the quality of spatial data. This method illustrates how to increase the geometrical completeness of the road networks data. In the source dataset available objects such roundabouts must be found in the target dataset and assigned to the new amended dataset. The problem is that crossroads, which are roundabouts, in the dataset are saved as simple crossroad. At first a position of all available crossroads in the both datasets has to be found. A roundabout is finding if minimum three edges of the road network have the same start- and endpoint. If there are three edges, which have the same node, regardless of that is start or end point of each edge, then this intersection is a part of the roundabout.
- #13 In this way every crossroad of the dataset is verified. If a roundabout is defined, than at the second step the adequate crossroad is searched in the second dataset. Therefore the points are used, which are valid as traffic access or exits
- #14 All access or exits of roundabout are found in the first input dataset. The corresponding edges in the second input dataset are also found. Now the geometrical information about new objects can be assigned
- #16 After merge process of two or more datasets, the completeness of input data is always increased. This applies to all data types: polygons, lines, points. One condition must be fulfilled - one of the input datasets must have more information than the other. Not all new geometrical object of the end dataset include information about attributes. The completeness of the end dataset can never be complete in terms of thematic information. Datasets generated by conflation can be complete only in terms of geometrical information. The figure illustrates this problem. The figure 3 shows an example of two datasets. The first dataset (source dataset) includes the information about 6 buildings. However in the real world total number of buildings is 8, so two objects in this dataset are not provided. The source dataset includes thematic information about type of use of these buildings. The second dataset (target dataset) includes geometrical information about 5 objects. The information about existence of the buildings number 6, 7 and 8 is not available. Unlike source dataset, target data have information about quantity of floors. This information in the first dataset is missing. The end dataset in the figure 3 shows the complete dataset in terms of geometric information. The table under it shows increment of attributes. Geometrical objects, which are available in both input datasets, have 100% thematically completeness. The missing objects have thematic information of only one input dataset.
- #17 Conflation approaches allow the improvement of positional and temporal accuracy as well. Positional accuracy of a dataset can be increased with the information given by another input dataset. If both datasets have the major variance from real world, the arithmetic average of all input datasets can increase this quality element. The temporal accuracy will be improved if metadata provide information about actuality of spatial data.