SlideShare a Scribd company logo
VIRTUAL INTEGRATION OF
WISCONSIN PARCEL DATA
Howard Veregin                Martin Goettl
                              Geography & Anthropology
Brenda Hemstead               UW – Eau Claire
State Cartographer’s Office
UW-Madison
A RESEARCH PROJECT
Research focus: virtual data integration

Exploring feasibility of the approach

•   Advantages
•   Limitations
•   Challenges
•   Best practices
WHAT WE HAVE DONE
Combined existing county Web map services
into single multi-county online parcel map

Counties supplied REST service endpoints
•   No physical data exchange
•   No edgematching or
    common data model
•   Web map points to
    published county dataset
    (most current data)
WHAT ARE WEB SERVICES?
It depends on who you ask

Technology perspective
• Software and standards supporting
   computer interaction over the Internet

User perspective
• Web apps offering data, product, or
  service delivered over Web
WHAT ARE WEB MAP SERVICES?
 Technically
 • Web Map Service = WMS
 • OGC standard for online maps display
 • One of a family of standards

 Generically
 • Way to deliver map content over Web
 • Also, feature and geoprocessing
   services…
OUR GOALS
Project goals broadened over time

Initial goal: create multi-county parcel
Web map

Our focus now is on the research side
• Not just parcels, but any theme
• Limitations, challenges, best practices
• Alignment with other GIS/IT trends
OUTLINE OF PRESENTATION
Background (Howard)

Project status (Brenda)

Main challenges (Howard)
• Performance
• Availability of map services
• Resymbolization and map appearance
• Distributed analysis and querying
• Legal issues
BACKGROUND
GEOSPATIAL DATA INTEGRATION
 “Combining data from different sources to
 provide a unified view of data for users”

 A mashup combines different geospatial
 themes over one area.

 Data integration combines the same
 theme over different (adjacent) areas.
ADVANTAGE #1
“Well-behaved” problem

Once source datasets are delivered, no
further external inputs are needed

Relatively easy to allocate personnel and
budget to the task
ADVANTAGE #2
True integration is possible (in theory)

Rubber sheeting and edgematching
eliminate spatial “gaffs” (slivers, overlaps)

Common data model facilitates analysis
and querying
ADVANTAGE #3
Republishing is relatively easy

Integrator can make data available in a
variety of formats
DISADVANTAGE #1
Data producers provide copy of dataset

Issues:
• Data sharing arrangements
• Loss of local control over data
• Possible quality decline due to spatial
   and/or attribute adjustments
DISADVANTAGE #2
Integrated data may not be current

Depends on time it takes to perform
integration, plus volatility of the layer

Re-integrating updated data is frequently
costly (so often never happens)
DISADVANTAGE #3
Curating integrated datasets is
increasingly impractical

Large data volumes (“big data”)

More frequent updates, data collection
Need a solution that
incorporates distributed
  access, visualization,
 analysis and querying
STATUS
PROCESS
                          Dear <<LIO>>,

                          This email is to inform you of a joint research project by the State Cartographers Office
                          (SCO) at UW-Madison and the Department of Geography and Anthropology at UW-Eau
                          Claire. The purpose of our project is to investigate the feasibility of using Web map
                          services to create a statewide view of geospatial data collected and maintained at the county
                          level.
Supported and             Our initial goal is to incorporate existing map services showing tax parcels into a single

facilitated by LION
                          online map application. We have chosen parcel data for this initial test because this type of
                          data is of interest to a wide range of users. However, our project has a broader purpose,
                          namely to explore how Web map services can be used to support virtual data integration for
                          simple mapping and display. Specific research questions we will be investigating include:

                          - How much flexibility exists to resymbolize map services from different counties? Can we

Contacted stakeholders    apply a common set of map symbols to different services to make the integrated map look
                          more consistent?
                          - What are the limitations on querying and analysis, given that data models and attributes
(county LIOs) via email   are not consistent from county to county? What implications does this have for data
                          standards?
                          - How much of an issue is performance? Are there performance improvements that can be
                          implemented?
                          - Can we integrate commercial and open-source services in a single Web application?

Gathered REST URL         Since our approach makes use of existing Web map services, we do not need to ask for
                          copies of your geospatial datasets. Instead, we will simply be tapping into existing services

(or other URL)            that are already available on the Web. This also means that any map that includes your
                          county's data will be up-to-date and accurate.

                          We do have one request. We would greatly appreciate your assistance by providing the
                          URL of your parcel data Web service. For most counties, this will be an ArcGIS Server
                          REST endpoint of the form:
Followed up in person     https://<host>/ArcGIS/rest/services

or by phone               We are also interested in other types of services -- such as ArcIMS, WMS, etc. If you have
                          such a service, we would appreciate your help identifying its URL.

                          To provide us with your URL, simply reply to this email or to one of the email addresses
                          listed below. So that we can keep on schedule for our project, we would greatly appreciate
                          a response by May 1, 2012.

                          Please let us know in your email response if you have any conditions or terms associated
REST ENDPOINTS
Representational State Transfer

A communications protocol for the Web

http://example.wi.us/arcgis/rest/services

Once a service is published through ArcMap
to ArcGIS Server it is visible at the REST URL
EXAMPLE

  REST SERVICES
DIRECTORY EXAMPLE
STATUS
Most counties use Esri
ArcGIS Server (REST)

ArcIMS still widely used
(but, migrating)

Small number of counties
using Open Source
technology
ARCGIS ONLINE
SOME EXAMPLES

    Waupaca            Outagamie
     County             County




                    County
                     Line
 REST
Services
SOME EXAMPLES

Waupaca         Outagamie
 County          County




             County
              Line
SOME EXAMPLES
Washington
 County                 Ozaukee
                        County


             Popup



Waukesha             Milwaukee
 County               County
CHALLENGES
PERFORMANCE
Many county REST services designed for
internal access or occasional citizen use

Impact on these users if site usage
increased significantly?

One of the reasons we are not releasing a
public-access viewer at this time
SERVICE AVAILABILITY
Services can be added, removed, or
modified

Affects where the map viewer points to
the data

Services may also go off-line

Virtually no control over these changes
SERVICE AVAILABILITY


 Map service
not responding
SERVICE AVAILABILITY



 Map service
 unavailable
RESYMBOLIZATION
Need to control symbol color and size

Also need to control zoom levels where
features appear and disappear

Relatively easy to
do, but little
consistency or
standardization
between counties
DISTRIBUTED QUERYING
How to query across multiple datasets
with different schemas

A big research issue (“semantic web”)

“Distributed query” or “federated search”

user  query  subqueries to participating
data sources  aggregation of query results
LEGAL ISSUES
Opens up new legal issues

Data readily incorporated into any
mashup for any purpose

Loss of control over data

How will local governments
react to this new technology?
CONCLUSION
WHO BENEFITS FROM INTEGRATED DATA?
Geospatial professionals
• Demonstrate ROI for cost of geospatial services
• Model a successful data integration scenario

Counties
• Active participants in an effort that will have
  impacts beyond county boundaries

Citizens and taxpayers
• Maximizing utilization of taxpayer investments
• Obtaining greater benefits
• More effective and efficient governance!
BENEFITS OF STUDY
Education about GIS Web services

Forward-looking way of thinking about data integration

Challenges and solutions to this new approach

Standards and best practices for Web services
THANK YOU!
  Howard Veregin, veregin@wisc.edu
Brenda Hemstead, hemstead@wisc.edu
  Martin Goettl, goettlm@uwec.edu
   Photos by UW-Madison, University Communications
   Geology Lab Michael Forster Rothbart/University of Wisconsin-Madison/2003
   Globe Jeff Miller/University of Wisconsin-Madison/2011
   Community Engagement Jeff Miller/University of Wisconsin-Madison/2009
   Jeopardy Bryce Richter/University of Wisconsin-Madison/2008
   All photos © Board of Regents of the University of Wisconsin System

   Other photos
   VIIRS Suomi Earth Image Norman Kuring/NASA/NOAA/GSFC/Suomi NPP/VIIRS

More Related Content

Similar to Wisconsin SCO Virtual Data Integration

GIS in Utah
GIS in UtahGIS in Utah
Utah Reorganizes its GIS Around Web Services
Utah Reorganizes its GIS Around Web ServicesUtah Reorganizes its GIS Around Web Services
Utah Reorganizes its GIS Around Web Services
State of Utah, Salt Lake City
 
Introduction to RAGLD
Introduction to RAGLDIntroduction to RAGLD
Introduction to RAGLD
ragld
 
11.concept for a web map implementation with faster query response
11.concept for a web map implementation with faster query response11.concept for a web map implementation with faster query response
11.concept for a web map implementation with faster query response
Alexander Decker
 
Concept for a web map implementation with faster query response
Concept for a web map implementation with faster query responseConcept for a web map implementation with faster query response
Concept for a web map implementation with faster query response
Alexander Decker
 
Leveraging ArcGIS Platform & CityEngine for GIS based Master Plans
Leveraging ArcGIS Platform & CityEngine for GIS based Master PlansLeveraging ArcGIS Platform & CityEngine for GIS based Master Plans
Leveraging ArcGIS Platform & CityEngine for GIS based Master Plans
Esri India
 
CK2017: Karnataka GIS - A GoK Initiative towards g-Governance
CK2017: Karnataka GIS - A GoK Initiative towards g-Governance CK2017: Karnataka GIS - A GoK Initiative towards g-Governance
CK2017: Karnataka GIS - A GoK Initiative towards g-Governance
WRI Ross Center for Sustainable Cities
 
GIS Standards and Interoperability
GIS Standards and InteroperabilityGIS Standards and Interoperability
GIS Standards and Interoperability
Nasr Khashoggi
 
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...Syntactic and semantic based approaches for Geoinformation Management - Dr. S...
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...
NeGD Capacity Building
 
Geospatial Ontologies and GeoSPARQL Services
Geospatial Ontologies and GeoSPARQL ServicesGeospatial Ontologies and GeoSPARQL Services
Geospatial Ontologies and GeoSPARQL Services
Stephane Fellah
 
Next Generation Open Data Platforms | AWS Public Sector Summit 2016
Next Generation Open Data Platforms | AWS Public Sector Summit 2016Next Generation Open Data Platforms | AWS Public Sector Summit 2016
Next Generation Open Data Platforms | AWS Public Sector Summit 2016
Amazon Web Services
 
Getting your Data Out There: An Introduction to Distributed GIS
Getting your Data Out There:An Introduction to Distributed GISGetting your Data Out There:An Introduction to Distributed GIS
Getting your Data Out There: An Introduction to Distributed GIS
John Reiser
 
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...
GIS in the Rockies
 
Web mapping
Web mappingWeb mapping
Web mapping
Musnanda Satar
 
ESRIUK_Track4_maria adamson BT Lancashire Services
ESRIUK_Track4_maria adamson BT Lancashire ServicesESRIUK_Track4_maria adamson BT Lancashire Services
ESRIUK_Track4_maria adamson BT Lancashire Services
Esri UK
 
Web Mapping
Web MappingWeb Mapping
Web Mapping
Web Directions
 
Future of GIS, Moving to the Enterprise Platform
Future of GIS, Moving to the Enterprise PlatformFuture of GIS, Moving to the Enterprise Platform
Future of GIS, Moving to the Enterprise Platform
SSP Innovations
 
Strategies for Integrating Utility System Operational Data into ArcGIS Server...
Strategies for Integrating Utility System Operational Data into ArcGIS Server...Strategies for Integrating Utility System Operational Data into ArcGIS Server...
Strategies for Integrating Utility System Operational Data into ArcGIS Server...
True North Geographic Technologies
 
Web Mapping - exploiting location based information through eGovernment
Web Mapping - exploiting  location based information through eGovernmentWeb Mapping - exploiting  location based information through eGovernment
Web Mapping - exploiting location based information through eGovernment
David Hayward
 
WEB GIS AND WEB MAP.pptx
WEB GIS AND WEB MAP.pptxWEB GIS AND WEB MAP.pptx
WEB GIS AND WEB MAP.pptx
Asim Pt
 

Similar to Wisconsin SCO Virtual Data Integration (20)

GIS in Utah
GIS in UtahGIS in Utah
GIS in Utah
 
Utah Reorganizes its GIS Around Web Services
Utah Reorganizes its GIS Around Web ServicesUtah Reorganizes its GIS Around Web Services
Utah Reorganizes its GIS Around Web Services
 
Introduction to RAGLD
Introduction to RAGLDIntroduction to RAGLD
Introduction to RAGLD
 
11.concept for a web map implementation with faster query response
11.concept for a web map implementation with faster query response11.concept for a web map implementation with faster query response
11.concept for a web map implementation with faster query response
 
Concept for a web map implementation with faster query response
Concept for a web map implementation with faster query responseConcept for a web map implementation with faster query response
Concept for a web map implementation with faster query response
 
Leveraging ArcGIS Platform & CityEngine for GIS based Master Plans
Leveraging ArcGIS Platform & CityEngine for GIS based Master PlansLeveraging ArcGIS Platform & CityEngine for GIS based Master Plans
Leveraging ArcGIS Platform & CityEngine for GIS based Master Plans
 
CK2017: Karnataka GIS - A GoK Initiative towards g-Governance
CK2017: Karnataka GIS - A GoK Initiative towards g-Governance CK2017: Karnataka GIS - A GoK Initiative towards g-Governance
CK2017: Karnataka GIS - A GoK Initiative towards g-Governance
 
GIS Standards and Interoperability
GIS Standards and InteroperabilityGIS Standards and Interoperability
GIS Standards and Interoperability
 
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...Syntactic and semantic based approaches for Geoinformation Management - Dr. S...
Syntactic and semantic based approaches for Geoinformation Management - Dr. S...
 
Geospatial Ontologies and GeoSPARQL Services
Geospatial Ontologies and GeoSPARQL ServicesGeospatial Ontologies and GeoSPARQL Services
Geospatial Ontologies and GeoSPARQL Services
 
Next Generation Open Data Platforms | AWS Public Sector Summit 2016
Next Generation Open Data Platforms | AWS Public Sector Summit 2016Next Generation Open Data Platforms | AWS Public Sector Summit 2016
Next Generation Open Data Platforms | AWS Public Sector Summit 2016
 
Getting your Data Out There: An Introduction to Distributed GIS
Getting your Data Out There:An Introduction to Distributed GISGetting your Data Out There:An Introduction to Distributed GIS
Getting your Data Out There: An Introduction to Distributed GIS
 
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...
2013 URISA Track, Deploying Web-GIS Apps on Multiple Platforms, Scott Staffor...
 
Web mapping
Web mappingWeb mapping
Web mapping
 
ESRIUK_Track4_maria adamson BT Lancashire Services
ESRIUK_Track4_maria adamson BT Lancashire ServicesESRIUK_Track4_maria adamson BT Lancashire Services
ESRIUK_Track4_maria adamson BT Lancashire Services
 
Web Mapping
Web MappingWeb Mapping
Web Mapping
 
Future of GIS, Moving to the Enterprise Platform
Future of GIS, Moving to the Enterprise PlatformFuture of GIS, Moving to the Enterprise Platform
Future of GIS, Moving to the Enterprise Platform
 
Strategies for Integrating Utility System Operational Data into ArcGIS Server...
Strategies for Integrating Utility System Operational Data into ArcGIS Server...Strategies for Integrating Utility System Operational Data into ArcGIS Server...
Strategies for Integrating Utility System Operational Data into ArcGIS Server...
 
Web Mapping - exploiting location based information through eGovernment
Web Mapping - exploiting  location based information through eGovernmentWeb Mapping - exploiting  location based information through eGovernment
Web Mapping - exploiting location based information through eGovernment
 
WEB GIS AND WEB MAP.pptx
WEB GIS AND WEB MAP.pptxWEB GIS AND WEB MAP.pptx
WEB GIS AND WEB MAP.pptx
 

More from Wisconsin Land Information Association

Airphoto anomilies
Airphoto anomiliesAirphoto anomilies
A wikimap of landscape values in the bad river watershed carl sack
A wikimap of landscape values in the bad river watershed   carl sackA wikimap of landscape values in the bad river watershed   carl sack
A wikimap of landscape values in the bad river watershed carl sack
Wisconsin Land Information Association
 
Workshop using open source software for mobile data collection workshop - a...
Workshop   using open source software for mobile data collection workshop - a...Workshop   using open source software for mobile data collection workshop - a...
Workshop using open source software for mobile data collection workshop - a...
Wisconsin Land Information Association
 
Wigicc's role in wisconsin jon schwitchtenberg
Wigicc's role in wisconsin   jon schwitchtenbergWigicc's role in wisconsin   jon schwitchtenberg
Wigicc's role in wisconsin jon schwitchtenberg
Wisconsin Land Information Association
 
Wi 590 nutrient management web application lisa morrison
Wi 590 nutrient management web application   lisa morrisonWi 590 nutrient management web application   lisa morrison
Wi 590 nutrient management web application lisa morrison
Wisconsin Land Information Association
 
Surveying and land records management dean roth
Surveying and land records management   dean rothSurveying and land records management   dean roth
Surveying and land records management dean roth
Wisconsin Land Information Association
 
Mapping spatial patterns of whai finder usage to measure community outreach e...
Mapping spatial patterns of whai finder usage to measure community outreach e...Mapping spatial patterns of whai finder usage to measure community outreach e...
Mapping spatial patterns of whai finder usage to measure community outreach e...
Wisconsin Land Information Association
 
Local gis in the statewide voter registration system sarah whitt
Local gis in the statewide voter registration system   sarah whittLocal gis in the statewide voter registration system   sarah whitt
Local gis in the statewide voter registration system sarah whitt
Wisconsin Land Information Association
 
Li dar quality control a client's perspective - tyler grosshuesch
Li dar quality control   a client's perspective - tyler grosshueschLi dar quality control   a client's perspective - tyler grosshuesch
Li dar quality control a client's perspective - tyler grosshuesch
Wisconsin Land Information Association
 
Li dar meets wisconsinview jc nelson
Li dar meets wisconsinview   jc nelsonLi dar meets wisconsinview   jc nelson
Li dar meets wisconsinview jc nelson
Wisconsin Land Information Association
 
Lakesheds and riverscapes extending wisconsin's hydro database with landsca...
Lakesheds and riverscapes   extending wisconsin's hydro database with landsca...Lakesheds and riverscapes   extending wisconsin's hydro database with landsca...
Lakesheds and riverscapes extending wisconsin's hydro database with landsca...
Wisconsin Land Information Association
 
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...
Wisconsin Land Information Association
 
Integrating sanitary televising data with utility gis data within the city of...
Integrating sanitary televising data with utility gis data within the city of...Integrating sanitary televising data with utility gis data within the city of...
Integrating sanitary televising data with utility gis data within the city of...
Wisconsin Land Information Association
 
Integrating high accuracy gps with esri's arc gis for windows mobile field so...
Integrating high accuracy gps with esri's arc gis for windows mobile field so...Integrating high accuracy gps with esri's arc gis for windows mobile field so...
Integrating high accuracy gps with esri's arc gis for windows mobile field so...
Wisconsin Land Information Association
 
Implementing arc gis 10.1 for the wisconsin dnr nhi portal levi felling
Implementing arc gis 10.1 for the wisconsin dnr nhi portal   levi fellingImplementing arc gis 10.1 for the wisconsin dnr nhi portal   levi felling
Implementing arc gis 10.1 for the wisconsin dnr nhi portal levi felling
Wisconsin Land Information Association
 
Gis in parks and recreation the proragis website - trish nau
Gis in parks and recreation   the proragis website - trish nauGis in parks and recreation   the proragis website - trish nau
Gis in parks and recreation the proragis website - trish nau
Wisconsin Land Information Association
 
Geo moose project update brian fischer
Geo moose project update   brian fischerGeo moose project update   brian fischer
Geo moose project update brian fischer
Wisconsin Land Information Association
 
Developing mobile apps pick your poison - levi felling
Developing mobile apps   pick your poison - levi fellingDeveloping mobile apps   pick your poison - levi felling
Developing mobile apps pick your poison - levi felling
Wisconsin Land Information Association
 
City of ashland an analysis of mobile gis through amazon elastic cloud comp...
City of ashland   an analysis of mobile gis through amazon elastic cloud comp...City of ashland   an analysis of mobile gis through amazon elastic cloud comp...
City of ashland an analysis of mobile gis through amazon elastic cloud comp...
Wisconsin Land Information Association
 
A Journey Through Mobile Application Development - Brian Fischer
A Journey Through Mobile Application Development - Brian FischerA Journey Through Mobile Application Development - Brian Fischer
A Journey Through Mobile Application Development - Brian Fischer
Wisconsin Land Information Association
 

More from Wisconsin Land Information Association (20)

Airphoto anomilies
Airphoto anomiliesAirphoto anomilies
Airphoto anomilies
 
A wikimap of landscape values in the bad river watershed carl sack
A wikimap of landscape values in the bad river watershed   carl sackA wikimap of landscape values in the bad river watershed   carl sack
A wikimap of landscape values in the bad river watershed carl sack
 
Workshop using open source software for mobile data collection workshop - a...
Workshop   using open source software for mobile data collection workshop - a...Workshop   using open source software for mobile data collection workshop - a...
Workshop using open source software for mobile data collection workshop - a...
 
Wigicc's role in wisconsin jon schwitchtenberg
Wigicc's role in wisconsin   jon schwitchtenbergWigicc's role in wisconsin   jon schwitchtenberg
Wigicc's role in wisconsin jon schwitchtenberg
 
Wi 590 nutrient management web application lisa morrison
Wi 590 nutrient management web application   lisa morrisonWi 590 nutrient management web application   lisa morrison
Wi 590 nutrient management web application lisa morrison
 
Surveying and land records management dean roth
Surveying and land records management   dean rothSurveying and land records management   dean roth
Surveying and land records management dean roth
 
Mapping spatial patterns of whai finder usage to measure community outreach e...
Mapping spatial patterns of whai finder usage to measure community outreach e...Mapping spatial patterns of whai finder usage to measure community outreach e...
Mapping spatial patterns of whai finder usage to measure community outreach e...
 
Local gis in the statewide voter registration system sarah whitt
Local gis in the statewide voter registration system   sarah whittLocal gis in the statewide voter registration system   sarah whitt
Local gis in the statewide voter registration system sarah whitt
 
Li dar quality control a client's perspective - tyler grosshuesch
Li dar quality control   a client's perspective - tyler grosshueschLi dar quality control   a client's perspective - tyler grosshuesch
Li dar quality control a client's perspective - tyler grosshuesch
 
Li dar meets wisconsinview jc nelson
Li dar meets wisconsinview   jc nelsonLi dar meets wisconsinview   jc nelson
Li dar meets wisconsinview jc nelson
 
Lakesheds and riverscapes extending wisconsin's hydro database with landsca...
Lakesheds and riverscapes   extending wisconsin's hydro database with landsca...Lakesheds and riverscapes   extending wisconsin's hydro database with landsca...
Lakesheds and riverscapes extending wisconsin's hydro database with landsca...
 
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...
Lake habitat mapping with side scan sonar in nine wisconsin lakes - christine...
 
Integrating sanitary televising data with utility gis data within the city of...
Integrating sanitary televising data with utility gis data within the city of...Integrating sanitary televising data with utility gis data within the city of...
Integrating sanitary televising data with utility gis data within the city of...
 
Integrating high accuracy gps with esri's arc gis for windows mobile field so...
Integrating high accuracy gps with esri's arc gis for windows mobile field so...Integrating high accuracy gps with esri's arc gis for windows mobile field so...
Integrating high accuracy gps with esri's arc gis for windows mobile field so...
 
Implementing arc gis 10.1 for the wisconsin dnr nhi portal levi felling
Implementing arc gis 10.1 for the wisconsin dnr nhi portal   levi fellingImplementing arc gis 10.1 for the wisconsin dnr nhi portal   levi felling
Implementing arc gis 10.1 for the wisconsin dnr nhi portal levi felling
 
Gis in parks and recreation the proragis website - trish nau
Gis in parks and recreation   the proragis website - trish nauGis in parks and recreation   the proragis website - trish nau
Gis in parks and recreation the proragis website - trish nau
 
Geo moose project update brian fischer
Geo moose project update   brian fischerGeo moose project update   brian fischer
Geo moose project update brian fischer
 
Developing mobile apps pick your poison - levi felling
Developing mobile apps   pick your poison - levi fellingDeveloping mobile apps   pick your poison - levi felling
Developing mobile apps pick your poison - levi felling
 
City of ashland an analysis of mobile gis through amazon elastic cloud comp...
City of ashland   an analysis of mobile gis through amazon elastic cloud comp...City of ashland   an analysis of mobile gis through amazon elastic cloud comp...
City of ashland an analysis of mobile gis through amazon elastic cloud comp...
 
A Journey Through Mobile Application Development - Brian Fischer
A Journey Through Mobile Application Development - Brian FischerA Journey Through Mobile Application Development - Brian Fischer
A Journey Through Mobile Application Development - Brian Fischer
 

Recently uploaded

20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
tolgahangng
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
Zilliz
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
Matthew Sinclair
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
Claudio Di Ciccio
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
Octavian Nadolu
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
Wouter Lemaire
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
Tomaz Bratanic
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
kumardaparthi1024
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
FODUU
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
Zilliz
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
David Brossard
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 

Recently uploaded (20)

20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Serial Arm Control in Real Time Presentation
Serial Arm Control in Real Time PresentationSerial Arm Control in Real Time Presentation
Serial Arm Control in Real Time Presentation
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
Infrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI modelsInfrastructure Challenges in Scaling RAG with Custom AI models
Infrastructure Challenges in Scaling RAG with Custom AI models
 
20240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 202420240607 QFM018 Elixir Reading List May 2024
20240607 QFM018 Elixir Reading List May 2024
 
“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”“I’m still / I’m still / Chaining from the Block”
“I’m still / I’m still / Chaining from the Block”
 
Artificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopmentArtificial Intelligence for XMLDevelopment
Artificial Intelligence for XMLDevelopment
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
UI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentationUI5 Controls simplified - UI5con2024 presentation
UI5 Controls simplified - UI5con2024 presentation
 
How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
GraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracyGraphRAG for Life Science to increase LLM accuracy
GraphRAG for Life Science to increase LLM accuracy
 
GenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizationsGenAI Pilot Implementation in the organizations
GenAI Pilot Implementation in the organizations
 
Things to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUUThings to Consider When Choosing a Website Developer for your Website | FODUU
Things to Consider When Choosing a Website Developer for your Website | FODUU
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
Building Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and MilvusBuilding Production Ready Search Pipelines with Spark and Milvus
Building Production Ready Search Pipelines with Spark and Milvus
 
OpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - AuthorizationOpenID AuthZEN Interop Read Out - Authorization
OpenID AuthZEN Interop Read Out - Authorization
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 

Wisconsin SCO Virtual Data Integration

  • 1. VIRTUAL INTEGRATION OF WISCONSIN PARCEL DATA Howard Veregin Martin Goettl Geography & Anthropology Brenda Hemstead UW – Eau Claire State Cartographer’s Office UW-Madison
  • 2. A RESEARCH PROJECT Research focus: virtual data integration Exploring feasibility of the approach • Advantages • Limitations • Challenges • Best practices
  • 3. WHAT WE HAVE DONE Combined existing county Web map services into single multi-county online parcel map Counties supplied REST service endpoints • No physical data exchange • No edgematching or common data model • Web map points to published county dataset (most current data)
  • 4. WHAT ARE WEB SERVICES? It depends on who you ask Technology perspective • Software and standards supporting computer interaction over the Internet User perspective • Web apps offering data, product, or service delivered over Web
  • 5. WHAT ARE WEB MAP SERVICES? Technically • Web Map Service = WMS • OGC standard for online maps display • One of a family of standards Generically • Way to deliver map content over Web • Also, feature and geoprocessing services…
  • 6. OUR GOALS Project goals broadened over time Initial goal: create multi-county parcel Web map Our focus now is on the research side • Not just parcels, but any theme • Limitations, challenges, best practices • Alignment with other GIS/IT trends
  • 7. OUTLINE OF PRESENTATION Background (Howard) Project status (Brenda) Main challenges (Howard) • Performance • Availability of map services • Resymbolization and map appearance • Distributed analysis and querying • Legal issues
  • 9. GEOSPATIAL DATA INTEGRATION “Combining data from different sources to provide a unified view of data for users” A mashup combines different geospatial themes over one area. Data integration combines the same theme over different (adjacent) areas.
  • 10.
  • 11. ADVANTAGE #1 “Well-behaved” problem Once source datasets are delivered, no further external inputs are needed Relatively easy to allocate personnel and budget to the task
  • 12. ADVANTAGE #2 True integration is possible (in theory) Rubber sheeting and edgematching eliminate spatial “gaffs” (slivers, overlaps) Common data model facilitates analysis and querying
  • 13. ADVANTAGE #3 Republishing is relatively easy Integrator can make data available in a variety of formats
  • 14. DISADVANTAGE #1 Data producers provide copy of dataset Issues: • Data sharing arrangements • Loss of local control over data • Possible quality decline due to spatial and/or attribute adjustments
  • 15. DISADVANTAGE #2 Integrated data may not be current Depends on time it takes to perform integration, plus volatility of the layer Re-integrating updated data is frequently costly (so often never happens)
  • 16. DISADVANTAGE #3 Curating integrated datasets is increasingly impractical Large data volumes (“big data”) More frequent updates, data collection
  • 17. Need a solution that incorporates distributed access, visualization, analysis and querying
  • 18.
  • 20. PROCESS Dear <<LIO>>, This email is to inform you of a joint research project by the State Cartographers Office (SCO) at UW-Madison and the Department of Geography and Anthropology at UW-Eau Claire. The purpose of our project is to investigate the feasibility of using Web map services to create a statewide view of geospatial data collected and maintained at the county level. Supported and Our initial goal is to incorporate existing map services showing tax parcels into a single facilitated by LION online map application. We have chosen parcel data for this initial test because this type of data is of interest to a wide range of users. However, our project has a broader purpose, namely to explore how Web map services can be used to support virtual data integration for simple mapping and display. Specific research questions we will be investigating include: - How much flexibility exists to resymbolize map services from different counties? Can we Contacted stakeholders apply a common set of map symbols to different services to make the integrated map look more consistent? - What are the limitations on querying and analysis, given that data models and attributes (county LIOs) via email are not consistent from county to county? What implications does this have for data standards? - How much of an issue is performance? Are there performance improvements that can be implemented? - Can we integrate commercial and open-source services in a single Web application? Gathered REST URL Since our approach makes use of existing Web map services, we do not need to ask for copies of your geospatial datasets. Instead, we will simply be tapping into existing services (or other URL) that are already available on the Web. This also means that any map that includes your county's data will be up-to-date and accurate. We do have one request. We would greatly appreciate your assistance by providing the URL of your parcel data Web service. For most counties, this will be an ArcGIS Server REST endpoint of the form: Followed up in person https://<host>/ArcGIS/rest/services or by phone We are also interested in other types of services -- such as ArcIMS, WMS, etc. If you have such a service, we would appreciate your help identifying its URL. To provide us with your URL, simply reply to this email or to one of the email addresses listed below. So that we can keep on schedule for our project, we would greatly appreciate a response by May 1, 2012. Please let us know in your email response if you have any conditions or terms associated
  • 21. REST ENDPOINTS Representational State Transfer A communications protocol for the Web http://example.wi.us/arcgis/rest/services Once a service is published through ArcMap to ArcGIS Server it is visible at the REST URL
  • 22. EXAMPLE REST SERVICES DIRECTORY EXAMPLE
  • 23. STATUS Most counties use Esri ArcGIS Server (REST) ArcIMS still widely used (but, migrating) Small number of counties using Open Source technology
  • 25. SOME EXAMPLES Waupaca Outagamie County County County Line REST Services
  • 26. SOME EXAMPLES Waupaca Outagamie County County County Line
  • 27. SOME EXAMPLES Washington County Ozaukee County Popup Waukesha Milwaukee County County
  • 29. PERFORMANCE Many county REST services designed for internal access or occasional citizen use Impact on these users if site usage increased significantly? One of the reasons we are not releasing a public-access viewer at this time
  • 30. SERVICE AVAILABILITY Services can be added, removed, or modified Affects where the map viewer points to the data Services may also go off-line Virtually no control over these changes
  • 31. SERVICE AVAILABILITY Map service not responding
  • 32. SERVICE AVAILABILITY Map service unavailable
  • 33. RESYMBOLIZATION Need to control symbol color and size Also need to control zoom levels where features appear and disappear Relatively easy to do, but little consistency or standardization between counties
  • 34. DISTRIBUTED QUERYING How to query across multiple datasets with different schemas A big research issue (“semantic web”) “Distributed query” or “federated search” user  query  subqueries to participating data sources  aggregation of query results
  • 35.
  • 36. LEGAL ISSUES Opens up new legal issues Data readily incorporated into any mashup for any purpose Loss of control over data How will local governments react to this new technology?
  • 38. WHO BENEFITS FROM INTEGRATED DATA? Geospatial professionals • Demonstrate ROI for cost of geospatial services • Model a successful data integration scenario Counties • Active participants in an effort that will have impacts beyond county boundaries Citizens and taxpayers • Maximizing utilization of taxpayer investments • Obtaining greater benefits • More effective and efficient governance!
  • 39. BENEFITS OF STUDY Education about GIS Web services Forward-looking way of thinking about data integration Challenges and solutions to this new approach Standards and best practices for Web services
  • 40. THANK YOU! Howard Veregin, veregin@wisc.edu Brenda Hemstead, hemstead@wisc.edu Martin Goettl, goettlm@uwec.edu Photos by UW-Madison, University Communications Geology Lab Michael Forster Rothbart/University of Wisconsin-Madison/2003 Globe Jeff Miller/University of Wisconsin-Madison/2011 Community Engagement Jeff Miller/University of Wisconsin-Madison/2009 Jeopardy Bryce Richter/University of Wisconsin-Madison/2008 All photos © Board of Regents of the University of Wisconsin System Other photos VIIRS Suomi Earth Image Norman Kuring/NASA/NOAA/GSFC/Suomi NPP/VIIRS