Kristin Fishburn & Andy Stauffer

1. Change Detection Research for
The National Map
National Geospatial Technical Operations Center
GeCo in the Rockies Conference: 24 September 2014
Kristin Fishburn Andy Stauffer
kafishburn@usgs.gov astauffer@usgs.gov
(303) 202-4405 (303) 202-4534

2. GeCo in the Rockies 2014 24 Sept 2014
Change Detection: Scope and Objectives
Research into vector based change detection to help minimize data maintenance
expenditures for The National Map (TNM) vector Levels-of-Detail (LoDs) and derived
products and services
• US Topo Maps
• 1:1M-scale data / 100K-scale data
• Vector Staged Products
• TNM Viewer map cache and other products and services (TBD)
Evaluation of coarse change data sources
• Support for data acquisition
• Support for change identification on-the-ground

3. GeCo in the Rockies 2014 24 Sept 2014
Change Detection: Concept of Operations

4. GeCo in the Rockies 2014 24 Sept 2014
Change Detection: Concept of Operations

5. GeCo in the Rockies 2014 24 Sept 2014
Example: FCode Change
3600 (Canal/Ditch) -> 44800 (Artificial Path)
Attribute change does NOT drive symbology change
33600 (Canal/Ditch) -> 46003 (Intermittent River)
Attribute change DOES drive symbology change
Change Detection: Concept of Operations

6. GeCo in the Rockies 2014 24 Sept 2014
Vector Staged Products
• Pre-packaged, staged for download
(ArcGIS format)
• Various footprints
• 7.5-minute
• 1-degree cells
• hydrographic units
• state
• Approximately 75,000 total products
• Boundaries
• High Resolution Hydrography
• Medium Resolution Hydrography
• Watershed Boundaries
• Elevation Contours
• Map Indices
• Geographic Names
• Structures
• Transportation
• Woodland
• Combined
TNM Derived Data and Products
US Topo Maps
• Digital USGS Topographic Map Product
• Modeled on standard 7.5-min quads
• Layered GeoPDF®
• Orthoimage base
• Core feature layers
• 3-year production cycle
• Approximately 65,000 total maps
• 18,000 produced / revised each year
• Download free on the Web
1:1M-scale (Formerly National Atlas base data)
• County Boundaries
• State Boundaries
• National Boundaries
• Cities and Towns
• Coastline
• Gaging Stations
• Streams
• Waterbodies
• Airports
• Ferries
• Port Facilities
• Railroads
• Rail and Bus Stations
• Roads

7. GeCo in the Rockies 2014 24 Sept 2014
Staged Products
???
US Topo Maps
LoDs
V.D. Date
<
last run
date?
Track Table
(Dirty Date and
Refresh Date)
Sort by
Product /Service
Examine dates to
flag product for
updates
STEP 2: Refresh Tools
Add to
Queue
????
Threshold
Change
Detection
Flag Feature Class
as Changed
SDE Database
A
SDE Database
B
Version
Difference Log
Feature Class 1
Version
Difference Log
Feature Class 2
Version
Difference Log
Feature Class n
START: Change Detection Tools
For each flagged
Log File
Relate FCs into
Deliverable
Extract Log File
Change Features
Subset footprints
in PCFP
Intersect footprints
with Changed
Features
Update product
Dirty Dates to
current time
Track Table
(Footprint Type)
STEP 1: Parser Tools
Define and apply product-specific requirements
Push
product restage
to Track Table
Update Dirty Dates
Update Restage Date
with Date Estimate
Update Restage Date
PtoR Sync
Feature Class
To
Product / Service
For each product / service
If Change Exists
Change Detection Workflow

8. GeCo in the Rockies 2014 24 Sept 2014
VersionDiff_NHDArea_high
Change Detection Tools: Version Difference Feature Class Log

9. GeCo in the Rockies 2014 24 Sept 2014
Staged Products
???
US Topo Maps
LoDs
V.D. Date
<
last run
date?
Track Table
(Dirty Date and
Refresh Date)
Sort by
Product /Service
Examine dates to
flag product for
updates
STEP 2: Refresh Tools
Add to
Queue
????
Threshold
Change
Detection
Flag Feature Class
as Changed
SDE Database
A
SDE Database
B
Version
Difference Log
Feature Class 1
Version
Difference Log
Feature Class 2
Version
Difference Log
Feature Class n
START: Change Detection Tools
For each flagged
Log File
Relate FCs into
Deliverable
Extract Log File
Change Features
Subset footprints
in PCFP
Intersect footprints
with Changed
Features
Update product
Dirty Dates to
current time
Track Table
(Footprint Type)
STEP 1: Parser Tools
Define and apply product-specific requirements
Push
product restage
to Track Table
Update Dirty Dates
Update Restage Date
with Date Estimate
Update Restage Date
PtoR Sync
Feature Class
To
Product / Service
For each product / service
If Change Exists
Change Detection Workflow

10. GeCo in the Rockies 2014 24 Sept 2014
Parser Tools: Intersect Changed Features w/ Product Footprints
VersionDiff_NHDFlowlines_high
Product Catalog Requirements Lookup
Footprint Polygon FC(s)

11. GeCo in the Rockies 2014 24 Sept 2014
Staged Products
???
US Topo Maps
LoDs
V.D. Date
<
last run
date?
Track Table
(Dirty Date and
Refresh Date)
Sort by
Product /Service
Examine dates to
flag product for
updates
STEP 2: Refresh Tools
Add to
Queue
????
Threshold
Change
Detection
Flag Feature Class
as Changed
SDE Database
A
SDE Database
B
Version
Difference Log
Feature Class 1
Version
Difference Log
Feature Class 2
Version
Difference Log
Feature Class n
START: Change Detection Tools
For each flagged
Log File
Relate FCs into
Deliverable
Extract Log File
Change Features
Subset footprints
in PCFP
Intersect footprints
with Changed
Features
Update product
Dirty Dates to
current time
Track Table
(Footprint Type)
STEP 1: Parser Tools
Define and apply product-specific requirements
Push
product restage
to Track Table
Update Dirty Dates
Update Restage Date
with Date Estimate
Update Restage Date
PtoR Sync
Feature Class
To
Product / Service
For each product / service
If Change Exists
Change Detection Workflow

12. GeCo in the Rockies 2014 24 Sept 2014
Parser Tools: Send to Refresh Tools

13. GeCo in the Rockies 2014 24 Sept 2014
• Study area: The entire nation
• Study period: May 8 – July 14 (67 days)
• No. of footprints (FPs) w/ 7 day refresh requirement: 73,210
• No. of refresh cycles over study period: 9
Total: FPs times refresh cycles (73,210 x 9): 658,890
• No. of changed features (from 20 feature classes): 5,043,669
• No. of FPs flagged for updates through 9 cycles: 96,677
• Total run time for Parser Tools over study period: 5hr 36min
• Percent of total FPs needed to be refreshed 14.7%
Change Detection: Case Study Results - Vector Staged Products

14. GeCo in the Rockies 2014 24 Sept 2014
• Continue work with threshold Change Detection
– Will an attribution change cause a change to the symbology or
label on a US Topo map?
– Will a geometric change be significant enough to be detectable
on a map at scale (24K)?
• Define threshold requirements
– Extend to other products and services (US Topo maps, LoD, etc.)
• Define aggregate change requirements
– How much data must change within a map before it needs to be
updated?
• Within a feature class?
• Across multiple feature classes?
Change Detection: Continued Work

15. GeCo in the Rockies 2014 24 Sept 2014
Change Detection: Application to US Topo Maps and 1:1M-scale data
US Topo Maps
• More than 65,000 US Topo maps cover all U.S. states and territories
• Approximately 18,000 US Topo maps are currently produced / revised each year
• Content enhancements (new feature additions) anticipated to continue through
2018
• Third three-year production cycle will be completed in 2018
• Change detection can reduce the number of maps that need to be revised each year
• Focus resources
• Areas where certain types of change is occurring
• Areas where change is occurring rapidly
• Change the 3-year cycle to a tailored revision cycle per map, according to change
information
1:1M-scale datasets
• Change detection can reduce resources required to revise datasets
• Update cycle is currently 5-years for the nation
• Change to a tailored revision cycle per feature class and per designated AOI (e.g.
county / state) according to change information

16. Questions?
Kristin Fishburn Andy Stauffer
kafishburn@usgs.gov astauffer@usgs.gov
(303) 202-4405 (303) 202-4534

17. Backup
Kristin Fishburn Andy Stauffer
kafishburn@usgs.gov astauffer@usgs.gov
(303) 202-4405 (303) 202-4534

18. GeCo in the Rockies 2014 24 Sept 2014
US Topo Maps Content
Content added: 2009, 2010, 2011, 2012, 2013, 2014
Ortho-rectified Aerial Imagery
Roads
Names
Elevation Contours
Hydrography
State/County/USFS Boundaries
Runways
Woodland
Railroads
PLSS
Fire Stations
Hospitals
Schools
Military Boundaries
Cemeteries
Post Offices
Shaded Relief
Trails
FWS Boundaries
State Capitals
Police Stations
Correctional Facilities

19. GeCo in the Rockies 2014 24 Sept 2014
US Topo Maps Work Plan