Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies

584
-1

Published on

Walter Simonazzi and Christopher Brown.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
584
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
22
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Ozri 2013 Brisbane, Australia - Geodatabase Efficiencies

  1. 1. Geodatabase Efficiencies Walter Simonazzi & Christopher Brown
  2. 2. Agenda • Geodatabase design and how it can assist you • Geodatabase Storage and Migration • Versioning – When to use? – How to manage • Geodatabase Replication • Performance and Maintenance
  3. 3. Department of Spatial Awareness Dave • New Spatial Data Administrator • Existing Organisation Planning Operations Media
  4. 4. Department of Spatial Awareness Dave • Lots of Corporate Data stored in “silo’s” • A lot of project data stored on peoples computers • No specified data standards • The data has been stored in SDE – Where no one knows what is there – Everyone complains about poor performance
  5. 5. Department of Spatial Awareness What should Dave do now? • Identify the workflows in the organisation • Create a data governance document – What do the users need to do to make the data useful to the organisation • • • • Create a Data Model Import the data into the new data model Setup an edit workflow Manage the ongoing performance of the Database
  6. 6. What’s in a geodatabase design? GIS behavior Rules Tools Elements Single-user Multiuser Geodatabase
  7. 7. Geodatabase functionality Default attribute values Subtypes Single-user Multiuser Attribute domains Attachments Relationship classes Topology
  8. 8. Workflow: From design to prototype Design the geodatabase Obtain schema Modify schema Add data Prototype geodatabase
  9. 9. What should Dave do next? • Speak to Barry • Barry is the Corporate DBA – It is Barry’s job to make sure that the databases perform The key to Enterprise GIS is a collaboration between the business systems and the spatial architecture
  10. 10. Diagrammer & Case Tools (free tools) • ArcGIS Diagrammer is a productivity tool for GIS professionals to create, edit or analyze geodatabase schema. • Is a visual editor for Esri’s .xml Workspace Document • *Supports complex geodatabase elements such as topology and parcel fabrics http://www.arcgis.com/home/item.html?id=5af1723bab4e413bae63dd89daa87984
  11. 11. CDB If I build it, they will come ArcGIS Geodatabase and CASE Tools
  12. 12. What’s in the Geodatabase?
  13. 13. What’s in the Geodatabase?
  14. 14. What’s inside the Geodatabase?
  15. 15. What’s inside the Geodatabase? - Pre-configured table - 370 configuration parameters
  16. 16. ArcSDE and the DBTUNE table Client Translator Database Server Select… DBTUNE Repository
  17. 17. ArcSDE compressed binary • Better performance for advance geodatabase elements • Reduce the storage size in the RDBMS • Difficult to access with SQL commands and third party applications
  18. 18. Spatial field types • The default format in ArcSDE • Easy access with SQL operators and spatial functions.
  19. 19. Supported Storage types
  20. 20. Migrating spatial types Supported migration paths SQLServer • • SDE binary to Geometry SDE binary t Geography Oracle • • SDE binary to ST_Geometry SDO_Geometry to ST_Geometry
  21. 21. WS Put it in the bucket Storage and Migration
  22. 22. Like a Version D77 SDE_STATE_ID # DELETED_AT Unique object ID  Constant for all versions of a row # # SDE_DELETES_ROW_ID A77 SHAPE NAME OBJECTID SDE_STATE_ID Database state  Identifies when row was added CELL_TOWERS SHAPE 1 2 3 NAME Riverside NE Riverside SE Riverside W OBJECTID 1 2 3 SDE_STATE_ID 0 0 0
  23. 23. Like a Version - Adding D77 SDE_STATE_ID SDE_DELETES_ROW_ID DELETED_AT # # # # A77 SHAPE 4 NAME OBJECTID 4 SDE_STATE_ID 1 CELL_TOWERS SHAPE 1 2 3 NAME Riverside NE Riverside SE Riverside W OBJECTID 1 2 3 SDE_STATE_ID 0 0 0
  24. 24. Like a Version - Deleting D77 # # # SDE_STATE_ID 0 SDE_DELETES_ROW_ID 2 Created at state DELETED_AT 2 Deleted at state A77 SHAPE 4 NAME OBJECTID 4 SDE_STATE_ID 1 CELL_TOWERS SHAPE 1 2 3 NAME Riverside NE Riverside SE Riverside W OBJECTID 1 2 3 SDE_STATE_ID 0 0 0
  25. 25. Like a Version - Updating D77 # # Riverside Mid SDE_STATE_ID 0 1 SDE_DELETES_ROW_ID 2 4 DELETED_AT 2 3 # A77 SHAPE 4 4 NAME OBJECTID 4 Riverside Mid 4 SDE_STATE_ID 1 3 CELL_TOWERS SHAPE 1 2 3 NAME Riverside NE Riverside SE Riverside W OBJECTID 1 2 3 SDE_STATE_ID 0 0 0
  26. 26. Versioned Editing Performance • Performance affected by: 0 – Volume of states – Stale statistics – Unnecessary versions* – Proper workflow State 0 Version pinning v2 state tree • Manage your version – Reconcile – Post – Compress v1 v4 DEFAULT
  27. 27. To Version or not to Version
  28. 28. CDB Who’s afraid of the big bad version? Version Creation and Management
  29. 29. What is Geodatabase Replication? • Geodatabase replication allows you to create copies of data across two or more geodatabases and to keep data synchronized. • Geodatabase replication allows to replicate just the elements you want.
  30. 30. Three types of Replication PARENT CHILD Sync both directions Two-way One-way Sync one direction Check-out once Check-out/ check-in Check-in once
  31. 31. Preparing data for replication Data requirements Stored in high-precision spatial format Registered as fully versioned in 2wR (no move to base) Non-versioned or fully versioned in 1wR (no move to base) Must have global ids The database user must have write permission to the data
  32. 32. Create a Replica • Distributed Geodatabase toolbar • Create Replica tool • Arcpy
  33. 33. WS Replica versus Replicant Using Replication
  34. 34. No LAN/WAN between offices? Replication using Geodata services
  35. 35. Real time edits Use Replication to avoid service interruptions
  36. 36. Privileges • Data set privileges managed from ArcCatalog
  37. 37. Performance Bottlenecks Client interaction Network Server hardware DBMS/ ArcSDE ArcMap TCP/IP User interaction SQL Multiuser geodatabase Results presented SQL TCP/IP ArcMap DBMS server
  38. 38. Attribute indexes WHERE value > 10 Use Index
  39. 39. Spatial indexes Select by Location Use Spatial Index
  40. 40. Statistics Small table Full Table Scan Large table Use Index
  41. 41. Scheduling tasks Windows Scheduler Python Script arcpy.RebuildIndexes_management… arcpy.AnalyzeDatasets_management…
  42. 42. Responsibilities Dave Barry Compress Analyse Attribute Indexes Attribute Indexes Spatial Indexes Database Statistics
  43. 43. ALL Keep on Running Performance and Management Techniques
  44. 44. Summary • Design and maintain your geodatabase to support your business processes. • Every minute you spent thinking about the design of your geospatial database can save you hours of frustration. See you at the Booth * The view of the presenters is not always the views of anybody else
  45. 45. Training • Building Geodatabases • Configuring and Managing the Multiuser Geodatabase • Implementing Versioned Workflows in a Multiuser Geodatabase • Distributing Data using Geodatabase replication Training website http://esriaustralia.com.au/training
  46. 46. Other Resources • Come chat to us at the Industry Solution booth on the conference • ArcGIS Resources – Geodatabase Community http://resources.arcgis.com/en/communities/geodata/ • GIS Wiki http://wiki.gis.com/wiki/index.php/Main_Page • Esri Online Training Gateway http://training.esri.com/gateway/index.cfm
  47. 47. Questions? Thank you

×