SlideShare a Scribd company logo
In Cooperation with the New Mexico Interstate Stream Commission (NMISC)

    Building a Water-Resources
    Geodatabase for the Rio Grande Basin
    – San Acacia, New Mexico to Fort
    Quitman, Texas
    Thomas E. Burley, GISP
    USGS Texas Water Science Center – Austin, TX

    2011 Texas GIS Forum – Austin, TX



U.S. Department of the Interior
U.S. Geological Survey
Overview – Need and Significance

 Data collected for middle Rio Grande Basin for variety of
  purposes over several decades by numerous agencies,
  researchers, and organizations
 Previous attempts to compile these data have not been
  complete or done in a way that could be repeated
 A well-organized and usable database is needed to
  identify management priorities and facilitate hydrologic
  studies
Hydrologic Geodatabase Overview

   Data organized into a comprehensive spatially-
    enabled relational database (geodatabase)
   Stores spatial and tabular data for area of interest
    from multiple sources
   Data can be queried and/or viewed spatially to assist
    in identifying data gaps, conduct spatial analysis, and
    support decision-making
Rio Grande Basin – San Acacia, New
       Mexico to Fort Quitman, Texas

   Surface-water catchments
    encompass approximate
    extents of underlying aquifers
    of interest
   Surface-water catchments
    used to geographically filter
    physical sites and associated
    data from sources with larger
    spatial delivery extents
Data Sources and Types
 Hard-copy reports, previous data compilations, and
  various collecting entities
 Updated web-accessible raw data sources such as USGS
  NWIS, EPA STORET and state environmental agencies,
  many current through day of download
 Surface-water discharges, ground-water elevations, and
  water-quality data (daily and instantaneous)
Data Complexity: Making Sense of it All
Compilation Methods and Tools
 Data pre-processing scripts stage raw data for loading (e.g.,
  separate source files with site/sample/result/parameter tables)
 Loaders query data from staged source files
   • Facilitate maintenance and updates
   • Document how table fields were mapped from source files to final compiled
      geodatabase

 Methods scalable for a variety of hydrologic studies (data types,
  data size)
   • 24 distinct data sources
   • Of those, 10 are pre-existing compilations or raw data aggregation efforts
      such as EPA STORET which contain data from one or more collecting
      entities
Data Pre-Processing Scripts
 Import and format data from raw downloaded files into one
  “staged” relational database per source
 Scripts help clean data to ensure data integrity
   •   Remove extraneous non-printable characters
   •   Remove extra spaces
   •   Date formatting (MM/DD/YYYY)
   •   Separate multiple data types from one field (e.g., result values with
       comments) into separate fields

 Repeatable script programs (VBScript, VBA) with code
  comments as documentation help ensure data consistency
  and reduce human error
Data Compilation Loaders

   Load data into compilation database from source “staged”
    databases
   Cross-walks source file table fields with compilation table
    fields
   Functions as process documentation; customizable for
    each source
   Repeatable and consistent – helps reduce human error
Data Management Challenges:
           The Devil is in the Details
 Source compilation relational databases – database design
  and data integrity issues
 Site identification (Site ID’s): different ID’s & names for the
  same physical location on the ground
 Duplicate data
 Data recovery efforts and methods used
 Null values vs. zero; result value rounding
 Little or no metadata in most cases
Direct Benefits to Researchers

                      Multiple agencies’ data
                       managed in one location
                      Record-level metadata to
Relevant Data Only     document collecting agencies
                       and data sources (not always
                       the same)
                      One comprehensive relational
                       geodatabase as opposed to
                       scattered records stored as flat
                       files in spreadsheets
Direct Benefits to Researchers (cont.)
 Data can be limited to
  just relevant
  parameters/sites using
  traditional database
  queries via Structured
  Query Language (SQL)
  and/or spatial selections
  in a GIS
 Data enhanced for map
  production and spatial
  and temporal analysis
Summary
   Usability of source data greatly enhanced
   Facilitates identification of data gaps – spatial,
    temporal, and thematic
   Multitude of data stored in a well-documented format
    that can be readily updated
   Sound data management helps support sound science
    – quality information can only be derived from quality
    data
Questions?
                      Thomas E. Burley
                 Texas Water Science Center
                   U.S. Geological Survey
                     teburley@usgs.gov

Associated Publication:
Burley, T.E., 2010, Usage and administration manual for a geodatabase compendium of
   water-resources data—Rio Grande Basin from the Rio Arriba-Sandoval County line,
   New Mexico, to Presidio, Texas, 1889–2009: U.S. Geological Survey Open-File
   Report 2010–1331, 62 p. Available from http://pubs.usgs.gov/of/2010/1331/

More Related Content

Similar to Building a water resources geodatabase for the rio grande basin

2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)Rudolf Husar
 
Srds Pres011120
Srds Pres011120Srds Pres011120
Srds Pres011120
Rudolf Husar
 
Database Management Systems - Management Information System
Database Management Systems - Management Information SystemDatabase Management Systems - Management Information System
Database Management Systems - Management Information System
Nijaz N
 
Dats nih-dccpc-kc7-april2018-prs-uoxf
Dats  nih-dccpc-kc7-april2018-prs-uoxfDats  nih-dccpc-kc7-april2018-prs-uoxf
Dats nih-dccpc-kc7-april2018-prs-uoxf
Philippe Rocca-Serra
 
Brislinger, Recker: Keeping data re-usable in the evs
Brislinger, Recker: Keeping data re-usable in the evsBrislinger, Recker: Keeping data re-usable in the evs
Brislinger, Recker: Keeping data re-usable in the evs
GESIS - Leibniz-Institut für Sozialwissenschaften
 
Alive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values StudyAlive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values Study
CESSDA Training
 
31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax
cmspinto
 
31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifaxcmspinto
 
TYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
TYBSC IT PGIS Unit II Chapter I Data Management and Processing SystemsTYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
TYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
Arti Parab Academics
 
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRISCombining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Anastasija Nikiforova
 
GPS to GIS Emergency Mapping
GPS to GIS Emergency MappingGPS to GIS Emergency Mapping
GPS to GIS Emergency Mapping
rmikol
 
Data base
Data baseData base
Relational database revised
Relational database revisedRelational database revised
Relational database revisedmnodalo
 
A hierarchical tensor based approach to compressing, updating and querying ge...
A hierarchical tensor based approach to compressing, updating and querying ge...A hierarchical tensor based approach to compressing, updating and querying ge...
A hierarchical tensor based approach to compressing, updating and querying ge...
ieeepondy
 
FINAL LESSON 3--GIS-Overview of GIS.pptx
FINAL LESSON 3--GIS-Overview of GIS.pptxFINAL LESSON 3--GIS-Overview of GIS.pptx
FINAL LESSON 3--GIS-Overview of GIS.pptx
ChristianMatas2
 
Geographic information systems (gis) for libraries
Geographic information systems (gis) for librariesGeographic information systems (gis) for libraries
Geographic information systems (gis) for libraries
Seti Keshmiripour
 
6.2 software
6.2 software6.2 software
EcoInformatics FRS Presentation - Discussion 20101206
EcoInformatics FRS Presentation - Discussion 20101206EcoInformatics FRS Presentation - Discussion 20101206
EcoInformatics FRS Presentation - Discussion 20101206
Dave Smith / USEPA Office of Environmental Information
 
Semantics-enhanced Geoscience Interoperability, Analytics, and Applications
Semantics-enhanced Geoscience Interoperability, Analytics, and ApplicationsSemantics-enhanced Geoscience Interoperability, Analytics, and Applications
Semantics-enhanced Geoscience Interoperability, Analytics, and Applications
Artificial Intelligence Institute at UofSC
 

Similar to Building a water resources geodatabase for the rio grande basin (20)

2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)2004-11-13 Supersite Relational Database Project: (Data Portal?)
2004-11-13 Supersite Relational Database Project: (Data Portal?)
 
Srds Pres011120
Srds Pres011120Srds Pres011120
Srds Pres011120
 
Database Management Systems - Management Information System
Database Management Systems - Management Information SystemDatabase Management Systems - Management Information System
Database Management Systems - Management Information System
 
Dats nih-dccpc-kc7-april2018-prs-uoxf
Dats  nih-dccpc-kc7-april2018-prs-uoxfDats  nih-dccpc-kc7-april2018-prs-uoxf
Dats nih-dccpc-kc7-april2018-prs-uoxf
 
Brislinger, Recker: Keeping data re-usable in the evs
Brislinger, Recker: Keeping data re-usable in the evsBrislinger, Recker: Keeping data re-usable in the evs
Brislinger, Recker: Keeping data re-usable in the evs
 
Alive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values StudyAlive and kicking! Keeping data re-usable in the European Values Study
Alive and kicking! Keeping data re-usable in the European Values Study
 
Dbms9
Dbms9Dbms9
Dbms9
 
31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax
 
31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax31 E30 Eco System Concept Halifax
31 E30 Eco System Concept Halifax
 
TYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
TYBSC IT PGIS Unit II Chapter I Data Management and Processing SystemsTYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
TYBSC IT PGIS Unit II Chapter I Data Management and Processing Systems
 
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRISCombining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
Combining Data Lake and Data Wrangling for Ensuring Data Quality in CRIS
 
GPS to GIS Emergency Mapping
GPS to GIS Emergency MappingGPS to GIS Emergency Mapping
GPS to GIS Emergency Mapping
 
Data base
Data baseData base
Data base
 
Relational database revised
Relational database revisedRelational database revised
Relational database revised
 
A hierarchical tensor based approach to compressing, updating and querying ge...
A hierarchical tensor based approach to compressing, updating and querying ge...A hierarchical tensor based approach to compressing, updating and querying ge...
A hierarchical tensor based approach to compressing, updating and querying ge...
 
FINAL LESSON 3--GIS-Overview of GIS.pptx
FINAL LESSON 3--GIS-Overview of GIS.pptxFINAL LESSON 3--GIS-Overview of GIS.pptx
FINAL LESSON 3--GIS-Overview of GIS.pptx
 
Geographic information systems (gis) for libraries
Geographic information systems (gis) for librariesGeographic information systems (gis) for libraries
Geographic information systems (gis) for libraries
 
6.2 software
6.2 software6.2 software
6.2 software
 
EcoInformatics FRS Presentation - Discussion 20101206
EcoInformatics FRS Presentation - Discussion 20101206EcoInformatics FRS Presentation - Discussion 20101206
EcoInformatics FRS Presentation - Discussion 20101206
 
Semantics-enhanced Geoscience Interoperability, Analytics, and Applications
Semantics-enhanced Geoscience Interoperability, Analytics, and ApplicationsSemantics-enhanced Geoscience Interoperability, Analytics, and Applications
Semantics-enhanced Geoscience Interoperability, Analytics, and Applications
 

More from Texas Natural Resources Information System

From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...Texas Natural Resources Information System
 
Early warning forecast of an oil spill bp deepwater horizon in the gulf
Early warning forecast of an oil spill bp deepwater horizon in the gulfEarly warning forecast of an oil spill bp deepwater horizon in the gulf
Early warning forecast of an oil spill bp deepwater horizon in the gulf
Texas Natural Resources Information System
 
We are the music makers and we are the dreamers of dreams
We are the music makers and we are the dreamers of dreamsWe are the music makers and we are the dreamers of dreams
We are the music makers and we are the dreamers of dreams
Texas Natural Resources Information System
 
Volunteered geographic information (vgi) for the national map
Volunteered geographic information (vgi) for the national mapVolunteered geographic information (vgi) for the national map
Volunteered geographic information (vgi) for the national map
Texas Natural Resources Information System
 
Uav image recognition technology and applications
Uav image recognition technology and applicationsUav image recognition technology and applications
Uav image recognition technology and applications
Texas Natural Resources Information System
 
Texas high water marks crowd sourcing history, culture, and geography
Texas high water marks   crowd sourcing history, culture, and geographyTexas high water marks   crowd sourcing history, culture, and geography
Texas high water marks crowd sourcing history, culture, and geography
Texas Natural Resources Information System
 

More from Texas Natural Resources Information System (20)

Txgio presentation rgsm_gps_pearson_062012
Txgio presentation rgsm_gps_pearson_062012Txgio presentation rgsm_gps_pearson_062012
Txgio presentation rgsm_gps_pearson_062012
 
Usslsc cgsic regional austin 061312
Usslsc cgsic regional austin 061312Usslsc cgsic regional austin 061312
Usslsc cgsic regional austin 061312
 
Using gps technology at the texas general land
Using gps technology at the texas general landUsing gps technology at the texas general land
Using gps technology at the texas general land
 
Ussls austin civil utility - klein - 061312 - final
Ussls austin   civil utility - klein - 061312 - finalUssls austin   civil utility - klein - 061312 - final
Ussls austin civil utility - klein - 061312 - final
 
Tx dot gps applications fuegner
Tx dot gps applications   fuegnerTx dot gps applications   fuegner
Tx dot gps applications fuegner
 
Tnris 2012
Tnris 2012Tnris 2012
Tnris 2012
 
Nmc ussls charter 2012
Nmc ussls charter 2012Nmc ussls charter 2012
Nmc ussls charter 2012
 
Nationwide dgps (ndgps) lt mendoza
Nationwide dgps (ndgps)   lt mendozaNationwide dgps (ndgps)   lt mendoza
Nationwide dgps (ndgps) lt mendoza
 
Lyle tamucc 2
Lyle tamucc 2Lyle tamucc 2
Lyle tamucc 2
 
Dirks cgsic brief 2012
Dirks cgsic brief 2012Dirks cgsic brief 2012
Dirks cgsic brief 2012
 
Connected vehicle highway network applications
Connected vehicle highway network applicationsConnected vehicle highway network applications
Connected vehicle highway network applications
 
Cgsic presentation humphreys
Cgsic presentation humphreysCgsic presentation humphreys
Cgsic presentation humphreys
 
Cgsic navcen
Cgsic navcenCgsic navcen
Cgsic navcen
 
Gnss international policy regional cgsic (austin - jun2012)
Gnss international policy   regional cgsic (austin - jun2012)Gnss international policy   regional cgsic (austin - jun2012)
Gnss international policy regional cgsic (austin - jun2012)
 
From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...From creekology to rocket science the evolution of remote sensing gis in oilg...
From creekology to rocket science the evolution of remote sensing gis in oilg...
 
Early warning forecast of an oil spill bp deepwater horizon in the gulf
Early warning forecast of an oil spill bp deepwater horizon in the gulfEarly warning forecast of an oil spill bp deepwater horizon in the gulf
Early warning forecast of an oil spill bp deepwater horizon in the gulf
 
We are the music makers and we are the dreamers of dreams
We are the music makers and we are the dreamers of dreamsWe are the music makers and we are the dreamers of dreams
We are the music makers and we are the dreamers of dreams
 
Volunteered geographic information (vgi) for the national map
Volunteered geographic information (vgi) for the national mapVolunteered geographic information (vgi) for the national map
Volunteered geographic information (vgi) for the national map
 
Uav image recognition technology and applications
Uav image recognition technology and applicationsUav image recognition technology and applications
Uav image recognition technology and applications
 
Texas high water marks crowd sourcing history, culture, and geography
Texas high water marks   crowd sourcing history, culture, and geographyTexas high water marks   crowd sourcing history, culture, and geography
Texas high water marks crowd sourcing history, culture, and geography
 

Recently uploaded

Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...
ThomasParaiso2
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
Kari Kakkonen
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Nexer Digital
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
mikeeftimakis1
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
Rohit Gautam
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
nkrafacyberclub
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
DianaGray10
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
Neo4j
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
Neo4j
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
Neo4j
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 

Recently uploaded (20)

Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...GridMate - End to end testing is a critical piece to ensure quality and avoid...
GridMate - End to end testing is a critical piece to ensure quality and avoid...
 
Climate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing DaysClimate Impact of Software Testing at Nordic Testing Days
Climate Impact of Software Testing at Nordic Testing Days
 
Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?Elizabeth Buie - Older adults: Are we really designing for our future selves?
Elizabeth Buie - Older adults: Are we really designing for our future selves?
 
Introduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - CybersecurityIntroduction to CHERI technology - Cybersecurity
Introduction to CHERI technology - Cybersecurity
 
Large Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial ApplicationsLarge Language Model (LLM) and it’s Geospatial Applications
Large Language Model (LLM) and it’s Geospatial Applications
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptxSecstrike : Reverse Engineering & Pwnable tools for CTF.pptx
Secstrike : Reverse Engineering & Pwnable tools for CTF.pptx
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1Communications Mining Series - Zero to Hero - Session 1
Communications Mining Series - Zero to Hero - Session 1
 
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
GraphSummit Singapore | Neo4j Product Vision & Roadmap - Q2 2024
 
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
GraphSummit Singapore | The Future of Agility: Supercharging Digital Transfor...
 
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024GraphSummit Singapore | The Art of the  Possible with Graph - Q2 2024
GraphSummit Singapore | The Art of the Possible with Graph - Q2 2024
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 

Building a water resources geodatabase for the rio grande basin

  • 1. In Cooperation with the New Mexico Interstate Stream Commission (NMISC) Building a Water-Resources Geodatabase for the Rio Grande Basin – San Acacia, New Mexico to Fort Quitman, Texas Thomas E. Burley, GISP USGS Texas Water Science Center – Austin, TX 2011 Texas GIS Forum – Austin, TX U.S. Department of the Interior U.S. Geological Survey
  • 2. Overview – Need and Significance  Data collected for middle Rio Grande Basin for variety of purposes over several decades by numerous agencies, researchers, and organizations  Previous attempts to compile these data have not been complete or done in a way that could be repeated  A well-organized and usable database is needed to identify management priorities and facilitate hydrologic studies
  • 3. Hydrologic Geodatabase Overview  Data organized into a comprehensive spatially- enabled relational database (geodatabase)  Stores spatial and tabular data for area of interest from multiple sources  Data can be queried and/or viewed spatially to assist in identifying data gaps, conduct spatial analysis, and support decision-making
  • 4. Rio Grande Basin – San Acacia, New Mexico to Fort Quitman, Texas  Surface-water catchments encompass approximate extents of underlying aquifers of interest  Surface-water catchments used to geographically filter physical sites and associated data from sources with larger spatial delivery extents
  • 5. Data Sources and Types  Hard-copy reports, previous data compilations, and various collecting entities  Updated web-accessible raw data sources such as USGS NWIS, EPA STORET and state environmental agencies, many current through day of download  Surface-water discharges, ground-water elevations, and water-quality data (daily and instantaneous)
  • 6. Data Complexity: Making Sense of it All
  • 7. Compilation Methods and Tools  Data pre-processing scripts stage raw data for loading (e.g., separate source files with site/sample/result/parameter tables)  Loaders query data from staged source files • Facilitate maintenance and updates • Document how table fields were mapped from source files to final compiled geodatabase  Methods scalable for a variety of hydrologic studies (data types, data size) • 24 distinct data sources • Of those, 10 are pre-existing compilations or raw data aggregation efforts such as EPA STORET which contain data from one or more collecting entities
  • 8. Data Pre-Processing Scripts  Import and format data from raw downloaded files into one “staged” relational database per source  Scripts help clean data to ensure data integrity • Remove extraneous non-printable characters • Remove extra spaces • Date formatting (MM/DD/YYYY) • Separate multiple data types from one field (e.g., result values with comments) into separate fields  Repeatable script programs (VBScript, VBA) with code comments as documentation help ensure data consistency and reduce human error
  • 9. Data Compilation Loaders  Load data into compilation database from source “staged” databases  Cross-walks source file table fields with compilation table fields  Functions as process documentation; customizable for each source  Repeatable and consistent – helps reduce human error
  • 10. Data Management Challenges: The Devil is in the Details  Source compilation relational databases – database design and data integrity issues  Site identification (Site ID’s): different ID’s & names for the same physical location on the ground  Duplicate data  Data recovery efforts and methods used  Null values vs. zero; result value rounding  Little or no metadata in most cases
  • 11. Direct Benefits to Researchers  Multiple agencies’ data managed in one location  Record-level metadata to Relevant Data Only document collecting agencies and data sources (not always the same)  One comprehensive relational geodatabase as opposed to scattered records stored as flat files in spreadsheets
  • 12. Direct Benefits to Researchers (cont.)  Data can be limited to just relevant parameters/sites using traditional database queries via Structured Query Language (SQL) and/or spatial selections in a GIS  Data enhanced for map production and spatial and temporal analysis
  • 13. Summary  Usability of source data greatly enhanced  Facilitates identification of data gaps – spatial, temporal, and thematic  Multitude of data stored in a well-documented format that can be readily updated  Sound data management helps support sound science – quality information can only be derived from quality data
  • 14. Questions? Thomas E. Burley Texas Water Science Center U.S. Geological Survey teburley@usgs.gov Associated Publication: Burley, T.E., 2010, Usage and administration manual for a geodatabase compendium of water-resources data—Rio Grande Basin from the Rio Arriba-Sandoval County line, New Mexico, to Presidio, Texas, 1889–2009: U.S. Geological Survey Open-File Report 2010–1331, 62 p. Available from http://pubs.usgs.gov/of/2010/1331/