CO Presentation on EcoData


Published on

This presentation by Candy Thompson from Colorado HMWMD discusses CO's efforts to share data and set up data standards. This presentation discusses why, who, what kind of data, and other issues regarding the "Data Monster."

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

CO Presentation on EcoData

  1. 1. ____________ EcoData
  2. 2. ECODATA Includes Participation by these Groups of CDPHE Hazardous Materials and Waste Management Division – Superfund/CERCLA – Hazardous Waste Sites RCRA – Solid Waste Landfills Water Quality Control Division – Waste Water Discharge (NPDES) – Drinking Water – Stream and Groundwater Classification and Monitoring Air Pollution Control Division – Stationary Sources of Air Pollution Consumer Protection Division – Limited Distribution Drinking Water Wells
  3. 3. VISION: TOWARDS TRANSPARENT GOVERNMENT Easily Share and Display Data Across: DIFFERENT DATABASES, and from: Federal Tribes State County City Industry Citizen Groups
  4. 4. Environmental Monitoring Data Includes: Laboratory and Field Analysis for Chemical Analytes, Flow, Water Levels, Biologic, etc. Media: Groundwater, Surface Water, Air, Soils, Drinking Water For: Ambient environmental conditions, regulatory compliance, site cleanup, etc.
  5. 5. Why Share Environmental Data Minimize costs of collecting data Allow Government to discern and focus on most pressing environmental problems Determine historic or baseline conditions in an area Map chemical contaminants across wider areas to determine exposure risks and communicate to the public More completely depict the environmental conditions in an area of interest
  6. 6. Currently Data Sharing is Nearly Impossible No methods to determine who has what data No common chemical/analyte parameter codes No common data format If pertinent data is found, 90% of the project manager’s time is spent manipulating and converting the data into a different system
  7. 7. THE DATA MONSTER Questionable Quality or Unknown Quality of Parameter Results No Standard Format of Data Little Use of Standard Coding for Parameters Inconsistent Spatial Projection Systems for Locations
  9. 9. Rocky Flats ArcIMS Web Mapping of Environmental Monitoring Data maps.asp
  10. 10. ECODATA Data Streamlining and Sharing Method at Colorado Dept. of Public Health and Environment (CDPHE) Transfer System for Environmental Monitoring Data Streamlines data input to storage databases from laboratory and field Streamlines output from databases for data sharing through common web interfaces
  11. 11. ECODATA PROMISE Save money for CDPHE and Regulated Community by creating one lab Electronic Data Deliverable (EDD) format across all environmental programs Create the ability to share data across the major databases Save time by minimizing data conversion to storage database Accommodates different databases, database models, and parameter coding
  12. 12. Streamlining Data Input and Sharing Based upon the concept that no matter for what media or purpose, all environmental monitoring sampling and analysis can be accommodated by one large electronic wrapper Sampling, Chain of Custody, and Laboratory procedures are all similar and can be accommodated by one Universal Electronic Data Deliverable (EDD) format
  13. 13. Current Situation
  14. 14. Solution
  15. 15. Universal Electronic Data Deliverable Format Based on study of all participating groups needs. Incorporates EPA Standards One standard list of reference values Expandable
  16. 16. EDD Electronic Data Deliverable Consists of - ROSETTA STONE - Universal Parameter Code Universal Parameter List includes 3500 Parameter codes based upon CAS ID, IRPMS, and EPA STORET ID in that order Acts as a translator between universal and program specific reference values. – Universal Data Element Mapping (Format) - Data Element Mapping creates one format accommodating the largest, most detailed needs for data, I.e., quality control (QC) for data qualification Across all participating databases
  17. 17. Universal EDD Format Includes XML or Comma delimited formats Location information Field Sampling information Laboratory Test information Field Readings information
  18. 18. Diagram of Program vs Universal Universal SAMS/EQuIS STORET PM10 PM2.5 SDWIS/State Fluoridation CPD
  19. 19. Next Steps Work with data providers to facilitate their submission of data in correct formats. Require submittal of formats for participating systems Expand deliverables to include geologic, water level formats, and others.
  20. 20. CDPHE EDD Based upon the EDD developed by EPA Region II and the EPA’s Environmental Data Registry - Chemical Identification Standard Includes data qualifiers (blanks, dups, lab batch, and instrument calibration) allowing data validation Expanded to include Air, Safe Drinking Water Information System (SDWIS), and Biological Data
  21. 21. HAT EDD USE REQUIRES Formatting a conversion from the EDD to underlying Database Can accept as few or as many elements/fields of the Universal EDD as applicable Although Lab format utilizes the Universal EDD format, Lab only analyzes and submits data requested for the sample
  22. 22. WHAT EDD USE REQUIRES, cont. Does not force changes in underlying databases Does require translation between Parameter List and the underlying database parameter nomenclature Same process can be used to extract and share data between underlying databases
  23. 23. Web Applications for Data Sharing A Universal EDD and the synchronization afforded across individual databases sets the stage to share environmental data across agencies, industry, and the public
  24. 24. Pacific Northwest Water Quality Data Exchange Data Access Application Oregon Idaho Data NODE Source .xml Data NODE .xml Source Host Data Catalog Database Internet Internet .xml .xml Washington Alaska Data Data NODE NODE Source Source .xml EPA STORET CDX Data Warehouse
  25. 25. Pacific Northwest ater Quality Data Exchange Provides a single point of access to a comprehensive source of ambient water quality monitoring data across the Pacific Northwest region. Demonstrates the national Network concept and principles. Illustrates mechanism and benefits of State-to- State information exchanges. Implements a “network-based” approach. Will facilitate State-to-EPA data exchange of data Illustrates rapid data exchange development possibilities inherent in the Network principles.
  26. 26. ____________ EcoData