Environmental Data
 Automated Workflow
National Groundwater Association
            Tucson AZ
           April 21, 2009


...
Environmental Data

         Dow Jones Investment Forum:
In the next 5 years, more (environmental) data
will be collected ...
Large Database Case Studies

• EPA Regions 2, 3, 4, 5, Lake Mead
• States of WV, DE, CA, CO, NY, TX, LA, MT, OH,
  WY, and...
Environmental Sample
   Workflow Automation

• Automated Data Collection &
• Automated Database Loading
• Automated Data R...
Automated Data Reporting
Agents: Date- or Data-Driven Triggers initiating
  reports delivered by email and/or dashboard:
 ...
Key Metric:
More Graphics, More Reports, Faster
                                      1,3-         2-                     ...
GIS Plus Database
         Reporting and Graphics

• Automated links to ArcGIS, ArcGIS Server,
  EVS, EnviroInsite and oth...
Automated Data Collection: EDDs
• Excel Spreadsheets, XML packets, “flat” ASCII files
    • Single Tab or Multi-Tab
• May ...
Closed Loop
    Automated Workflow
•   Includes highly automated systems
    and subsystems for large groups such
    as s...
• Frequently now written into Statements of
  Work / Standard Operating Procedures
• Checks are required to enforce transa...
• Sign and Submit tools
   – Digital Signature?
   – Security Rules?
• Interactive “find and fix” tools so labs and field ...
t rue
1
3 als e
F 0 W B wL
/wE P D wU
EDP & Enterprise EDP
   EDDs are checked and loaded using Professional or Enterprise
         modules - same code, same ch...
•   eCoC Systems
•   Glassware, Bottle Labels
•   Completeness Checker
•   Generates “Field” EDD for field sampling crew
 ...
Generates
  Chain of Custodies




 Generates
Bottle Labels
                    Generates
                   Completeness
...
• Standalone EDD Preparation
• EDD Submissions
• EDD Receipts and
  Acknowledgements
Field Data Collection

•   PDA/Tablets/Paper to Excel EDDs
•   Sign and Submit Field EDDs to EDP w email
•   Sign and Subm...
Field Data Capture
Environmental Data Automated Workflow - NGWA - Tucson April 2009
Environmental Data Automated Workflow - NGWA - Tucson April 2009
Environmental Data Automated Workflow - NGWA - Tucson April 2009
Environmental Data Automated Workflow - NGWA - Tucson April 2009
Upcoming SlideShare
Loading in …5
×

Environmental Data Automated Workflow - NGWA - Tucson April 2009

899 views

Published on

Environmental Data Automated Workflow Presentation given to the National Groundwater Association in Tucson, AZ on April 21, 2009.

Mitch Beard
CEO and Founder
EarthSoft, Inc.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
899
On SlideShare
0
From Embeds
0
Number of Embeds
64
Actions
Shares
0
Downloads
9
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Environmental Data Automated Workflow - NGWA - Tucson April 2009

  1. 1. Environmental Data Automated Workflow National Groundwater Association Tucson AZ April 21, 2009 Mitch Beard CEO and Founder EarthSoft, Inc.
  2. 2. Environmental Data Dow Jones Investment Forum: In the next 5 years, more (environmental) data will be collected than in the previous history of mankind. Automated Workflow: Required for large volumes of data and many users. Manual workflows won’t allow us to process this much data.
  3. 3. Large Database Case Studies • EPA Regions 2, 3, 4, 5, Lake Mead • States of WV, DE, CA, CO, NY, TX, LA, MT, OH, WY, and others. • AECOM, Arcadis, Black & Veatch, CDM, CRA, ERM, Foth, Delta Environmental, Golder, Kleinfelder, URS, and others. • Several Major industrials including BP, Cemex, Rohm and Haas, Shell Global Solutions Group, and others that prefer not to be named.
  4. 4. Environmental Sample Workflow Automation • Automated Data Collection & • Automated Database Loading • Automated Data Reporting
  5. 5. Automated Data Reporting Agents: Date- or Data-Driven Triggers initiating reports delivered by email and/or dashboard: – Example 1: Produce Report A and email it to me every Friday at 3PM. – Example 2: Produce Reports A-F and email them to all 30 members of my project team, our state PM and our client, every Friday at 3PM. – Example 3: Produce Report A and email it to me every time MTBE => 35 PPM. – Example 4: Produce Reports A-F and email them to all 30 members of my project team, our state PM and our client, every time MTBE => 35 PPM.
  6. 6. Key Metric: More Graphics, More Reports, Faster 1,3- 2- Carbon Chlorofor Cis-1,2- Methyl T-Butyl Ether Trichloroethyl Vinyl B-30 Dichlorobenzene Hexanone ACETONE BENZENE Tetrachloride m Dichloroethene (MTBE) ene Chloride Depth: 31 (ug/l) (ug/l) (ug/l) (ug/l) (ug/l) (ug/l) (ug/l) (ug/l) (ug/l) (ug/l) CLEANWATER RES -- -- -- -- -- -- -- 75 0.25 -- DRINKINGWATER RES -- -- 2 5 -- -- -- 50 5 5 Mean 69.59 35.91 338.28 26.31 3.94 113.43 0.005 68.92 0.005 0.005 UCL 73.29 48.95 581.25 41.44 8.98 130.18 0.005 91.91 0.005 0.005 Median 69.20 32.91 242.66 20.61 0.97 111.65 0.005 66.39 0.005 0.005 Standard Deviation 4.50 15.85 295.36 18.39 6.13 20.35 0.00 27.95 0.00 0.00 Skewness 0.26 0.68 1.15 1.16 1.83 0.27 -- 0.44 -- -- Minimum 64.08 18.61 70.74 9.03 0.03 87.92 0.005 35.62 0.005 0.005 Maximum 75.90 60.59 841.59 57.82 15.56 142.43 0.005 111.02 0.005 0.005 Count (n) 6 6 6 6 6 6 6 6 6 6 Mann-Kendall S -15 -15 15 -15 -15 15 0 15 0 0 Negative Positive Negative Positive 90% confidence Negative Trend Trend Trend Trend Negative Trend Trend No Trend Positive Trend No Trend No Trend Negative Positive Negative Positive 95% confidence Negative Trend Trend Trend Trend Negative Trend Trend No Trend Positive Trend No Trend No Trend Negative Positive Negative Positive 99% confidence Negative Trend Trend Trend Trend Negative Trend Trend No Trend Positive Trend No Trend No Trend Sen Slope -0.027 -0.093 1.257 -0.092 -0.022 0.116 0.0000 0.156 0.0000 0.0000
  7. 7. GIS Plus Database Reporting and Graphics • Automated links to ArcGIS, ArcGIS Server, EVS, EnviroInsite and other graphics and models. • GIS and Web GIS Query and Labeling Tools • “Spider Diagrams”, “Chem Data Boxes”: • GIS to CrossTabs • Thumbnail Graphics
  8. 8. Automated Data Collection: EDDs • Excel Spreadsheets, XML packets, “flat” ASCII files • Single Tab or Multi-Tab • May be thousands per month (can not be manual!) • Lab EDDs (300+ varieties) • Hopefully produced from LIMS • Field and GIS EDDs (many automatically from instruments) • Limnology EDDs, Geotechnical EDDs • EDD Checkers • Correctness and Completeness Checks + Data Validation • Legislatively Driven EDDs (NPDES, Stormwater, Drinking Water, Superfund)
  9. 9. Closed Loop Automated Workflow • Includes highly automated systems and subsystems for large groups such as states and EPA Regions. • Process many thousands of EDDs without any human involvement. • Automatically ‘push’ Reports and Graphics to data End Users upon certain ‘triggers’ such as new data or hits. • Schedule each stage to run at specified times or intervals.
  10. 10. • Frequently now written into Statements of Work / Standard Operating Procedures • Checks are required to enforce transactions • Checker for EDD submitter • Same Checker for EDD receiver • Clearinghouse, “Gatekeeper” • May be 2-step, lab to field to client/state
  11. 11. • Sign and Submit tools – Digital Signature? – Security Rules? • Interactive “find and fix” tools so labs and field crews get it right – Standalone, Interactive, Private – TQM: Errors are not allowed to be forwarded • EDD Receipt Automation, Server-side – EDD may have to declare Type upon arrival – Web Dashboard tool, ftp, or email – 0 or 1, Right or Wrong, ! • Receipt Notification for Closed Loop – Feedback to data submitter via email or dashboard
  12. 12. t rue 1 3 als e F 0 W B wL /wE P D wU
  13. 13. EDP & Enterprise EDP EDDs are checked and loaded using Professional or Enterprise modules - same code, same checks, different GUIs EQuIS Data Processor Enterprise EDP • Power and Flexibility • Easy to Use • Interactive Error Checking • Process is Automated • Color Coded Errors • Large Volume • Already Owned by Most Labs • Supports Multiple EDD Formats
  14. 14. • eCoC Systems • Glassware, Bottle Labels • Completeness Checker • Generates “Field” EDD for field sampling crew – Workflow is the same for paper, Excel spreadsheets, PDAs, or laptops/tablets
  15. 15. Generates Chain of Custodies Generates Bottle Labels Generates Completeness Checker
  16. 16. • Standalone EDD Preparation • EDD Submissions • EDD Receipts and Acknowledgements
  17. 17. Field Data Collection • PDA/Tablets/Paper to Excel EDDs • Sign and Submit Field EDDs to EDP w email • Sign and Submit COC/eCOC to LAB w email • Real-Time Data Streams – aka Time Series Data – Instrument Interfaces – Data Reduction and storage
  18. 18. Field Data Capture

×