Successfully reported this slideshow.

061211 Agu Aq Datasystem1

849 views

Published on

http://datafedwiki.wustl.edu/index.php/2006-12-11_AGU%2C_San_Fransisco

Published in: Technology, Education
  • Be the first to comment

  • Be the first to like this

061211 Agu Aq Datasystem1

  1. 1. Emerging Approaches to the Integration of Autonomous Heterogeneous Air Quality Information Systems Invited Paper IN13E-01 American Geophysical Union, San Francisco December 11, 2006 Richard Scheffe US Environmental Protection Agency Rudolf B. Husar Washington University, St. Louis
  2. 2. Entities participating in AQ information exchannge Unfortunately, the inner working of the IS that links these entities is not yet understood. The challenge posed by R. Scheffe : Please e xplain this Informatics Mess GEOSS Eco-informatics Accountability/ indicators SIPs, nat.rules designations PHASE PM research Risk/exposure assessments AQ forecasting Programs NAAQS setting EPA NOAA NASA NPS USDA DOE Private Sector States/Tribes RPO’s/Interstate Academia NARSTO NAS, CAAAC CASAC, OMB Enviros Organizations CDC Supersites IMPROVE, NCore PM monit, PAMS CASTNET Lidar systems NADP Satellite data Intensive studies PM centers Other networks: SEARCH, IADN.. Data sources CMAQ GEOS-CHEM Emissions Meteorology Health/mort. records
  3. 3. Specific AQ Informatics Questions: 2. Is data sharing a viable approach to achieve the convergence & optimization? Common data Client Data Overlaps Monitoring Satellite Modeling 1. Can we integrate air quality information through partnerships ?
  4. 4. Infromatics Challenges Science: Understand and explain how IS work Dependencies, driving forces (co-opetition) and processes of IS Engineering: Design of Info Systems Information Flow, SAO, System of Systems Technology: Harnessing and harvesting IT & the web. Web Services, Workflow, Social Software, Google *.* Web2.0, RSS
  5. 5. Information Providers: Geography, Content, Agency, Form <ul><li>Data are distributed geographically by autonomous providers </li></ul>Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data includes emissions </li></ul>Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data includes emissions, ambient data, </li></ul>Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data includes emissions, ambient data, satellite data </li></ul>Satellite Satellite Satellite Satellite Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data includes emissions, ambient data, satellite data and model output </li></ul>Model Model Model Model Satellite Satellite Satellite Satellite Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data are provided by multiple agencies : EPA, NOAA, NASA and others </li></ul>NASA Mission NOAA GASP NASA IDEA NASA DAACs NOAA ASOS EPA-AQS DataMart EPA AIRNow RPO VIEWS FS FireInv State/Local Emission EPA NEISGEI EPA NEI NOAA WeaMod EPA AQModel NOAA Forecast Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form NASA DAACs NOAA GASP NASA IDEA NASA Missions EPA NEI EPA NEISGEI FS FireInv State/Local Emission NOAA ASOS RPO VIEWS EPA AIRNow EPA-AQS AIRS NOAA WeaMod EPA AQModel NASA GloModel NOAA Forecast <ul><li>Furthermore, data are provided in varied formats and access protocols </li></ul>Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data on Internet are geography-independent and can be ‘linearized’ </li></ul>Internet Remote Sensing SurfaceObs Emission SciForecast Model
  6. 6. Users: By Types, Agency, Info Needs <ul><li>Users are distributed geographically </li></ul>EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Policy Policy Policy <ul><li>Users includes policy makers </li></ul>EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist <ul><li>Users includes policy makers, the public </li></ul>Policy Policy Policy Public Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist <ul><li>Users includes policy makers, the public , AQ managers </li></ul>Policy Policy Policy Public Public Manager Manager EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist and scientist Policy Policy Policy Public Public Manager Manager Scientist Scientist Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist <ul><li>Users are affiliated with multiple agencies : EPA, NOAA, NASA, as well as others </li></ul>Policy Policy Policy Public Public Manager Manager Scientist Scientist Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist <ul><li>Furthermore, users need various types of information provided in multiple formats </li></ul>Policy Manager Policy Scientist Manager Scientist Scientist Policy Public Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist <ul><li>Since the users are also on the Internet, their geographic location is irrelevant </li></ul>Public Manager Scientist Internet other
  7. 7. Information System Challenge Refining and delivering information Data Knowledge Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  8. 8. Agile Information System: Data Access, Processing and Products Data Organizing Document Structure/Format Interfacing Value Adding Processes Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  9. 9. Agile Information System: Data Access, Processing and Products Data Organizing Document Structure/Format Interfacing Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  10. 10. Agile Information System: Data Access, Processing and Products Data Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  11. 11. Agile Information System: Data Access, Processing and Products Data Analyzing Filter/Integrate Aggregate/Fuse Custom Analysis Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  12. 12. Value-Adding Processes Data Analyzing Filter/Integrate Aggregate/Fuse Custom Analysis Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Reporting Inclusiveness Iterative/Agile Dynamic Report Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  13. 13. Agile Information System: Data Access, Processing and Products Control Data Data Control Seeking Information Providing Information Negotiating & Market Space Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  14. 14. Infromatics Challenges Science: Understand and explain how IS work Dependencies, driving forces (co-opetition), information processes Engineering: Design of Info Systems Information Flow, SAO, System of Systems Technology: Harnessing and harvesting IT & the web. Web Services, Workflow, Social Software, Google *.* Web2.0, RSS
  15. 15. Loosely Coupled Data Access through Standard Protocols Standard Data Query Language: Where? When? What? (Space-time query by OGC WMS, WCS) GetCapabilities GetData Capabilities, ‘Profile’ Data Where? When? What? Which Format? Server Back End Std. Interface Client Front End Std. Interface T2 T1 Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow others Data CF, EOS, OGC CF OGC, ISO OGC, ISO Standards netCDF, HDF.. Format Temperature What? Time When? BBOX Where? GetData Query
  16. 16. Web Services and Workflow for Loose Coupling Web Services Triad: Publish – Find – Bind Workflow Software: Dynamic Linking Software Mashups Software Mashup: Coarse-grain Linking Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow others Data Service Broker Service Provider Publish Find Bind Service User Web Service Interaction Service Chaining & Workflow
  17. 17. Collaborative Reporting and Dynamic Delivery Collaborative Analysis and Writing Wiki, Blogs, Group Annotations Dynamic Content Delivery: GoogleEarth, Screencasting… Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow others Data Co Writing - Wiki ScreenCast
  18. 18. Summary <ul><li>There IS an ‘ alignment of stars ’ for integrating AQ data systems </li></ul><ul><li>Third-party mediation can homogenize the distributed data </li></ul><ul><li>Agile SOA-based IS can deliver info products to diverse users </li></ul><ul><li>Since 2005, one such IS, DataFed is used by EPA and in research </li></ul>
  19. 19. Some major AQ Information System Challenges (Same as the DoD, ES Challenges?) Are WCS/WMS Convergence Protocols? Connecting Humans! Right Level of Networking? WCS/WMS App App App App
  20. 20. DataFed assumes autonomous data providers Non-intrusively wraps data into web services Provides processing and analysis tools
  21. 21. Apparent divergences? Organizations have different missions NASA Explore fundamental Earth System Properties EPA ( Protect human health & envi. Improve air, water, ecosystem NOAA To understand and predict changes in the Earth’s environment and … NPS Protect ecosystems, AQ WQ USDA Protect/optimize Ag and forest resources CDC To promote health and quality of life ….
  22. 22. Stars aligned? Collaboration (culture) empire building? Observation technologies {e.g., satellites} Computational power Science, talent {embodied in AQ models and young geniuses } Budgets, agency collaboration resource/program accountability Accountability, ↓ regulatory assessments {e.g., NAS, CASAC} Information technologies {e.g., data sharing protocols} Alignment

×