061211 Agu Aq Datasystem1

  • 606 views
Uploaded on

http://datafedwiki.wustl.edu/index.php/2006-12-11_AGU%2C_San_Fransisco

http://datafedwiki.wustl.edu/index.php/2006-12-11_AGU%2C_San_Fransisco

More in: Technology , Education
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
606
On Slideshare
0
From Embeds
0
Number of Embeds
1

Actions

Shares
Downloads
8
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide
  • We will start out by highlighting significant trends in air pollution monitoring and management Next we will describe an agile information system architecture for air quality decision support Finally, we will show the application of this architecture and technologies for two use cases: a real time smoke event analysis and a long-term model evaluation

Transcript

  • 1. Emerging Approaches to the Integration of Autonomous Heterogeneous Air Quality Information Systems Invited Paper IN13E-01 American Geophysical Union, San Francisco December 11, 2006 Richard Scheffe US Environmental Protection Agency Rudolf B. Husar Washington University, St. Louis
  • 2. Entities participating in AQ information exchannge Unfortunately, the inner working of the IS that links these entities is not yet understood. The challenge posed by R. Scheffe : Please e xplain this Informatics Mess GEOSS Eco-informatics Accountability/ indicators SIPs, nat.rules designations PHASE PM research Risk/exposure assessments AQ forecasting Programs NAAQS setting EPA NOAA NASA NPS USDA DOE Private Sector States/Tribes RPO’s/Interstate Academia NARSTO NAS, CAAAC CASAC, OMB Enviros Organizations CDC Supersites IMPROVE, NCore PM monit, PAMS CASTNET Lidar systems NADP Satellite data Intensive studies PM centers Other networks: SEARCH, IADN.. Data sources CMAQ GEOS-CHEM Emissions Meteorology Health/mort. records
  • 3. Specific AQ Informatics Questions: 2. Is data sharing a viable approach to achieve the convergence & optimization? Common data Client Data Overlaps Monitoring Satellite Modeling 1. Can we integrate air quality information through partnerships ?
  • 4. Infromatics Challenges Science: Understand and explain how IS work Dependencies, driving forces (co-opetition) and processes of IS Engineering: Design of Info Systems Information Flow, SAO, System of Systems Technology: Harnessing and harvesting IT & the web. Web Services, Workflow, Social Software, Google *.* Web2.0, RSS
  • 5. Information Providers: Geography, Content, Agency, Form
    • Data are distributed geographically by autonomous providers
    Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form
    • Data includes emissions
    Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form
    • Data includes emissions, ambient data,
    Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form
    • Data includes emissions, ambient data, satellite data
    Satellite Satellite Satellite Satellite Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form
    • Data includes emissions, ambient data, satellite data and model output
    Model Model Model Model Satellite Satellite Satellite Satellite Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form
    • Data are provided by multiple agencies : EPA, NOAA, NASA and others
    NASA Mission NOAA GASP NASA IDEA NASA DAACs NOAA ASOS EPA-AQS DataMart EPA AIRNow RPO VIEWS FS FireInv State/Local Emission EPA NEISGEI EPA NEI NOAA WeaMod EPA AQModel NOAA Forecast Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form NASA DAACs NOAA GASP NASA IDEA NASA Missions EPA NEI EPA NEISGEI FS FireInv State/Local Emission NOAA ASOS RPO VIEWS EPA AIRNow EPA-AQS AIRS NOAA WeaMod EPA AQModel NASA GloModel NOAA Forecast
    • Furthermore, data are provided in varied formats and access protocols
    Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form
    • Data on Internet are geography-independent and can be ‘linearized’
    Internet Remote Sensing SurfaceObs Emission SciForecast Model
  • 6. Users: By Types, Agency, Info Needs
    • Users are distributed geographically
    EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Policy Policy Policy
    • Users includes policy makers
    EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist
    • Users includes policy makers, the public
    Policy Policy Policy Public Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist
    • Users includes policy makers, the public , AQ managers
    Policy Policy Policy Public Public Manager Manager EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist and scientist Policy Policy Policy Public Public Manager Manager Scientist Scientist Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist
    • Users are affiliated with multiple agencies : EPA, NOAA, NASA, as well as others
    Policy Policy Policy Public Public Manager Manager Scientist Scientist Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist
    • Furthermore, users need various types of information provided in multiple formats
    Policy Manager Policy Scientist Manager Scientist Scientist Policy Public Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist
    • Since the users are also on the Internet, their geographic location is irrelevant
    Public Manager Scientist Internet other
  • 7. Information System Challenge Refining and delivering information Data Knowledge Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • 8. Agile Information System: Data Access, Processing and Products Data Organizing Document Structure/Format Interfacing Value Adding Processes Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • 9. Agile Information System: Data Access, Processing and Products Data Organizing Document Structure/Format Interfacing Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • 10. Agile Information System: Data Access, Processing and Products Data Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • 11. Agile Information System: Data Access, Processing and Products Data Analyzing Filter/Integrate Aggregate/Fuse Custom Analysis Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • 12. Value-Adding Processes Data Analyzing Filter/Integrate Aggregate/Fuse Custom Analysis Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Reporting Inclusiveness Iterative/Agile Dynamic Report Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • 13. Agile Information System: Data Access, Processing and Products Control Data Data Control Seeking Information Providing Information Negotiating & Market Space Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • 14. Infromatics Challenges Science: Understand and explain how IS work Dependencies, driving forces (co-opetition), information processes Engineering: Design of Info Systems Information Flow, SAO, System of Systems Technology: Harnessing and harvesting IT & the web. Web Services, Workflow, Social Software, Google *.* Web2.0, RSS
  • 15. Loosely Coupled Data Access through Standard Protocols Standard Data Query Language: Where? When? What? (Space-time query by OGC WMS, WCS) GetCapabilities GetData Capabilities, ‘Profile’ Data Where? When? What? Which Format? Server Back End Std. Interface Client Front End Std. Interface T2 T1 Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow others Data CF, EOS, OGC CF OGC, ISO OGC, ISO Standards netCDF, HDF.. Format Temperature What? Time When? BBOX Where? GetData Query
  • 16. Web Services and Workflow for Loose Coupling Web Services Triad: Publish – Find – Bind Workflow Software: Dynamic Linking Software Mashups Software Mashup: Coarse-grain Linking Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow others Data Service Broker Service Provider Publish Find Bind Service User Web Service Interaction Service Chaining & Workflow
  • 17. Collaborative Reporting and Dynamic Delivery Collaborative Analysis and Writing Wiki, Blogs, Group Annotations Dynamic Content Delivery: GoogleEarth, Screencasting… Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow others Data Co Writing - Wiki ScreenCast
  • 18. Summary
    • There IS an ‘ alignment of stars ’ for integrating AQ data systems
    • Third-party mediation can homogenize the distributed data
    • Agile SOA-based IS can deliver info products to diverse users
    • Since 2005, one such IS, DataFed is used by EPA and in research
  • 19. Some major AQ Information System Challenges (Same as the DoD, ES Challenges?) Are WCS/WMS Convergence Protocols? Connecting Humans! Right Level of Networking? WCS/WMS App App App App
  • 20. DataFed assumes autonomous data providers Non-intrusively wraps data into web services Provides processing and analysis tools
  • 21. Apparent divergences? Organizations have different missions NASA Explore fundamental Earth System Properties EPA ( Protect human health & envi. Improve air, water, ecosystem NOAA To understand and predict changes in the Earth’s environment and … NPS Protect ecosystems, AQ WQ USDA Protect/optimize Ag and forest resources CDC To promote health and quality of life ….
  • 22. Stars aligned? Collaboration (culture) empire building? Observation technologies {e.g., satellites} Computational power Science, talent {embodied in AQ models and young geniuses } Budgets, agency collaboration resource/program accountability Accountability, ↓ regulatory assessments {e.g., NAS, CASAC} Information technologies {e.g., data sharing protocols} Alignment