Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
ESIP AQ Cluster, rhusar@me.wustl.edu DRAFT  June 6, 2005 Air Quality Cluster TechTrack   Earth Science Information Partner...
Data Acquisition and Usage Activities (Select View Show, click to step through PPT)   <ul><li>The data life cycle consists...
Sample AQ Information Usage Landscape Scientist Science DAACs <ul><li>Current info systems are  project/program oriented  ...
Information Landscape: Providers  Geography, Content, Agency, Form <ul><li>Data are  distributed  geographically by  auton...
Information Landscape: Users Types, Agency, Info Needs <ul><li>Users are  distributed  geographically </li></ul>EPA NOAA N...
Information Landscape: Info System  Data Access, Processing and Products Providers NASA DAACs EPA R&D Model EPA  AIRNow ot...
Current Delivery and Integration Systems Data:  Emission, Surface Satellite, Model Single Datasets <ul><li>Currently distr...
ESIP AQ Cluster, rhusar@me.wustl.edu DRAFT  June 6, 2005 Integrated Data System for Air Quality-IDAQ  ESIP AQ Cluster 0505...
A Sample of  Datasets  Accessible through ESIP –  DataFed  Mediation Near Real Time (~ day) <ul><li>It has been demonstrat...
Upcoming SlideShare
Loading in …5
×

051101 Epa Event Seminar 050603 Current Future Idaq Black

556 views

Published on

http://capitawiki.wustl.edu/index.php/20051031_Air_Quality_Cluster_TechTrack_Agile_Data_Integration_Infrastructure

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

051101 Epa Event Seminar 050603 Current Future Idaq Black

  1. 1. ESIP AQ Cluster, rhusar@me.wustl.edu DRAFT June 6, 2005 Air Quality Cluster TechTrack Earth Science Information Partners Agile Data Integration Infrastructure Air Quality Data Meteorology Data Emissions Data Informing Public AQ Compliance Status and Trends Network Assess. Tracking Progress Data to Knowledge Transformation Draft, June 2005 (intended as background for AQ Cluster discussions) Partners <ul><li>NASA </li></ul><ul><li>NOAA </li></ul><ul><li>EPA </li></ul><ul><li>(?) </li></ul><ul><li>USGS </li></ul><ul><li>DOE </li></ul><ul><li>NSF </li></ul><ul><li>Industry… </li></ul>Flow of Data Flow of Control
  2. 2. Data Acquisition and Usage Activities (Select View Show, click to step through PPT) <ul><li>The data life cycle consists of the acquisition and the usage parts </li></ul>Usage Activities Data Acquisition <ul><li>The acquisition part processes the sensory data by firmly linked procedures </li></ul>The Federation focuses on data usage activities and presumes repositories <ul><li>The usage activities are more iterative, dynamic procedures </li></ul><ul><li>The collected and cleaned data are stored in the repository </li></ul>Data Repository <ul><li>The usage cycle transform data into knowledge for decision making </li></ul>Decisions
  3. 3. Sample AQ Information Usage Landscape Scientist Science DAACs <ul><li>Current info systems are project/program oriented and provide end-to-end solutions </li></ul>Info Users Data Providers Info System AIRNow Public AIRNow Model Compliance Manager a <ul><li>Part of the data resources of any project can be shared for re-use through DataFed </li></ul><ul><li>Through the Federation, the data are homogenized into multi-dimensional cubes </li></ul><ul><li>Data processing and rendering can then be performed through web services </li></ul><ul><li>Each project/program can be augmented by Federation data and services </li></ul>
  4. 4. Information Landscape: Providers Geography, Content, Agency, Form <ul><li>Data are distributed geographically by autonomous providers </li></ul>Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data includes emissions </li></ul>Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data includes emissions, ambient data, </li></ul>Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data includes emissions, ambient data, satellite data </li></ul>Satellite Satellite Satellite Satellite Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data includes emissions, ambient data, satellite data and model output </li></ul>Model Model Model Model Satellite Satellite Satellite Satellite Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data are provided by multiple agencies : EPA, NOAA, NASA and others </li></ul>NASA Mission NOAA GASP NASA IDEA NASA DAACs NOAA ASOS EPA-AQS DataMart EPA AIRNow RPO VIEWS FS FireInv State/Local Emission EPA NEISGEI EPA NEI NOAA WeaMod EPA AQModel NOAA Forecast Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form NASA DAACs NOAA GASP NASA IDEA NASA Missions EPA NEI EPA NEISGEI FS FireInv State/Local Emission NOAA ASOS RPO VIEWS EPA AIRNow EPA-AQS AIRS NOAA WeaMod EPA AQModel NASA GloModel NOAA Forecast <ul><li>Furthermore, data are provided in varied formats and access protocols </li></ul>Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form <ul><li>Data on Internet are geography-independent and can be ‘linearized’ </li></ul>Internet NASA DAACs EPA R&D Model EPA AIRNow others
  5. 5. Information Landscape: Users Types, Agency, Info Needs <ul><li>Users are distributed geographically </li></ul>EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Policy Policy Policy <ul><li>Users includes policy makers </li></ul>EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist <ul><li>Users includes policy makers, the public </li></ul>Policy Policy Policy Public Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist <ul><li>Users includes policy makers, the public , AQ managers </li></ul>Policy Policy Policy Public Public Manager Manager EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist and scientist Policy Policy Policy Public Public Manager Manager Scientist Scientist Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist <ul><li>Users are affiliated with multiple agencies : EPA, NOAA, NASA, as well as others </li></ul>Policy Policy Policy Public Public Manager Manager Scientist Scientist Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist <ul><li>Furthermore, users need various types of information provided in multiple formats </li></ul>Policy Manager Policy Scientist Manager Scientist Scientist Policy Public Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist <ul><li>Since the users are also on the Internet, their geographic location is irrelevant </li></ul>Public Manager Scientist Internet other
  6. 6. Information Landscape: Info System Data Access, Processing and Products Providers NASA DAACs EPA R&D Model EPA AIRNow others Public Manager Scientist Users other <ul><li>The info system transforms the data into info products for each user </li></ul><ul><li>In the first stage the heterogeneous data are prepared for uniform access </li></ul>Uniform Access <ul><li>The second stage performs filtering, aggregation, fusion and other operations </li></ul>Data Processing Web Service Chain Custom Processing SciFlo DataFed Info Products Reports, Websites Forecasting Compliance Other Sci. Reports <ul><li>The third stage prepares and delivers the needed info products </li></ul>
  7. 7. Current Delivery and Integration Systems Data: Emission, Surface Satellite, Model Single Datasets <ul><li>Currently distributed are web-accessible as files, through data warehouses and web portals </li></ul><ul><li>Virtually all processing, analysis and synthesis is custom-programmed by people </li></ul>Reports <ul><li>The resulting information products are also hand-crafted by analysts </li></ul>
  8. 8. ESIP AQ Cluster, rhusar@me.wustl.edu DRAFT June 6, 2005 Integrated Data System for Air Quality-IDAQ ESIP AQ Cluster 050510 Draft [email_address] <ul><li>The challenge is to design a general supportive infrastructure </li></ul><ul><li>Simply connecting the relevant provides and users for each info product is messy </li></ul><ul><li>The info system infrastructure needs to facilitate the creation of info products </li></ul>AQ Compliance Nowcast/Forecast Status & Trends Find Data Gaps ID New Problems ……… Info Needs Reports <ul><li>Providers supply the ‘raw material’ (data and models) for ‘refined’ info products </li></ul>Emission Surface Satellite Model Single Datasets Providers Wrappers Where? What? When? Federate Data Structuring <ul><li>Structuring the heterogeneous data into where-when-what ‘cubes’ simplifies the mess </li></ul>Slice & Dice Explore Data Viewers <ul><li>The ‘cubed’ data can be accessed and explored by slicing-dicing tools </li></ul>Programs Integrate Understand <ul><li>More elaborate data integration and fusion can be done by web service chaining </li></ul><ul><li>This infrastructure support for IDAQ can be provided by the ESIP Federation </li></ul>Non-intrusive Linking & Mediation Data Users Data Providers
  9. 9. A Sample of Datasets Accessible through ESIP – DataFed Mediation Near Real Time (~ day) <ul><li>It has been demonstrated (project FASTNET ) that these and other datasets can be accessed, repackaged and delivered by AIRNow through ‘Consoles’ </li></ul>MODIS Reflectance MODIS AOT TOMS Index GOES AOT GOES 1km Reflec NEXTRAD Radar MODIS Fire Pix NRL MODEL NWS Surf Wind, Bext

×