070726 Igarss07 Barcelona

DataFed: View-Based Mediated Web Service Architecture Rudolf B. Husar and Kari Hoijarvi Washington University, St. Louis Presented at IGARSS07, Barcelona, ES, July 22, 2007 Mediator Wrapper Wrapper Source 1 Source 2 User query Data View

Information Landscape: Providers Geography, Content, Agency, Form ,[object Object],Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form ,[object Object],Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form ,[object Object],Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form ,[object Object],Satellite Satellite Satellite Satellite Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form ,[object Object],Model Model Model Model Satellite Satellite Satellite Satellite Ambient Ambient Ambient Ambient Emission Emission Emission Emission Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form ,[object Object],NASA Mission NOAA GASP NASA IDEA NASA DAACs NOAA ASOS EPA-AQS DataMart EPA AIRNow RPO VIEWS FS FireInv State/Local Emission EPA NEISGEI EPA NEI NOAA WeaMod EPA AQModel NOAA Forecast Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form NASA DAACs NOAA GASP NASA IDEA NASA Missions EPA NEI EPA NEISGEI FS FireInv State/Local Emission NOAA ASOS RPO VIEWS EPA AIRNow EPA-AQS AIRS NOAA WeaMod EPA AQModel NASA GloModel NOAA Forecast ,[object Object],Emission Ambient Satellite Model EPA NOAA NASA Other Content | Agency | Form ,[object Object],Internet NASA DAACs EPA R&D Model EPA AIRNow others

Information Landscape: Users Types, Agency, Info Needs ,[object Object],EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist Policy Policy Policy ,[object Object],EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist ,[object Object],Policy Policy Policy Public Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist ,[object Object],Policy Policy Policy Public Public Manager Manager EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist and scientist Policy Policy Policy Public Public Manager Manager Scientist Scientist Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist ,[object Object],Policy Policy Policy Public Public Manager Manager Scientist Scientist Scientist EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist ,[object Object],Policy Manager Policy Scientist Manager Scientist Scientist Policy Public Public EPA NOAA NASA Other Stakeholder | Agency | Form Policy Manager Public Scientist ,[object Object],Public Manager Scientist Internet other

Lets agree on Space-Time-Parameter Data Access Query Protocol

OGS WCS/WMS Protocols Space-Time-Parameter queries T2 T1 Loose Coupling of Servcies GetCapabilities GetData Capabilities, ‘Profile’ Data Where? When? What? Which Format? Server Back End Std. Interface Client Front End Std. Interface CF, EOS, OGC CF OGC, ISO OGC, ISO Standards netCDF, HDF.. Format Temperature What? Time When? BBOX Where? GetData Query

Gio Wiederhold 1992: Mediators

Jeff Ullman, 1998: Answering Queries Using Views Mediator Global Schema Wrapper Wrapper Source 1 Source 2 User query Query Query Query Query Result Result Result Result View Jeff Ullman, Stanford, 1998 Mediator answers queries Collects data from wrappers or mediators Wrapper (adapter) translates between the local and global language, model Heterogeneous sources

Wrapper Classes: Point, Image, Grid 5Dim Data Model Common Views

Anatomy of a Wrapper Service: TOMS Satellite Image Data ,[object Object],[object Object],[object Object],Image Description for Data Access: image_width=502 image_height=329 margin_bottom=105 margin_left=69 margin_right=69 margin_top=46 lat_min=-70 lat_max=70 lon_min=-180 lon_max=180 Daily TOMS images on FTP archive ftp://toms.gsfc.nasa.gov/pub/eptoms/images/aerosol/y2000/ea000820.gif Template: ftp://toms.gsfc.nasa.gov/pub/eptoms/images/aerosol/y[yyyy]/ea[yy][mm][dd].gif Transparent colors for overlays RGB(89,140,255) RGB(41,117,41) RGB(23,23,23) RGB(0,0,0)

Integrated Data System for Air Quality-IDAQ ESIP AQ Cluster 050510 Draft [email_address] ,[object Object],[object Object],[object Object],AQ Compliance Nowcast/Forecast Status & Trends Find Data Gaps ID New Problems ……… Info Needs Reports ,[object Object],Emission Surface Satellite Model Single Datasets Providers Wrappers Where? What? When? Federate Data Structuring ,[object Object],Slice & Dice Explore Data Viewers ,[object Object],Programs Integrate Understand ,[object Object],[object Object],Non-intrusive Linking & Mediation Data Users Data Providers

Model-Data Comparison Workflow Software Workflow Flow Program Lego-like assembly of component AeroCom Chemical Models Paris, FR VIEWS Chemical Data Ft. Collins, CO Model- Data Comparison Workflow Std I/O Std I/O WMS, WCS OGC Services

DataFed: 100+ Datasets Non-intrusively Federated ,[object Object],[object Object],[object Object],Near Real Time Data Integration Delayed Data Integration Surface Air Quality AIRNOW O3, PM25 ASOS_STI Visibility, 300 sites METAR Visibility, 1200 sites VIEWS_OL 40+ Aerosol Parameters Satellite MODIS_AOT AOT, Idea Project GASP Reflectance, AOT TOMS Absorption Indx, Refl. SEAW_US Reflectance, AOT Model Output NAAPS Dust, Smoke, Sulfate, AOT WRF Sulfate Fire Data HMS_Fire Fire Pixels MODIS_Fire Fire Pixels Surface Meteorology RADAR NEXTRAD SURF_MET Temp, Dewp, Humidity… SURF_WIND Wind vectors ATAD Trajectory, VIEWS locs.

Summary ,[object Object],[object Object],[object Object],[object Object],Parting thoughts Think outside the stovepipe – Think networking Divide and Conquer, NO! Connect and Enable, YES! Thank you

070726 Igarss07 Barcelona

Recommended

Recommended

More Related Content

What's hot

What's hot (12)

Viewers also liked

Viewers also liked (20)

Similar to 070726 Igarss07 Barcelona

Similar to 070726 Igarss07 Barcelona (20)

More from Rudolf Husar

More from Rudolf Husar (20)

Recently uploaded

Recently uploaded (20)

070726 Igarss07 Barcelona