• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
070416 Egu Vienna Husar
 

070416 Egu Vienna Husar

on

  • 817 views

http://datafedwiki.wustl.edu/index.php/2007-04-16_EGU_Mtg_Vienna

http://datafedwiki.wustl.edu/index.php/2007-04-16_EGU_Mtg_Vienna

Statistics

Views

Total Views
817
Views on SlideShare
801
Embed Views
16

Actions

Likes
0
Downloads
12
Comments
0

1 Embed 16

http://datafedwiki.wustl.edu 16

Accessibility

Categories

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

070416 Egu Vienna Husar 070416 Egu Vienna Husar Presentation Transcript

  • Architectures and Technologies Enabling the Diffusion of Atmospheric Science Information Rudolf B. Husar and Erin Robinson Washington University, St. Louis Presented at EGU, Vienna April 18, 2007 Think Networking! Data Data Data Data Data Application Application Application Application Application
  • The Transformational Effect of Networking
    • Information has become the main driver of progress
    • Time and place are no longer barriers to participation and interaction
    • The Web has become a medium participation - ‘Web 2.0’ phenomenon
    “ Networking has led to an unprecedented surge of productivity” Time Magazine, Person of the Year 2006, YOU
    • These are opportunities to enable Earth Science through more networking
    • But many resistances to networking exist that need to be overcome
  • Networking Multiplies Value Creation Application Data 1 User Stovepipe Value = 1 1 Data x 1 Program = 1 Enclosed Value-Creating Process - ‘Stovepipe’
  • Application Data Application Application Application Application Stovepipe 1 User Stovepipe Value = 1 1 Data x 1 Program = 1 5 Uses of Data Value = 5 1 Data x 5 Program = 5 Networking Multiplies Value Creation
  • Networking Multiplies Value Creation Merging data may creates new, unexpected opportunities Not all data are equally valuable to all programs 1 User Stovepipe Value = 1 1 Data x 1 Program = 1 5 Uses of Data Value = 5 1 Data x 5 Program = 5 Open Network Value = 25 5 Data x 5 Program = 25 Data Data Data Data Data Stovepipe Application Application Application Application Application
  • Agile Information System: Data Access, Processing and Products Data Organizing Document Structure/Format Interfacing Value Adding Processes Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • Agile Information System: Data Access, Processing and Products Data Organizing Document Structure/Format Interfacing Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • Agile Information System: Data Access, Processing and Products Data Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • Agile Information System: Data Access, Processing and Products Data Analyzing Filter/Integrate Aggregate/Fuse Custom Analysis Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • Value-Adding Processes Data Analyzing Filter/Integrate Aggregate/Fuse Custom Analysis Organizing Document Structure/Format Interfacing Characterizing Display/Browse Compare/Fuse Characterize Reporting Inclusiveness Iterative/Agile Dynamic Report Value Adding Processes Homogenizing Format profile Standard access Data as Service Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • Agile Information System: Data Access, Processing and Products Control Data Data Control Seeking Information Providing Information Negotiating & Market Space Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Provider NASA DAACs EPA Model EPA AIRNow others
  • System of Systems Global Earth Observing System of Systems - GEOSS
    • Characteristics of System of Systems (SoS)
    • Autonomous constituents managed/operated independently
    • Independent evolution of each constituent
    • SoS displays emergent behavior
    • Must recognize, manage, exploit the characteristics:
    • No stakeholder has complete SoS insight
    • Central control is limited; distributed control is essential
    • Users, must be involved throughout the life of a SoS
  • Lets agree on Space-Time-Parameter Data Access Query Protocol
  • Interoperability Stack: Key concept of the Web Connecting Machines and People IP – Internet Protocol Service Orientation Open Architecture Data Standards Amplify Individuals Connect Minds System components have to be interoperable at each layer
  • Loosely Coupled Data Access through Standard Protocols Standard Data Query Language: Where? When? What? (Space-time query - WMS, WCS) GetCapabilities GetData Capabilities, ‘Profile’ Data Where? When? What? Which Format? Server Back End Std. Interface Client Front End Std. Interface T2 T1 Standard Messaging What data you have? Give me this data Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow others Data CF, EOS, OGC CF OGC, ISO OGC, ISO Standards netCDF, HDF.. Format Temperature What? Time When? BBOX Where? GetData Query
  • Web Services and Workflow for Loose Coupling Workflow Software: Dynamic Linking Software Mashups Software Mashup: Coarse-grain Linking Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow others Data Service Chaining & Workflow
  •  
  • Collaborative Reporting and Dynamic Delivery Co Writing - Wiki Collaborative Analysis and Writing Wiki, Blogs, Group Annotations Dynamic Content Delivery: GoogleEarth, Screencasting… Uniform Access Data Processing Web Service Chain Custom Processing SciFlo DataFed Products Reports Forecast Compli. Other Science Public Manager Scientist Users other Control Data Acquisition Provider NASA DAACs EPA Model EPA AIRNow others Data ScreenCast
  • ‘ Stovepipe’ and Federated Usage Architectures Landscape
    • Each project/program can be augmented by Federation data and services
    Scientist Science DAACs
    • Current info systems are project/program oriented and provide end-to-end solutions
    Info Users Data Providers Info System AIRNow Public AIRNow Model Compliance Manager
    • Part of the data resources of any project can be shared for re-use through DataFed
    • Through the Federation, the data are homogenized into multi-dimensional cubes
    • Data processing and rendering can then be performed through web services
  • DataFed: 100+ Datasets Non-intrusively Federated
    • Data are accessed from autonomous, distributed providers
    • DataFed ‘wrappers’ provide uniform geo-time referencing
    • Tools allow space/time overlay, comparisons and fusion
    Near Real Time Data Integration Delayed Data Integration Surface Air Quality AIRNOW O3, PM25 ASOS_STI Visibility, 300 sites METAR Visibility, 1200 sites VIEWS_OL 40+ Aerosol Parameters Satellite MODIS_AOT AOT, Idea Project GASP Reflectance, AOT TOMS Absorption Indx, Refl. SEAW_US Reflectance, AOT Model Output NAAPS Dust, Smoke, Sulfate, AOT WRF Sulfate Fire Data HMS_Fire Fire Pixels MODIS_Fire Fire Pixels Surface Meteorology RADAR NEXTRAD SURF_MET Temp, Dewp, Humidity… SURF_WIND Wind vectors ATAD Trajectory, VIEWS locs.
  • Sample of Federated Datasets
  •  
  • A Sample of Datasets Accessible through ESIP Mediation Near Real Time (~ day)
    • It has been demonstrated (project FASTNET) that these and other datasets can be accessed, repackaged and delivered by AIRNow through ‘Consoles’
    MODIS Reflectance MODIS AOT TOMS Index GOES AOT GOES 1km Reflec NEXTRAD Radar MODIS Fire Pix NRL MODEL NWS Surf Wind, Bext
  • Summary Grand Convergence Will we make use of it?
    • Third-party mediation can homogenize distributed ES data
    • Agile SOA-based IS can deliver diverse info products to users
    • Since 2005, one such IS, DataFed is used by EPA and in research
    • However, more data need to be federated by the community
    Parting thoughts Think outside the stovepipe – Think networking Divide and Conquer, NO! Connect and Enable, YES! Thank you