PRISM Data Distribution System


Published on

Published in: Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

PRISM Data Distribution System

  1. 1. PRISM Information Integration System The “Bloodstream” Miles Logsdon Bruce Campbell Harvey Greenberg Sarah Rodda
  2. 2. Initial Boundary NCEP Interpolation Coordinate Transformation Interpolation PRISM Domain Land Cover Soils Flow Routing MM5 48hr Weather Forecasts Surface Field to Sound Circulation 3-D Fields WEB DHSVM River Flow Basin Sums WEB Visuals SST • Short- & Long-wave • Precipitation • Temperature • Humidity • Wind Speed • Surface pressure DRIVERS MODELS OUTPUT Surface Field Urban Model Tidal Elevation Current Temperature WEB Visuals Lateral Boundary • Tidal Elevation • River Flow • River Temp. Sound Circulation POM Salinity Mixing Land Conversion Resources Use Emissions WEB Visuals P. S. Template (biophysical) • Topography • Climate • Soils • • • • • • • • • • • • Impervious Surface Water Demand Infrastructure • Transportation • Energy • Water & Sewer UrbanSim & CRYSTAL Miles' 1998 • Short- & Long-wave • Precipitation • Temperature • Humidity • Wind Speed • Surface pressure Surface Boundary Initial Conditions • Temperature • Salinity • Bathymetry Households Income Size Ethnicity Education Businesses SIC # of Employees Output Income Land Use Type Lot size # of Units Value • # of people • Birth rate • Migration Demographics Economic • Regional Trends • Input-Output Political • Growth Mgmt. • Zoning • Environmental Laws
  3. 3. Miles explains PRISM '99 - '00 Hunter Hadaway & CEV
  4. 4. We started drawing arrows <ul><li>Soils - </li></ul><ul><li>3 layers </li></ul><ul><li>Surface & Subsurface </li></ul><ul><li>Process </li></ul>Snow -2 layers <ul><li>Vegetation </li></ul><ul><li>2 canopies </li></ul><ul><li>density </li></ul><ul><li>LAI </li></ul>Wind Stress Evaporation Precipitation <ul><li>Runoff </li></ul><ul><li>Erosion </li></ul>Mixing Clouds Evapotransporations Biomass <ul><li>Atmosphere </li></ul><ul><li>32 layers </li></ul><ul><li>Sea </li></ul><ul><li>30 layers </li></ul><ul><li>Tides </li></ul><ul><li>Temp. & </li></ul><ul><li>Salinity </li></ul><ul><li>River network </li></ul><ul><li>Routing </li></ul><ul><li>Chemistry </li></ul><ul><li>Urbanization </li></ul><ul><li>Growth </li></ul><ul><li>Land cover & use </li></ul><ul><li>Emissions </li></ul>Radiation
  5. 5. Water Resource Allocation CRYSTAL Landsat TM SeaWiFs AVHRR urbdp467 More Arrows Coastal Zone Habitat Hillslope Continuos Real-time Monitoring Stations Land Processes. Hydrology DHSVM Climate & Atmospheric Forcing MM5 Human Dimension Urban Sim Sea Circulation & Composition POM & EFDC Landcover Mapping Urban Watershed Shorelines Waste treatment Biotic Resources
  6. 6. PRISM – Information Integration System Architecture: “ the Bloodstream ” <ul><li>Fewer Arrows </li></ul><ul><li>Less lines </li></ul><ul><li>A “circle”! </li></ul>
  7. 7. Key Points <ul><li>It’s about Data Integration and Data Sharing </li></ul><ul><li>Everyone is either one or more of these: </li></ul><ul><ul><li>A data source </li></ul></ul><ul><ul><li>An Occasional default data sink (proactive) </li></ul></ul><ul><ul><li>A hardwired data sink (proactive) </li></ul></ul><ul><ul><li>A query sink (retroactive) </li></ul></ul><ul><li>We’ve begun: </li></ul><ul><ul><li>Relay Node – </li></ul></ul><ul><ul><li>Wiring for example sink and source services </li></ul></ul><ul><ul><li>Default source and sink services </li></ul></ul><ul><ul><li>Investigation of 39 program languages suited for XML-RPC services </li></ul></ul>
  8. 8. Design Basis: a framework that simplifies all aspects of scientific data networking, allowing simple access to data <ul><li>Built upon the design principles of : </li></ul><ul><li>Division of Atmospheric Sciences ( ATM ) of the National Science Foundation ( NSF ) NSF UNIDATA program, and the Internet Data Distribution ( IDD ) system, and </li></ul><ul><li>The NASA Earth Science Information Partners (ESIP) Federation </li></ul>DODS Distributed Oceanographic Data System
  9. 9. Design Principle <ul><li>Data are most appropriately described updated and distributed by those that develop them; </li></ul><ul><li>Users desire access ready for their existing application/software; </li></ul><ul><li>It isn’t the scientists job to responding to data request; </li></ul><ul><li>Users want access to data from anywhere that is served by the PRISM project regardless of its native format </li></ul>
  10. 10. <ul><li>Multiple SOURCES : Data can be injected into the BLOODSTREAM from multiple sources where SOURCE SERVICES have been installed. </li></ul><ul><li>Data recognition SINKS : Through a data recognition mechanism, users select from the available data only those needed for their needs. </li></ul><ul><li>Reliable data delivery RELAYS : Reliable transport protocols ensure data accuracy at all sites. A queuing system buffers data flows at relays, preventing losses from network congestion and short outages. </li></ul><ul><li>Load distribution: designed to avoid excessive concentration of network traffic. Generally, metadata flows with data. Only new data flow when needed. </li></ul>Data SOURCE services Data RELAY services Data SINK services
  11. 11. What is XML-RPC? <ul><li>A specification and a set of implementations that allow software running on disparate operating systems, running in different environments to make procedure calls over the Internet. </li></ul><ul><li>Remote procedure calling services using HTTP as the transport and XML as the encoding. XML-RPC is designed to be as simple as possible, while allowing complex data structures to be transmitted, processed and returned. </li></ul>
  12. 12. XML-RPC Implementations <ul><li>AOL Server client/server </li></ul><ul><li>Apache client/server </li></ul><ul><li>AppleScript client </li></ul><ul><li>ASP client/server </li></ul><ul><li>Axapta client/server </li></ul><ul><li>C/C++ client/server </li></ul><ul><li>C client/server </li></ul><ul><li>Cold Fusion client/server </li></ul><ul><li>COM client/server </li></ul><ul><li>Delphi/Kylix client/server </li></ul><ul><li>Dylan client/server </li></ul><ul><li>Eiffel client/server </li></ul><ul><li>Flash client </li></ul><ul><li>Frontier client/server </li></ul><ul><li>Guile client/server </li></ul><ul><li>Internet Expolrer client </li></ul><ul><li>J2ME client </li></ul><ul><li>Java client/server </li></ul><ul><li>JavaScript client </li></ul><ul><li>K client/server </li></ul><ul><li>KDE client/server </li></ul><ul><li>Lingo client </li></ul><ul><li>Lisp client/server </li></ul><ul><li>Macintosh OS X client/server </li></ul><ul><li>Microsoft .NET client/server </li></ul><ul><li>Mozilla client </li></ul><ul><li>Objective C client/server </li></ul><ul><li>Perl client/server </li></ul><ul><li>PHP client/server </li></ul><ul><li>Pike server </li></ul><ul><li>Python client/server </li></ul><ul><li>REALBasic client </li></ul><ul><li>Rebol client/server </li></ul><ul><li>Ruby client/server </li></ul><ul><li>Scheme client </li></ul><ul><li>Tcl client/server </li></ul><ul><li>Tintware client/server </li></ul><ul><li>WebObjects client/server </li></ul><ul><li>Zope client/server </li></ul>
  13. 13. Default Sink Client (available 11/15/2002) <ul><li>Data Access Methods : </li></ul><ul><li>Web via URL </li></ul><ul><li>FTP via anonymous FTP </li></ul><ul><li>Email via request form </li></ul><ul><li>Database Query </li></ul><ul><li>Other methods required by us </li></ul>Query results of latest catalog entries Status Updates Applet or Application Filtering Available based on XML hierarchy
  14. 14. Default Source Client (available 11/15/2002) Applet or Application For Querying and Filtering
  15. 15. Miles’ Parting Shots <ul><li>Remember: We’re trying to say: </li></ul><ul><li>Collaboration begins with sharing information </li></ul><ul><li>Each of our projects is both a data source and data sink within the PRISM program </li></ul><ul><li>By “communicating” through our data and information, we reduce the need for numerous solutions to similar tasks of data distribution, formatting, archiving, and retrieval tasks </li></ul>
  16. 16. Have Fun!