SlideShare a Scribd company logo
1 of 24
Observing Weather and Climate FROM THE GROUND UP A Nationwide Network of Networks R. E. Carbone 10 August 2009 AMS Summer Community Meeting Weather and Climate Enterprise Commission 1
Committee on Developing Mesoscale Meteorological Observational Capabilities to Meet Multiple National Needs. Sponsors: NOAA, NASA, EPA, DOT, DHS, OFCM RICHARD E. (RIT) CARBONE (Chair)  NCAR, Boulder, CO  JAMES BLOCK  DTN/Meteorlogix, Minneapolis, MN S. EDWARD BOSELLY  Weather Solutions Group, Olympia, WA GREGORY R. CARMICHAEL  University of Iowa, Iowa City FREDERICK H. CARR  University of Oklahoma, Norman V. (CHANDRA) CHANDRASEKAR  Colorado State University, Fort Collins EVE GRUNTFEST NCAR, Boulder, CO  Liaison: Walter F. Dabberdt Board of Atmospheric Sciences  and Climate NRC Staff: CURTIS MARSHALL  Senior Program Officer ROB GREENWAY,  Senior Program Assistant RAYMOND M. HOFF  University of Maryland Baltimore Co. WITOLD F. KRAJEWSKI University of Iowa, Iowa City MARGARET A. LEMONE NCAR, Boulder, CO JAMES F.W. PURDOM Colorado State University, Fort Collins THOMAS W. SCHLATTER University of Colorado, Boulder EUGENE S. TAKLE Iowa State University, Ames JAY TITLOW Weatherflow, Inc., Poquoson, VA 2
Study Tasks, Goals, Foci Develop an “overarching vision” for an integrated, flexible, adaptive, and multi-purpose network We did not engage in network design. Focus on requirements for the United States and adjacent coastal zones Emphasize the planetary boundary layer      (~2 meters below the surface to 2-3 km above) Identify steps to develop a network that meets “multiple national needs” in a cost-effective manner. 3
Multiple National Needs We framed the whole study around major applications. Health and Safety Transportation Food and Water Energy Security 4
How should we define mesoscale observations?* Those that resolvemesoscale structure and detect events? Those that enable dynamical prediction? Non-meteorologicalobs having influence on weather? Environmental conditionsinfluenced by weather? All of the above. Which raises the bar considerably *In the context of satellites and the global obs system
Diverse Players energetic and chaotic Complex Widely vested Driven by local market forces Countless Users and Uses Thousands of providers 17 Federal Agencies Multiple Agencies in all States Municipalities Water Districts Various Local Authorities Agricultural Producers Fortune 500 Corporations Countless small businesses Universities, Research Labs K-12 Schools Enthusiasts and hobbyists 6
Current Statusenergetic and chaotic Weaknesses Mostly locally driven Lacking a national strategy Disparate systems Single application Unknown exposures Unknown standards  Various comms protocols A condition of “false sparsity” Spatial gaps and sensor gaps  Soil moisture Oklahoma, “gold Standard” or “lunatic fringe” ?? Strengths dense surface networks responsive to local needs grass roots participation near population centers regional collectives  Few vertical profiles Increased coordination is indicated.
What’s needed to improve functionality and increase benefits to the nation? Provide an organizational framework                              for coordination, integration and interoperability Make far better use of what we have                     to satisfy multiple national applications Augment current observations        in the strategic gaps identified 8
A Challenge To preserve and enhance the rich diversity of investment (mainly motivated by unique local interests)  While also introducing sufficient coordination To realize increased benefits for multiple national needs. 9
What Observations are Needed?And what enhancements do these infer? Basic Infrastructure to Monitor and Predict Mesoscale Weather Energy Security Public Health and Safety Transportation  Water Resources and Food Production We looked for “common threads” among these. We also discussed the benefits to be derived for and from research.
A Phenomenological Approach                  was used for core weather monitoring and prediction components
Common Threads Ximportant gaps may exist;     so inadequate that no network can be said to exist.
Inferred Priorities from Common Threads   MOST NEEDED:Profile Data  ,[object Object]
Soil moisture and temperature profiles
High resolution vertical profiles of humidity
ABOVE THE SURFACE LAYER: carbon monoxide, sulfur dioxide, ozone, and particulate matter < 2.5µ micronsNEEDED: ,[object Object]
High vertical resolution profiles of wind and temperature
Sub-surface temperature profiles (e.g., under pavement)
Icing near the surface
Surface turbulence parametersUrban, Coastal and Mountainous Regions  have added complexity, increased societal impact,  and are especially in need of augmentation.  13
The Vision To create the network of our dreams… A Network of Networks (NoN), serving multiple applications, jointly provided and used by government, industry, academia and the public. NoN could be enabled to dynamically configure customized networks….. As specified by the users themselves. Albeit at different levels of effectiveness, this can be implemented with or without additional observing systems.
Steps to Ensure Progress  15
Key Attributes of an Idealized NoN Stability and Continuity Incentives to Participate  Metadata, Metadata, Metadata Access to More and Better Data  Establish and protect data/IP rights Rolling review of societal needs, gaps, requirements Flexibility to evolve and adapt to new conditions across sectors A local presence for regular contact with providers and stakeholders 16
Essential Core Services We recommend 13 enabling services:     Expert assistance and monetary incentives to maintain standards Knowledge of data available and suitable to one’s own application Ease of access to custom-configured sets of observations/analyses  Archival of data commensurate with useful lifetimes  Economy of access to products and services from other providers The importance of extensive metadata is absolutely critical to the effectiveness of an NoN.   17 categories of metadata are defined

More Related Content

Similar to ams2009scm-01-Carbone

2008-02-11: EPA DataFed Presentation
2008-02-11: EPA DataFed Presentation2008-02-11: EPA DataFed Presentation
2008-02-11: EPA DataFed Presentation
Rudolf Husar
 
2004-07-28 Fast Aerosol Sensing Tools for Natural Event Tracking FASTNET
2004-07-28 Fast Aerosol Sensing Tools for Natural Event Tracking FASTNET2004-07-28 Fast Aerosol Sensing Tools for Natural Event Tracking FASTNET
2004-07-28 Fast Aerosol Sensing Tools for Natural Event Tracking FASTNET
Rudolf Husar
 
2003-12-02 Environmental Information Systems for Monitoring, Assessment, and ...
2003-12-02 Environmental Information Systems for Monitoring, Assessment, and ...2003-12-02 Environmental Information Systems for Monitoring, Assessment, and ...
2003-12-02 Environmental Information Systems for Monitoring, Assessment, and ...
Rudolf Husar
 
Data accessibility and the role of informatics in predicting the biosphere
Data accessibility and the role of informatics in predicting the biosphereData accessibility and the role of informatics in predicting the biosphere
Data accessibility and the role of informatics in predicting the biosphere
Alex Hardisty
 
Evaluating Rewards for Environmental Services Schemes
Evaluating Rewards for Environmental Services SchemesEvaluating Rewards for Environmental Services Schemes
Evaluating Rewards for Environmental Services Schemes
World Agroforestry (ICRAF)
 
Best Practices Framework 3
Best Practices Framework 3Best Practices Framework 3
Best Practices Framework 3
f_pereztrejo
 
2005-10-31 Concepts on Aerosol Characterization
2005-10-31 Concepts on Aerosol Characterization2005-10-31 Concepts on Aerosol Characterization
2005-10-31 Concepts on Aerosol Characterization
Rudolf Husar
 

Similar to ams2009scm-01-Carbone (20)

2008-02-11: EPA DataFed Presentation
2008-02-11: EPA DataFed Presentation2008-02-11: EPA DataFed Presentation
2008-02-11: EPA DataFed Presentation
 
2004-07-28 Fast Aerosol Sensing Tools for Natural Event Tracking FASTNET
2004-07-28 Fast Aerosol Sensing Tools for Natural Event Tracking FASTNET2004-07-28 Fast Aerosol Sensing Tools for Natural Event Tracking FASTNET
2004-07-28 Fast Aerosol Sensing Tools for Natural Event Tracking FASTNET
 
Fastnet Awma Em
Fastnet Awma EmFastnet Awma Em
Fastnet Awma Em
 
Frankenberger - Do Edge of Field Monitoring Results Inform, Support, and Improve
Frankenberger - Do Edge of Field Monitoring Results Inform, Support, and ImproveFrankenberger - Do Edge of Field Monitoring Results Inform, Support, and Improve
Frankenberger - Do Edge of Field Monitoring Results Inform, Support, and Improve
 
Citizen Sensing Efforts November 2011
Citizen Sensing Efforts   November 2011Citizen Sensing Efforts   November 2011
Citizen Sensing Efforts November 2011
 
Software Sustainability Institute
Software Sustainability InstituteSoftware Sustainability Institute
Software Sustainability Institute
 
2003-12-02 Environmental Information Systems for Monitoring, Assessment, and ...
2003-12-02 Environmental Information Systems for Monitoring, Assessment, and ...2003-12-02 Environmental Information Systems for Monitoring, Assessment, and ...
2003-12-02 Environmental Information Systems for Monitoring, Assessment, and ...
 
AAS National Conference 2008: Mike Freilich
AAS National Conference 2008: Mike FreilichAAS National Conference 2008: Mike Freilich
AAS National Conference 2008: Mike Freilich
 
Data accessibility and the role of informatics in predicting the biosphere
Data accessibility and the role of informatics in predicting the biosphereData accessibility and the role of informatics in predicting the biosphere
Data accessibility and the role of informatics in predicting the biosphere
 
Evaluating Rewards for Environmental Services Schemes
Evaluating Rewards for Environmental Services SchemesEvaluating Rewards for Environmental Services Schemes
Evaluating Rewards for Environmental Services Schemes
 
Totten 189 slides on Catalyzing Zero Emission Cities - presentation to Colora...
Totten 189 slides on Catalyzing Zero Emission Cities - presentation to Colora...Totten 189 slides on Catalyzing Zero Emission Cities - presentation to Colora...
Totten 189 slides on Catalyzing Zero Emission Cities - presentation to Colora...
 
Programme on Climate Information for Resilient Development in Africa
Programme on Climate Information for Resilient Development in AfricaProgramme on Climate Information for Resilient Development in Africa
Programme on Climate Information for Resilient Development in Africa
 
Case study: Programme on Climate Information for Resilient Development in Afr...
Case study: Programme on Climate Information for Resilient Development in Afr...Case study: Programme on Climate Information for Resilient Development in Afr...
Case study: Programme on Climate Information for Resilient Development in Afr...
 
Cloud processing close to the Earth data
Cloud processing close to the Earth dataCloud processing close to the Earth data
Cloud processing close to the Earth data
 
International collaboration with Cloud v1
International collaboration with Cloud v1International collaboration with Cloud v1
International collaboration with Cloud v1
 
Best Practices Framework 3
Best Practices Framework 3Best Practices Framework 3
Best Practices Framework 3
 
The evolution of the Sentinel Landscape initiative
The evolution of the Sentinel Landscape initiativeThe evolution of the Sentinel Landscape initiative
The evolution of the Sentinel Landscape initiative
 
2005-10-31 Concepts on Aerosol Characterization
2005-10-31 Concepts on Aerosol Characterization2005-10-31 Concepts on Aerosol Characterization
2005-10-31 Concepts on Aerosol Characterization
 
Session 3 - Presentation by Ick Hoon Choi
Session 3 - Presentation by Ick Hoon ChoiSession 3 - Presentation by Ick Hoon Choi
Session 3 - Presentation by Ick Hoon Choi
 
DRI and UAS Applications Research
DRI and UAS Applications ResearchDRI and UAS Applications Research
DRI and UAS Applications Research
 

Recently uploaded

Recently uploaded (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 

ams2009scm-01-Carbone

  • 1. Observing Weather and Climate FROM THE GROUND UP A Nationwide Network of Networks R. E. Carbone 10 August 2009 AMS Summer Community Meeting Weather and Climate Enterprise Commission 1
  • 2. Committee on Developing Mesoscale Meteorological Observational Capabilities to Meet Multiple National Needs. Sponsors: NOAA, NASA, EPA, DOT, DHS, OFCM RICHARD E. (RIT) CARBONE (Chair) NCAR, Boulder, CO JAMES BLOCK DTN/Meteorlogix, Minneapolis, MN S. EDWARD BOSELLY Weather Solutions Group, Olympia, WA GREGORY R. CARMICHAEL University of Iowa, Iowa City FREDERICK H. CARR University of Oklahoma, Norman V. (CHANDRA) CHANDRASEKAR Colorado State University, Fort Collins EVE GRUNTFEST NCAR, Boulder, CO Liaison: Walter F. Dabberdt Board of Atmospheric Sciences and Climate NRC Staff: CURTIS MARSHALL Senior Program Officer ROB GREENWAY, Senior Program Assistant RAYMOND M. HOFF University of Maryland Baltimore Co. WITOLD F. KRAJEWSKI University of Iowa, Iowa City MARGARET A. LEMONE NCAR, Boulder, CO JAMES F.W. PURDOM Colorado State University, Fort Collins THOMAS W. SCHLATTER University of Colorado, Boulder EUGENE S. TAKLE Iowa State University, Ames JAY TITLOW Weatherflow, Inc., Poquoson, VA 2
  • 3. Study Tasks, Goals, Foci Develop an “overarching vision” for an integrated, flexible, adaptive, and multi-purpose network We did not engage in network design. Focus on requirements for the United States and adjacent coastal zones Emphasize the planetary boundary layer (~2 meters below the surface to 2-3 km above) Identify steps to develop a network that meets “multiple national needs” in a cost-effective manner. 3
  • 4. Multiple National Needs We framed the whole study around major applications. Health and Safety Transportation Food and Water Energy Security 4
  • 5. How should we define mesoscale observations?* Those that resolvemesoscale structure and detect events? Those that enable dynamical prediction? Non-meteorologicalobs having influence on weather? Environmental conditionsinfluenced by weather? All of the above. Which raises the bar considerably *In the context of satellites and the global obs system
  • 6. Diverse Players energetic and chaotic Complex Widely vested Driven by local market forces Countless Users and Uses Thousands of providers 17 Federal Agencies Multiple Agencies in all States Municipalities Water Districts Various Local Authorities Agricultural Producers Fortune 500 Corporations Countless small businesses Universities, Research Labs K-12 Schools Enthusiasts and hobbyists 6
  • 7. Current Statusenergetic and chaotic Weaknesses Mostly locally driven Lacking a national strategy Disparate systems Single application Unknown exposures Unknown standards Various comms protocols A condition of “false sparsity” Spatial gaps and sensor gaps Soil moisture Oklahoma, “gold Standard” or “lunatic fringe” ?? Strengths dense surface networks responsive to local needs grass roots participation near population centers regional collectives Few vertical profiles Increased coordination is indicated.
  • 8. What’s needed to improve functionality and increase benefits to the nation? Provide an organizational framework for coordination, integration and interoperability Make far better use of what we have to satisfy multiple national applications Augment current observations in the strategic gaps identified 8
  • 9. A Challenge To preserve and enhance the rich diversity of investment (mainly motivated by unique local interests) While also introducing sufficient coordination To realize increased benefits for multiple national needs. 9
  • 10. What Observations are Needed?And what enhancements do these infer? Basic Infrastructure to Monitor and Predict Mesoscale Weather Energy Security Public Health and Safety Transportation Water Resources and Food Production We looked for “common threads” among these. We also discussed the benefits to be derived for and from research.
  • 11. A Phenomenological Approach was used for core weather monitoring and prediction components
  • 12. Common Threads Ximportant gaps may exist; so inadequate that no network can be said to exist.
  • 13.
  • 14. Soil moisture and temperature profiles
  • 15. High resolution vertical profiles of humidity
  • 16.
  • 17. High vertical resolution profiles of wind and temperature
  • 18. Sub-surface temperature profiles (e.g., under pavement)
  • 19. Icing near the surface
  • 20. Surface turbulence parametersUrban, Coastal and Mountainous Regions have added complexity, increased societal impact, and are especially in need of augmentation. 13
  • 21. The Vision To create the network of our dreams… A Network of Networks (NoN), serving multiple applications, jointly provided and used by government, industry, academia and the public. NoN could be enabled to dynamically configure customized networks….. As specified by the users themselves. Albeit at different levels of effectiveness, this can be implemented with or without additional observing systems.
  • 22. Steps to Ensure Progress 15
  • 23. Key Attributes of an Idealized NoN Stability and Continuity Incentives to Participate Metadata, Metadata, Metadata Access to More and Better Data Establish and protect data/IP rights Rolling review of societal needs, gaps, requirements Flexibility to evolve and adapt to new conditions across sectors A local presence for regular contact with providers and stakeholders 16
  • 24. Essential Core Services We recommend 13 enabling services:   Expert assistance and monetary incentives to maintain standards Knowledge of data available and suitable to one’s own application Ease of access to custom-configured sets of observations/analyses Archival of data commensurate with useful lifetimes Economy of access to products and services from other providers The importance of extensive metadata is absolutely critical to the effectiveness of an NoN. 17 categories of metadata are defined
  • 25.
  • 26. Privately Chartered Non-Profit Corporation (501c3 – e.g., ESIP)
  • 28. Seeded Viral NoNx Lead Federal Agency X Multi-level Government Confederation x Government-Industry Confederation x Private For-Profit Corporation We have assumed it is necessary and desirable to engage the full breadth of the mesoscale observations enterprise. 18
  • 29. We highlighted this option A hybrid“Corporation for Environmental Monitoring” To provide 13 “essential core services” Does not own or operate individual networks. An enabling entity that comes into play only insofar as is necessary to realize the added utility and functionality of an NoN. A minimum degree of centralization for coordination and interoperability. Able to receive and transfer funds from all entities, including Congress. A relatively small but vital fraction of the public-private enterprise. 19
  • 30. Convene the Stakeholders Stakeholders, including all levels of government, various private sector interests, and academia should collectively develop and implement a plan for achieving and sustaining a mesoscale observing system to meet multiple national needs. a summit to achieve “buy-in”, followed by numerous professional/technical forums….. 20
  • 31. End User Assessment The stakeholders should commission an independent team of social and physical scientists to conduct end user assessments for selected sectors. current use and value in decision-making; anticipated added value associated with proposed new observations periodic assessments of the societal impact and its value This is envisioned as an ongoing and recurring activity. 21
  • 32. A Multi-faceted Relationship to Research As users for the conduct of research leverages a national backbone, lower cost, better experiments everywhere As providers of data to the broader NoN improved analyses, “testbeds” to assess the utility of added observations As developers of advanced technologies opportunity to investigate and demonstrate their potential use and value The opportunities may be especially ripe for biosphere, hydrosphere, atmosphere interactions (e.g. CASA, NEON, CUASHI). 22
  • 33. Take Home Message We have a dream: A NoN that is dynamically user-configurable and interoperable. Participating organizations serve only their own mission, while their contributions are enabled to serve multiple national needs. The organization should mirror the stakeholders themselves, being similarly adept and responsive to large agencies, academia, major corporations, local districts, small businesses and volunteers. The most formidable challenge before us is to assemble this grand alliance! 23
  • 34. Questions? Comments? Committee on Developing Mesoscale Meteorological Observational Capabilities to Meet Multiple National Needs. Irvine, CA, February 2008. Photo courtesy of Peggy LeMone.