SlideShare a Scribd company logo
1 of 117
Download to read offline
Machine learning for evaluating
climate model projections
@ZLabe
Zachary M. Labe
Postdoc at Princeton University and NOAA GFDL
7 December 2022 – Tech Talks 2.0
IEEE Student Branch ITTI & IEEE GRSS IITI
https://zacklabe.com/
Machine Learning
is not new!
But…
Machine Learning
is not new!
Artificial Intelligence
Machine Learning
Deep Learning
Computer Science
Computer Science
Artificial Intelligence
Machine Learning
Deep Learning
Supervised
Learning
Unsupervised
Learning
Labeled data
Classification
Regression
Unlabeled data
Clustering
Dimension reduction
• Do it better
• e.g., parameterizations in climate models are not
perfect, use ML to make them more accurate
• Do it faster
• e.g., code in climate models is very slow (but we
know the right answer) - use ML methods to speed
things up
• Do something new
• e.g., go looking for non-linear relationships you
didn’t know were there
Very relevant for
research: may be
slower and worse,
but can still learn
something
WHY SHOULD WE CONSIDER
MACHINE LEARNING?
GROWING DATA
Adapted from: Kotamarthi, R., Hayhoe, K., Mearns, L., Wuebbles, D., Jacobs, J., & Jurado, J.
(2021). Global Climate Models. In Downscaling Techniques for High-Resolution Climate
Projections: From Global Change to Local Impacts (pp. 19-39). Cambridge: Cambridge University
Press. doi:10.1017/9781108601269.003
CLIMATE MODELS
Horizontal Grid
Vertical Levels
Past/Present/Future
Fully-Coupled System
20-40 Petabytes of data
ADAPTED FROM EYRING ET AL. 2016
CMIP6
GROWING TOOLS
Python tools for machine learning
Today’s weather or climate
scientist is far more likely to be
debugging code written in
Python… than to be poring over
satellite images or releasing
radiosondes.
“
D. Irving| Bulletin of the American Meteorological Society| 2016
Machine learning for weather
IDENTIFYING SEVERE THUNDERSTORMS
Molina et al. 2021
Toms et al. 2021
CLASSIFYING PHASE OF MADDEN-JULLIAN OSCILLATION
SATELLITE DETECTION
Lee et al. 2021
DETECTING TORNADOES
McGovern et al. 2019
Machine learning for climate
FINDING FORECASTS OF OPPORTUNITY
Mayer and Barnes, 2021
PREDICTING CLIMATE MODES OF VARIABILITY
Gordon et al. 2021
TIMING OF CLIMATE CHANGE
Barnes et al. 2019
INPUT
[DATA]
PREDICTION
Machine
Learning
INPUT
[DATA]
PREDICTION
~Statistical
Algorithm~
INPUT
[DATA]
PREDICTION
Machine
Learning
NSF AI Institute for Research
on Trustworthy AI in Weather,
Climate, and Coastal
Oceanography (AI2ES)
https://www.ai2es.org/
E.g.,
Research to
Operations (R2O)
Tornado Warning
Special Marine Warning
Severe Thunderstorm Warning
Flash Flood Warning
E.g.,
Establish robust,
responsible AI for
severe weather
detection
Tornado Warning
Special Marine Warning
Severe Thunderstorm Warning
Flash Flood Warning
Artificial Intelligence
Machine Learning
Deep Learning
X1
X2
INPUTS
Artificial Neural Networks [ANN]
Linear regression!
Artificial Neural Networks [ANN]
X1
X2
W1
W2
∑ = X1W1+ X2W2 + b
INPUTS
NODE
Artificial Neural Networks [ANN]
X1
X2
W1
W2
∑
INPUTS
NODE
Linear regression with non-linear
mapping by an “activation function”
Training of the network is merely
determining the weights “w” and
bias/offset “b"
= factivation(X1W1+ X2W2 + b)
Artificial Neural Networks [ANN]
X1
X2
W1
W2
∑
INPUTS
NODE
= factivation(X1W1+ X2W2 + b)
ReLU Sigmoid Linear
X1
X2
∑
inputs
HIDDEN LAYERS
X3
∑
∑
∑
OUTPUT
= predictions
Artificial Neural Networks [ANN]
: : ::
INPUTS
Complexity and nonlinearities of the ANN allow it to learn many
different pathways of predictable behavior
Once trained, you have an array of weights and biases which can be
used for prediction on new data
INPUT
[DATA]
PREDICTION
Artificial Neural Networks [ANN]
TEMPERATURE
TEMPERATURE
We know some metadata…
+ What year is it?
+ Where did it come from?
We know some metadata…
+ What year is it?
+ Where did it come from?
TEMPERATURE
We know some metadata…
+ What year is it?
+ Where did it come from?
TEMPERATURE
Neural network learns nonlinear
combinations of forced climate
patterns to identify the year
----ANN----
2 Hidden Layers
10 Nodes each
Ridge Regularization
Early Stopping
We know some metadata…
+ What year is it?
+ Where did it come from?
[e.g., Barnes et al. 2019, 2020]
[e.g., Labe and Barnes, 2021]
TIMING OF EMERGENCE
(COMBINED VARIABLES)
RESPONSES TO
EXTERNAL CLIMATE
FORCINGS
PATTERNS OF
CLIMATE INDICATORS
[e.g., Rader et al. 2022]
Surface Temperature Map Precipitation Map
+
TEMPERATURE
----ANN----
2 Hidden Layers
10 Nodes each
Ridge Regularization
Early Stopping
We know some metadata…
+ What year is it?
+ Where did it come from?
[e.g., Barnes et al. 2019, 2020]
[e.g., Labe and Barnes, 2021]
TIMING OF EMERGENCE
(COMBINED VARIABLES)
RESPONSES TO
EXTERNAL CLIMATE
FORCINGS
PATTERNS OF
CLIMATE INDICATORS
Surface Temperature Map Precipitation Map
+
TEMPERATURE
[e.g., Rader et al. 2022]
THE REAL WORLD
(Observations)
What is the annual mean temperature of Earth?
What is the annual mean temperature of Earth?
THE REAL WORLD
(Observations)
Anomaly is relative to 1951-1980
What is the annual mean temperature of Earth?
THE REAL WORLD
(Observations)
Let’s run a
climate model
What is the annual mean temperature of Earth?
THE REAL WORLD
(Observations)
Let’s run a
climate model
again
What is the annual mean temperature of Earth?
THE REAL WORLD
(Observations)
Let’s run a
climate model
again & again
What is the annual mean temperature of Earth?
THE REAL WORLD
(Observations)
CLIMATE MODEL
ENSEMBLES
What is the annual mean temperature of Earth?
THE REAL WORLD
(Observations)
CLIMATE MODEL
ENSEMBLES
Range of ensembles
= internal variability (noise)
Mean of ensembles
= forced response (climate change)
What is the annual mean temperature of Earth?
Range of ensembles
= internal variability (noise)
Mean of ensembles
= forced response (climate change)
But let’s remove
climate change…
What is the annual mean temperature of Earth?
Range of ensembles
= internal variability (noise)
Mean of ensembles
= forced response (climate change)
After removing the
forced response…
anomalies/noise!
What is the annual mean temperature of Earth?
• Increasing greenhouse gases (CO2, CH4, N2O)
• Changes in industrial aerosols (SO4, BC, OC)
• Changes in biomass burning (aerosols)
• Changes in land-use & land-cover (albedo)
What is the annual mean temperature of Earth?
• Increasing greenhouse gases (CO2, CH4, N2O)
• Changes in industrial aerosols (SO4, BC, OC)
• Changes in biomass burning (aerosols)
• Changes in land-use & land-cover (albedo)
Plus everything else…
(Natural/internal variability)
What is the annual mean temperature of Earth?
Greenhouse gases fixed to 1920 levels
All forcings (CESM-LE)
Industrial aerosols fixed to 1920 levels
[Deser et al. 2020, JCLI]
Fully-coupled CESM1.1
20 Ensemble Members
Run from 1920-2080
Observations
So what?
Greenhouse gases = warming
Aerosols = ?? (though mostly cooling)
What are the relative responses
between greenhouse gas
and aerosol forcing?
Surface Temperature Map
ARTIFICIAL NEURAL NETWORK (ANN)
INPUT LAYER
Surface Temperature Map
ARTIFICIAL NEURAL NETWORK (ANN)
INPUT LAYER
HIDDEN LAYERS
OUTPUT LAYER
Surface Temperature Map
“2000-2009”
DECADE CLASS
“2070-2079”
“1920-1929”
ARTIFICIAL NEURAL NETWORK (ANN)
INPUT LAYER
HIDDEN LAYERS
OUTPUT LAYER
Surface Temperature Map
“2000-2009”
DECADE CLASS
“2070-2079”
“1920-1929”
BACK-PROPAGATE THROUGH NETWORK = EXPLAINABLE AI
ARTIFICIAL NEURAL NETWORK (ANN)
INPUT LAYER
HIDDEN LAYERS
OUTPUT LAYER
Layer-wise Relevance Propagation
Surface Temperature Map
“2000-2009”
DECADE CLASS
“2070-2079”
“1920-1929”
BACK-PROPAGATE THROUGH NETWORK = EXPLAINABLE AI
ARTIFICIAL NEURAL NETWORK (ANN)
[Barnes et al. 2020, JAMES]
[Labe and Barnes 2021, JAMES]
LAYER-WISE RELEVANCE PROPAGATION (LRP)
Volcano
Great White
Shark
Timber
Wolf
Image Classification LRP
https://heatmapping.org/
LRP heatmaps show regions
of “relevance” that
contribute to the neural
network’s decision-making
process for a sample
belonging to a particular
output category
Neural Network
WHY
WHY
WHY
Backpropagation – LRP
LAYER-WISE RELEVANCE PROPAGATION (LRP)
Volcano
Great White
Shark
Timber
Wolf
Image Classification LRP
https://heatmapping.org/
LRP heatmaps show regions
of “relevance” that
contribute to the neural
network’s decision-making
process for a sample
belonging to a particular
output category
Neural Network
WHY
WHY
WHY
Backpropagation – LRP
LAYER-WISE RELEVANCE PROPAGATION (LRP)
Volcano
Great White
Shark
Timber
Wolf
Image Classification LRP
https://heatmapping.org/
LRP heatmaps show regions
of “relevance” that
contribute to the neural
network’s decision-making
process for a sample
belonging to a particular
output category
Neural Network
Backpropagation – LRP
WHY
WHY
WHY
LAYER-WISE RELEVANCE PROPAGATION (LRP)
Image Classification LRP
https://heatmapping.org/
NOT PERFECT
Crock
Pot
Neural Network
Backpropagation – LRP
WHY
[Adapted from Adebayo et al., 2020]
EXPLAINABLE AI IS
NOT PERFECT
THERE ARE MANY
METHODS
[Adapted from Adebayo et al., 2020]
THERE ARE MANY
METHODS
EXPLAINABLE AI IS
NOT PERFECT
OUTPUT LAYER
Layer-wise Relevance Propagation
“2000-2009”
DECADE CLASS
“2070-2079”
“1920-1929”
BACK-PROPAGATE THROUGH NETWORK = EXPLAINABLE AI
WHY?
= LRP HEAT MAPS
[Labe and Barnes 2021, JAMES]
Layer-wise Relevance Propagation
BACK-PROPAGATE THROUGH NETWORK = EXPLAINABLE AI
WHY?
= LRP HEAT MAPS
Machine Learning
Black Box
[Labe and Barnes 2021, JAMES]
Layer-wise Relevance Propagation
BACK-PROPAGATE THROUGH NETWORK = EXPLAINABLE AI
WHY?
= LRP HEAT MAPS
Find regions of “relevance”
that contribute to the
neural network’s
decision-making process
[Labe and Barnes 2021, JAMES]
1960-1999: ANNUAL MEAN TEMPERATURE TRENDS
Greenhouse gases fixed
to 1920 levels
[AEROSOLS PREVAIL]
Industrial aerosols fixed
to 1920 levels
[GREENHOUSE GASES PREVAIL]
All forcings
[STANDARD CESM-LE]
DATA
1960-1999: ANNUAL MEAN TEMPERATURE TRENDS
Greenhouse gases fixed
to 1920 levels
[AEROSOLS PREVAIL]
Industrial aerosols fixed
to 1920 levels
[GREENHOUSE GASES PREVAIL]
All forcings
[STANDARD CESM-LE]
DATA
1960-1999: ANNUAL MEAN TEMPERATURE TRENDS
Greenhouse gases fixed
to 1920 levels
[AEROSOLS PREVAIL]
Industrial aerosols fixed
to 1920 levels
[GREENHOUSE GASES PREVAIL]
All forcings
[STANDARD CESM-LE]
DATA
1960-1999: ANNUAL MEAN TEMPERATURE TRENDS
Greenhouse gases fixed
to 1920 levels
[AEROSOLS PREVAIL]
Industrial aerosols fixed
to 1920 levels
[GREENHOUSE GASES PREVAIL]
All forcings
[STANDARD CESM-LE]
DATA
CLIMATE MODEL DATA PREDICT THE YEAR FROM MAPS OF TEMPERATURE
AEROSOLS
PREVAIL
GREENHOUSE GASES
PREVAIL
STANDARD
CLIMATE MODEL
[Labe and Barnes 2021, JAMES]
OBSERVATIONS PREDICT THE YEAR FROM MAPS OF TEMPERATURE
AEROSOLS
PREVAIL
GREENHOUSE GASES
PREVAIL
STANDARD
CLIMATE MODEL
[Labe and Barnes 2021, JAMES]
OBSERVATIONS
SLOPES
PREDICT THE YEAR FROM MAPS OF TEMPERATURE
AEROSOLS
PREVAIL
GREENHOUSE GASES
PREVAIL
STANDARD
CLIMATE MODEL
[Labe and Barnes 2021, JAMES]
HOW DID THE ANN
MAKE ITS
PREDICTIONS?
HOW DID THE ANN
MAKE ITS
PREDICTIONS?
WHY IS THERE
GREATER SKILL
FOR GHG+?
RESULTS FROM LRP
[Labe and Barnes 2021, JAMES]
Low High
RESULTS FROM LRP
[Labe and Barnes 2021, JAMES]
Low High
RESULTS FROM LRP
[Labe and Barnes 2021, JAMES]
Low High
RESULTS FROM LRP
[Labe and Barnes 2021, JAMES]
Low High
Earth is warming!
https://research.noaa.gov/article/ArtMID/587/ArticleID/2756/Simulated-
geoengineering-evaluation-cooler-planet-but-with-side-effects
Could we detect whether we were under the
influence of stratospheric aerosol injection (SAI)
using regional climate patterns?
TEMPERATURE
YEAR 2045
SAI? SAI?
PRECIPITATION
YEAR 2045
SAI? SAI?
LET’S TRY ANOMALIES
YEAR 2045
PROJECTIONS OF
TEMPERATURE
PROJECTIONS OF
PRECIPITATION
CAN WE DETECT A SAI WORLD?
LOGISTIC REGRESSION
CLIMATOLOGICAL MAPS OF ARISE-SAI-1.5 IN 2050-2069
MEAN STATE
DECADAL TRENDS
TEMPERATURE
DECADAL TRENDS
TEMPERATURE
DECADAL TRENDS
PRECIPITATION
DECADAL TRENDS
PRECIPITATION
N
Y
HIDDEN LAYERS
INPUT LAYER
INPUT LAYER
SAI WORLD?
or
or
map of near-surface temperature
map of near-surface temperature
map of total precipitation
map of total precipitation
Years Since
SAI Injection
OUTPUT
LOGISTIC
REGRESSION
ARTIFICAL
NEURAL
NETWORK
softmax
N
Y
HIDDEN LAYERS
INPUT LAYER
INPUT LAYER
SAI WORLD?
or
or
map of near-surface temperature
map of near-surface temperature
map of total precipitation
map of total precipitation
Years Since
SAI Injection
OUTPUT
LOGISTIC
REGRESSION
ARTIFICAL
NEURAL
NETWORK
softmax
CAN WE DETECT A SAI WORLD?
Central
Africa
HOW DID THE ML MODEL KNOW?
…Using regional climate patterns!
CAN WE DETECT A SAI WORLD?
PRECIPITATION
PRECIPITATION
PRECIPITATION
PRECIPITATION
PRECIPITATION
N
Y
HIDDEN LAYERS
INPUT LAYER
INPUT LAYER
SAI WORLD?
or
or
map of near-surface temperature
map of near-surface temperature
map of total precipitation
map of total precipitation
Years Since
SAI Injection
OUTPUT
LOGISTIC
REGRESSION
ARTIFICAL
NEURAL
NETWORK
softmax
TEMPERATURE
PRECIPITATION
INPUT
[DATA]
PREDICTION
Machine
Learning
Explainable AI
Learn new
science!
MACHINE LEARNING IS JUST
ANOTHER TOOL TO ADD TO OUR
WORKFLOW.
1)
MACHINE LEARNING IS
NO LONGER A BLACK BOX.
2)
WE CAN LEARN NEW SCIENCE
FROM EXPLAINABLE AI.
3)
KEY POINTS
1. Machine learning is just another tool to add to our scientific workflow
2. We can use explainable AI (XAI) methods to peer into the black box of machine learning
3. We can learn new science by using XAI methods in conjunction with existing statistical tools
Zachary Labe
zachary.labe@noaa.gov
@ZLabe
Labe, Z.M. and E.A. Barnes (2021), Detecting climate signals using explainable AI with single-forcing
large ensembles. Journal of Advances in Modeling Earth Systems, DOI:10.1029/2021MS002464
Labe, Z.M., E.A. Barnes, and J.W. Hurrell (2023), Identifying the regional emergence of climate patterns
in a simulation of stratospheric aerosol injection, to be submitted in December 2022

More Related Content

Similar to Machine learning for evaluating climate model projections

Explainable AI approach for evaluating climate models in the Arctic
Explainable AI approach for evaluating climate models in the ArcticExplainable AI approach for evaluating climate models in the Arctic
Explainable AI approach for evaluating climate models in the ArcticZachary Labe
 
Using explainable AI to identify key regions of climate change in GFDL SPEAR ...
Using explainable AI to identify key regions of climate change in GFDL SPEAR ...Using explainable AI to identify key regions of climate change in GFDL SPEAR ...
Using explainable AI to identify key regions of climate change in GFDL SPEAR ...Zachary Labe
 
Creative machine learning approaches for climate change detection
Creative machine learning approaches for climate change detectionCreative machine learning approaches for climate change detection
Creative machine learning approaches for climate change detectionZachary Labe
 
Explainable neural networks for evaluating patterns of climate change and var...
Explainable neural networks for evaluating patterns of climate change and var...Explainable neural networks for evaluating patterns of climate change and var...
Explainable neural networks for evaluating patterns of climate change and var...Zachary Labe
 
Using explainable machine learning to evaluate climate change projections
Using explainable machine learning to evaluate climate change projectionsUsing explainable machine learning to evaluate climate change projections
Using explainable machine learning to evaluate climate change projectionsZachary Labe
 
Explainable AI for identifying regional climate change patterns
Explainable AI for identifying regional climate change patternsExplainable AI for identifying regional climate change patterns
Explainable AI for identifying regional climate change patternsZachary Labe
 
Using neural networks to explore regional climate patterns in single-forcing ...
Using neural networks to explore regional climate patterns in single-forcing ...Using neural networks to explore regional climate patterns in single-forcing ...
Using neural networks to explore regional climate patterns in single-forcing ...Zachary Labe
 
Applications of machine learning for climate change and variability
Applications of machine learning for climate change and variabilityApplications of machine learning for climate change and variability
Applications of machine learning for climate change and variabilityZachary Labe
 
Disentangling Climate Forcing in Multi-Model Large Ensembles Using Neural Net...
Disentangling Climate Forcing in Multi-Model Large Ensembles Using Neural Net...Disentangling Climate Forcing in Multi-Model Large Ensembles Using Neural Net...
Disentangling Climate Forcing in Multi-Model Large Ensembles Using Neural Net...Zachary Labe
 
Evaluating global climate models using simple, explainable neural networks
Evaluating global climate models using simple, explainable neural networksEvaluating global climate models using simple, explainable neural networks
Evaluating global climate models using simple, explainable neural networksZachary Labe
 
Climate change extremes by season in the United States
Climate change extremes by season in the United StatesClimate change extremes by season in the United States
Climate change extremes by season in the United StatesZachary Labe
 
Climate Signals in CESM1 Single-Forcing Large Ensembles Revealed by Explainab...
Climate Signals in CESM1 Single-Forcing Large Ensembles Revealed by Explainab...Climate Signals in CESM1 Single-Forcing Large Ensembles Revealed by Explainab...
Climate Signals in CESM1 Single-Forcing Large Ensembles Revealed by Explainab...Zachary Labe
 
An intro to explainable AI for polar climate science
An intro to  explainable AI for  polar climate scienceAn intro to  explainable AI for  polar climate science
An intro to explainable AI for polar climate scienceZachary Labe
 
T. Lucas Makinen x Imperial SBI Workshop
T. Lucas Makinen x Imperial SBI WorkshopT. Lucas Makinen x Imperial SBI Workshop
T. Lucas Makinen x Imperial SBI WorkshopLucasMakinen1
 
Revealing climate change signals with explainable AI
Revealing climate change signals with explainable AIRevealing climate change signals with explainable AI
Revealing climate change signals with explainable AIZachary Labe
 
Explainable AI for distinguishing future climate change scenarios
Explainable AI for distinguishing future climate change scenariosExplainable AI for distinguishing future climate change scenarios
Explainable AI for distinguishing future climate change scenariosZachary Labe
 
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...Chris Rackauckas
 
Application of machine learning in 21cm cosmology
Application of machine learning in 21cm cosmologyApplication of machine learning in 21cm cosmology
Application of machine learning in 21cm cosmologyHayato Shimabukuro
 
Machine learning and climate and weather research
Machine learning and climate and weather researchMachine learning and climate and weather research
Machine learning and climate and weather researchDrMariaMorenodeCastr
 
Agents In An Exponential World Foster
Agents In An Exponential World FosterAgents In An Exponential World Foster
Agents In An Exponential World FosterIan Foster
 

Similar to Machine learning for evaluating climate model projections (20)

Explainable AI approach for evaluating climate models in the Arctic
Explainable AI approach for evaluating climate models in the ArcticExplainable AI approach for evaluating climate models in the Arctic
Explainable AI approach for evaluating climate models in the Arctic
 
Using explainable AI to identify key regions of climate change in GFDL SPEAR ...
Using explainable AI to identify key regions of climate change in GFDL SPEAR ...Using explainable AI to identify key regions of climate change in GFDL SPEAR ...
Using explainable AI to identify key regions of climate change in GFDL SPEAR ...
 
Creative machine learning approaches for climate change detection
Creative machine learning approaches for climate change detectionCreative machine learning approaches for climate change detection
Creative machine learning approaches for climate change detection
 
Explainable neural networks for evaluating patterns of climate change and var...
Explainable neural networks for evaluating patterns of climate change and var...Explainable neural networks for evaluating patterns of climate change and var...
Explainable neural networks for evaluating patterns of climate change and var...
 
Using explainable machine learning to evaluate climate change projections
Using explainable machine learning to evaluate climate change projectionsUsing explainable machine learning to evaluate climate change projections
Using explainable machine learning to evaluate climate change projections
 
Explainable AI for identifying regional climate change patterns
Explainable AI for identifying regional climate change patternsExplainable AI for identifying regional climate change patterns
Explainable AI for identifying regional climate change patterns
 
Using neural networks to explore regional climate patterns in single-forcing ...
Using neural networks to explore regional climate patterns in single-forcing ...Using neural networks to explore regional climate patterns in single-forcing ...
Using neural networks to explore regional climate patterns in single-forcing ...
 
Applications of machine learning for climate change and variability
Applications of machine learning for climate change and variabilityApplications of machine learning for climate change and variability
Applications of machine learning for climate change and variability
 
Disentangling Climate Forcing in Multi-Model Large Ensembles Using Neural Net...
Disentangling Climate Forcing in Multi-Model Large Ensembles Using Neural Net...Disentangling Climate Forcing in Multi-Model Large Ensembles Using Neural Net...
Disentangling Climate Forcing in Multi-Model Large Ensembles Using Neural Net...
 
Evaluating global climate models using simple, explainable neural networks
Evaluating global climate models using simple, explainable neural networksEvaluating global climate models using simple, explainable neural networks
Evaluating global climate models using simple, explainable neural networks
 
Climate change extremes by season in the United States
Climate change extremes by season in the United StatesClimate change extremes by season in the United States
Climate change extremes by season in the United States
 
Climate Signals in CESM1 Single-Forcing Large Ensembles Revealed by Explainab...
Climate Signals in CESM1 Single-Forcing Large Ensembles Revealed by Explainab...Climate Signals in CESM1 Single-Forcing Large Ensembles Revealed by Explainab...
Climate Signals in CESM1 Single-Forcing Large Ensembles Revealed by Explainab...
 
An intro to explainable AI for polar climate science
An intro to  explainable AI for  polar climate scienceAn intro to  explainable AI for  polar climate science
An intro to explainable AI for polar climate science
 
T. Lucas Makinen x Imperial SBI Workshop
T. Lucas Makinen x Imperial SBI WorkshopT. Lucas Makinen x Imperial SBI Workshop
T. Lucas Makinen x Imperial SBI Workshop
 
Revealing climate change signals with explainable AI
Revealing climate change signals with explainable AIRevealing climate change signals with explainable AI
Revealing climate change signals with explainable AI
 
Explainable AI for distinguishing future climate change scenarios
Explainable AI for distinguishing future climate change scenariosExplainable AI for distinguishing future climate change scenarios
Explainable AI for distinguishing future climate change scenarios
 
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
Generalizing Scientific Machine Learning and Differentiable Simulation Beyond...
 
Application of machine learning in 21cm cosmology
Application of machine learning in 21cm cosmologyApplication of machine learning in 21cm cosmology
Application of machine learning in 21cm cosmology
 
Machine learning and climate and weather research
Machine learning and climate and weather researchMachine learning and climate and weather research
Machine learning and climate and weather research
 
Agents In An Exponential World Foster
Agents In An Exponential World FosterAgents In An Exponential World Foster
Agents In An Exponential World Foster
 

More from Zachary Labe

Welcome to GFDL for Take Your Child To Work Day
Welcome to GFDL for Take Your Child To Work DayWelcome to GFDL for Take Your Child To Work Day
Welcome to GFDL for Take Your Child To Work DayZachary Labe
 
Reexamining future projections of Arctic climate linkages
Reexamining future projections of Arctic climate linkagesReexamining future projections of Arctic climate linkages
Reexamining future projections of Arctic climate linkagesZachary Labe
 
Techniques and Considerations for Improving Accessibility in Online Media
Techniques and Considerations for Improving Accessibility in Online MediaTechniques and Considerations for Improving Accessibility in Online Media
Techniques and Considerations for Improving Accessibility in Online MediaZachary Labe
 
Using accessible data to communicate global climate change
Using accessible data to communicate global climate changeUsing accessible data to communicate global climate change
Using accessible data to communicate global climate changeZachary Labe
 
Water in a Frozen Arctic: Cross-Disciplinary Perspectives
Water in a Frozen Arctic: Cross-Disciplinary PerspectivesWater in a Frozen Arctic: Cross-Disciplinary Perspectives
Water in a Frozen Arctic: Cross-Disciplinary PerspectivesZachary Labe
 
data-driven approach to identifying key regions of change associated with fut...
data-driven approach to identifying key regions of change associated with fut...data-driven approach to identifying key regions of change associated with fut...
data-driven approach to identifying key regions of change associated with fut...Zachary Labe
 
Distinguishing the regional emergence of United States summer temperatures be...
Distinguishing the regional emergence of United States summer temperatures be...Distinguishing the regional emergence of United States summer temperatures be...
Distinguishing the regional emergence of United States summer temperatures be...Zachary Labe
 
Researching and Communicating Our Changing Climate
Researching and Communicating Our Changing ClimateResearching and Communicating Our Changing Climate
Researching and Communicating Our Changing ClimateZachary Labe
 
Revisiting projections of Arctic climate change linkages
Revisiting projections of Arctic climate change linkagesRevisiting projections of Arctic climate change linkages
Revisiting projections of Arctic climate change linkagesZachary Labe
 
Visualizing climate change through data
Visualizing climate change through dataVisualizing climate change through data
Visualizing climate change through dataZachary Labe
 
Contrasting polar climate change in the past, present, and future
Contrasting polar climate change in the past, present, and futureContrasting polar climate change in the past, present, and future
Contrasting polar climate change in the past, present, and futureZachary Labe
 
Guest Lecture: Our changing Arctic in the past and future
Guest Lecture: Our changing Arctic in the past and futureGuest Lecture: Our changing Arctic in the past and future
Guest Lecture: Our changing Arctic in the past and futureZachary Labe
 
Climate Projections - What Really is Business as Usual?
Climate Projections - What Really is Business as Usual?Climate Projections - What Really is Business as Usual?
Climate Projections - What Really is Business as Usual?Zachary Labe
 
Making effective science figures
Making effective science figuresMaking effective science figures
Making effective science figuresZachary Labe
 
Monitoring indicators of climate change through data-driven visualization
Monitoring indicators of climate change through data-driven visualizationMonitoring indicators of climate change through data-driven visualization
Monitoring indicators of climate change through data-driven visualizationZachary Labe
 
Techniques and Considerations for Improving Accessibility in Online Media
Techniques and Considerations for Improving Accessibility in Online MediaTechniques and Considerations for Improving Accessibility in Online Media
Techniques and Considerations for Improving Accessibility in Online MediaZachary Labe
 
Career pathways and research opportunities in the Earth sciences
Career pathways and research opportunities in the Earth sciencesCareer pathways and research opportunities in the Earth sciences
Career pathways and research opportunities in the Earth sciencesZachary Labe
 
Telling data-driven climate stories
Telling data-driven climate storiesTelling data-driven climate stories
Telling data-driven climate storiesZachary Labe
 
Evaluating and communicating Arctic climate change projection
Evaluating and communicating Arctic climate change projectionEvaluating and communicating Arctic climate change projection
Evaluating and communicating Arctic climate change projectionZachary Labe
 

More from Zachary Labe (20)

Welcome to GFDL for Take Your Child To Work Day
Welcome to GFDL for Take Your Child To Work DayWelcome to GFDL for Take Your Child To Work Day
Welcome to GFDL for Take Your Child To Work Day
 
Reexamining future projections of Arctic climate linkages
Reexamining future projections of Arctic climate linkagesReexamining future projections of Arctic climate linkages
Reexamining future projections of Arctic climate linkages
 
Techniques and Considerations for Improving Accessibility in Online Media
Techniques and Considerations for Improving Accessibility in Online MediaTechniques and Considerations for Improving Accessibility in Online Media
Techniques and Considerations for Improving Accessibility in Online Media
 
Using accessible data to communicate global climate change
Using accessible data to communicate global climate changeUsing accessible data to communicate global climate change
Using accessible data to communicate global climate change
 
Water in a Frozen Arctic: Cross-Disciplinary Perspectives
Water in a Frozen Arctic: Cross-Disciplinary PerspectivesWater in a Frozen Arctic: Cross-Disciplinary Perspectives
Water in a Frozen Arctic: Cross-Disciplinary Perspectives
 
data-driven approach to identifying key regions of change associated with fut...
data-driven approach to identifying key regions of change associated with fut...data-driven approach to identifying key regions of change associated with fut...
data-driven approach to identifying key regions of change associated with fut...
 
Distinguishing the regional emergence of United States summer temperatures be...
Distinguishing the regional emergence of United States summer temperatures be...Distinguishing the regional emergence of United States summer temperatures be...
Distinguishing the regional emergence of United States summer temperatures be...
 
Researching and Communicating Our Changing Climate
Researching and Communicating Our Changing ClimateResearching and Communicating Our Changing Climate
Researching and Communicating Our Changing Climate
 
Revisiting projections of Arctic climate change linkages
Revisiting projections of Arctic climate change linkagesRevisiting projections of Arctic climate change linkages
Revisiting projections of Arctic climate change linkages
 
Visualizing climate change through data
Visualizing climate change through dataVisualizing climate change through data
Visualizing climate change through data
 
Contrasting polar climate change in the past, present, and future
Contrasting polar climate change in the past, present, and futureContrasting polar climate change in the past, present, and future
Contrasting polar climate change in the past, present, and future
 
Guest Lecture: Our changing Arctic in the past and future
Guest Lecture: Our changing Arctic in the past and futureGuest Lecture: Our changing Arctic in the past and future
Guest Lecture: Our changing Arctic in the past and future
 
Climate Projections - What Really is Business as Usual?
Climate Projections - What Really is Business as Usual?Climate Projections - What Really is Business as Usual?
Climate Projections - What Really is Business as Usual?
 
Making effective science figures
Making effective science figuresMaking effective science figures
Making effective science figures
 
Monitoring indicators of climate change through data-driven visualization
Monitoring indicators of climate change through data-driven visualizationMonitoring indicators of climate change through data-driven visualization
Monitoring indicators of climate change through data-driven visualization
 
Sea Ice Anomalies
Sea Ice AnomaliesSea Ice Anomalies
Sea Ice Anomalies
 
Techniques and Considerations for Improving Accessibility in Online Media
Techniques and Considerations for Improving Accessibility in Online MediaTechniques and Considerations for Improving Accessibility in Online Media
Techniques and Considerations for Improving Accessibility in Online Media
 
Career pathways and research opportunities in the Earth sciences
Career pathways and research opportunities in the Earth sciencesCareer pathways and research opportunities in the Earth sciences
Career pathways and research opportunities in the Earth sciences
 
Telling data-driven climate stories
Telling data-driven climate storiesTelling data-driven climate stories
Telling data-driven climate stories
 
Evaluating and communicating Arctic climate change projection
Evaluating and communicating Arctic climate change projectionEvaluating and communicating Arctic climate change projection
Evaluating and communicating Arctic climate change projection
 

Recently uploaded

Animal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxAnimal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxUmerFayaz5
 
NAVSEA PEO USC - Unmanned & Small Combatants 26Oct23.pdf
NAVSEA PEO USC - Unmanned & Small Combatants 26Oct23.pdfNAVSEA PEO USC - Unmanned & Small Combatants 26Oct23.pdf
NAVSEA PEO USC - Unmanned & Small Combatants 26Oct23.pdfWadeK3
 
Boyles law module in the grade 10 science
Boyles law module in the grade 10 scienceBoyles law module in the grade 10 science
Boyles law module in the grade 10 sciencefloriejanemacaya1
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSarthak Sekhar Mondal
 
A relative description on Sonoporation.pdf
A relative description on Sonoporation.pdfA relative description on Sonoporation.pdf
A relative description on Sonoporation.pdfnehabiju2046
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTSérgio Sacani
 
Scheme-of-Work-Science-Stage-4 cambridge science.docx
Scheme-of-Work-Science-Stage-4 cambridge science.docxScheme-of-Work-Science-Stage-4 cambridge science.docx
Scheme-of-Work-Science-Stage-4 cambridge science.docxyaramohamed343013
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​kaibalyasahoo82800
 
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCESTERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCEPRINCE C P
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...Sérgio Sacani
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...RohitNehra6
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PPRINCE C P
 
Work, Energy and Power for class 10 ICSE Physics
Work, Energy and Power for class 10 ICSE PhysicsWork, Energy and Power for class 10 ICSE Physics
Work, Energy and Power for class 10 ICSE Physicsvishikhakeshava1
 
zoogeography of pakistan.pptx fauna of Pakistan
zoogeography of pakistan.pptx fauna of Pakistanzoogeography of pakistan.pptx fauna of Pakistan
zoogeography of pakistan.pptx fauna of Pakistanzohaibmir069
 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bSérgio Sacani
 
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCRStunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCRDelhi Call girls
 
G9 Science Q4- Week 1-2 Projectile Motion.ppt
G9 Science Q4- Week 1-2 Projectile Motion.pptG9 Science Q4- Week 1-2 Projectile Motion.ppt
G9 Science Q4- Week 1-2 Projectile Motion.pptMAESTRELLAMesa2
 
Biological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfBiological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfmuntazimhurra
 
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...jana861314
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )aarthirajkumar25
 

Recently uploaded (20)

Animal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxAnimal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptx
 
NAVSEA PEO USC - Unmanned & Small Combatants 26Oct23.pdf
NAVSEA PEO USC - Unmanned & Small Combatants 26Oct23.pdfNAVSEA PEO USC - Unmanned & Small Combatants 26Oct23.pdf
NAVSEA PEO USC - Unmanned & Small Combatants 26Oct23.pdf
 
Boyles law module in the grade 10 science
Boyles law module in the grade 10 scienceBoyles law module in the grade 10 science
Boyles law module in the grade 10 science
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
 
A relative description on Sonoporation.pdf
A relative description on Sonoporation.pdfA relative description on Sonoporation.pdf
A relative description on Sonoporation.pdf
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOST
 
Scheme-of-Work-Science-Stage-4 cambridge science.docx
Scheme-of-Work-Science-Stage-4 cambridge science.docxScheme-of-Work-Science-Stage-4 cambridge science.docx
Scheme-of-Work-Science-Stage-4 cambridge science.docx
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​
 
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCESTERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
STERILITY TESTING OF PHARMACEUTICALS ppt by DR.C.P.PRINCE
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C P
 
Work, Energy and Power for class 10 ICSE Physics
Work, Energy and Power for class 10 ICSE PhysicsWork, Energy and Power for class 10 ICSE Physics
Work, Energy and Power for class 10 ICSE Physics
 
zoogeography of pakistan.pptx fauna of Pakistan
zoogeography of pakistan.pptx fauna of Pakistanzoogeography of pakistan.pptx fauna of Pakistan
zoogeography of pakistan.pptx fauna of Pakistan
 
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43bNightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
Nightside clouds and disequilibrium chemistry on the hot Jupiter WASP-43b
 
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCRStunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
 
G9 Science Q4- Week 1-2 Projectile Motion.ppt
G9 Science Q4- Week 1-2 Projectile Motion.pptG9 Science Q4- Week 1-2 Projectile Motion.ppt
G9 Science Q4- Week 1-2 Projectile Motion.ppt
 
Biological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfBiological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdf
 
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
Traditional Agroforestry System in India- Shifting Cultivation, Taungya, Home...
 
Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )Recombination DNA Technology (Nucleic Acid Hybridization )
Recombination DNA Technology (Nucleic Acid Hybridization )
 

Machine learning for evaluating climate model projections

  • 1. Machine learning for evaluating climate model projections @ZLabe Zachary M. Labe Postdoc at Princeton University and NOAA GFDL 7 December 2022 – Tech Talks 2.0 IEEE Student Branch ITTI & IEEE GRSS IITI https://zacklabe.com/
  • 5. Computer Science Artificial Intelligence Machine Learning Deep Learning Supervised Learning Unsupervised Learning Labeled data Classification Regression Unlabeled data Clustering Dimension reduction
  • 6. • Do it better • e.g., parameterizations in climate models are not perfect, use ML to make them more accurate • Do it faster • e.g., code in climate models is very slow (but we know the right answer) - use ML methods to speed things up • Do something new • e.g., go looking for non-linear relationships you didn’t know were there Very relevant for research: may be slower and worse, but can still learn something WHY SHOULD WE CONSIDER MACHINE LEARNING?
  • 8.
  • 9. Adapted from: Kotamarthi, R., Hayhoe, K., Mearns, L., Wuebbles, D., Jacobs, J., & Jurado, J. (2021). Global Climate Models. In Downscaling Techniques for High-Resolution Climate Projections: From Global Change to Local Impacts (pp. 19-39). Cambridge: Cambridge University Press. doi:10.1017/9781108601269.003 CLIMATE MODELS Horizontal Grid Vertical Levels Past/Present/Future Fully-Coupled System 20-40 Petabytes of data
  • 10. ADAPTED FROM EYRING ET AL. 2016 CMIP6
  • 12.
  • 13.
  • 14. Python tools for machine learning
  • 15. Today’s weather or climate scientist is far more likely to be debugging code written in Python… than to be poring over satellite images or releasing radiosondes. “ D. Irving| Bulletin of the American Meteorological Society| 2016
  • 16. Machine learning for weather IDENTIFYING SEVERE THUNDERSTORMS Molina et al. 2021 Toms et al. 2021 CLASSIFYING PHASE OF MADDEN-JULLIAN OSCILLATION SATELLITE DETECTION Lee et al. 2021 DETECTING TORNADOES McGovern et al. 2019
  • 17. Machine learning for climate FINDING FORECASTS OF OPPORTUNITY Mayer and Barnes, 2021 PREDICTING CLIMATE MODES OF VARIABILITY Gordon et al. 2021 TIMING OF CLIMATE CHANGE Barnes et al. 2019
  • 21. NSF AI Institute for Research on Trustworthy AI in Weather, Climate, and Coastal Oceanography (AI2ES) https://www.ai2es.org/
  • 22. E.g., Research to Operations (R2O) Tornado Warning Special Marine Warning Severe Thunderstorm Warning Flash Flood Warning
  • 23. E.g., Establish robust, responsible AI for severe weather detection Tornado Warning Special Marine Warning Severe Thunderstorm Warning Flash Flood Warning
  • 26. Linear regression! Artificial Neural Networks [ANN] X1 X2 W1 W2 ∑ = X1W1+ X2W2 + b INPUTS NODE
  • 27. Artificial Neural Networks [ANN] X1 X2 W1 W2 ∑ INPUTS NODE Linear regression with non-linear mapping by an “activation function” Training of the network is merely determining the weights “w” and bias/offset “b" = factivation(X1W1+ X2W2 + b)
  • 28. Artificial Neural Networks [ANN] X1 X2 W1 W2 ∑ INPUTS NODE = factivation(X1W1+ X2W2 + b) ReLU Sigmoid Linear
  • 30. Complexity and nonlinearities of the ANN allow it to learn many different pathways of predictable behavior Once trained, you have an array of weights and biases which can be used for prediction on new data INPUT [DATA] PREDICTION Artificial Neural Networks [ANN]
  • 32. TEMPERATURE We know some metadata… + What year is it? + Where did it come from?
  • 33. We know some metadata… + What year is it? + Where did it come from? TEMPERATURE
  • 34. We know some metadata… + What year is it? + Where did it come from? TEMPERATURE Neural network learns nonlinear combinations of forced climate patterns to identify the year
  • 35. ----ANN---- 2 Hidden Layers 10 Nodes each Ridge Regularization Early Stopping We know some metadata… + What year is it? + Where did it come from? [e.g., Barnes et al. 2019, 2020] [e.g., Labe and Barnes, 2021] TIMING OF EMERGENCE (COMBINED VARIABLES) RESPONSES TO EXTERNAL CLIMATE FORCINGS PATTERNS OF CLIMATE INDICATORS [e.g., Rader et al. 2022] Surface Temperature Map Precipitation Map + TEMPERATURE
  • 36. ----ANN---- 2 Hidden Layers 10 Nodes each Ridge Regularization Early Stopping We know some metadata… + What year is it? + Where did it come from? [e.g., Barnes et al. 2019, 2020] [e.g., Labe and Barnes, 2021] TIMING OF EMERGENCE (COMBINED VARIABLES) RESPONSES TO EXTERNAL CLIMATE FORCINGS PATTERNS OF CLIMATE INDICATORS Surface Temperature Map Precipitation Map + TEMPERATURE [e.g., Rader et al. 2022]
  • 37. THE REAL WORLD (Observations) What is the annual mean temperature of Earth?
  • 38. What is the annual mean temperature of Earth? THE REAL WORLD (Observations) Anomaly is relative to 1951-1980
  • 39. What is the annual mean temperature of Earth? THE REAL WORLD (Observations) Let’s run a climate model
  • 40. What is the annual mean temperature of Earth? THE REAL WORLD (Observations) Let’s run a climate model again
  • 41. What is the annual mean temperature of Earth? THE REAL WORLD (Observations) Let’s run a climate model again & again
  • 42. What is the annual mean temperature of Earth? THE REAL WORLD (Observations) CLIMATE MODEL ENSEMBLES
  • 43. What is the annual mean temperature of Earth? THE REAL WORLD (Observations) CLIMATE MODEL ENSEMBLES Range of ensembles = internal variability (noise) Mean of ensembles = forced response (climate change)
  • 44. What is the annual mean temperature of Earth? Range of ensembles = internal variability (noise) Mean of ensembles = forced response (climate change) But let’s remove climate change…
  • 45. What is the annual mean temperature of Earth? Range of ensembles = internal variability (noise) Mean of ensembles = forced response (climate change) After removing the forced response… anomalies/noise!
  • 46. What is the annual mean temperature of Earth? • Increasing greenhouse gases (CO2, CH4, N2O) • Changes in industrial aerosols (SO4, BC, OC) • Changes in biomass burning (aerosols) • Changes in land-use & land-cover (albedo)
  • 47. What is the annual mean temperature of Earth? • Increasing greenhouse gases (CO2, CH4, N2O) • Changes in industrial aerosols (SO4, BC, OC) • Changes in biomass burning (aerosols) • Changes in land-use & land-cover (albedo) Plus everything else… (Natural/internal variability)
  • 48. What is the annual mean temperature of Earth?
  • 49. Greenhouse gases fixed to 1920 levels All forcings (CESM-LE) Industrial aerosols fixed to 1920 levels [Deser et al. 2020, JCLI] Fully-coupled CESM1.1 20 Ensemble Members Run from 1920-2080 Observations
  • 50. So what? Greenhouse gases = warming Aerosols = ?? (though mostly cooling) What are the relative responses between greenhouse gas and aerosol forcing?
  • 51. Surface Temperature Map ARTIFICIAL NEURAL NETWORK (ANN)
  • 52. INPUT LAYER Surface Temperature Map ARTIFICIAL NEURAL NETWORK (ANN)
  • 53. INPUT LAYER HIDDEN LAYERS OUTPUT LAYER Surface Temperature Map “2000-2009” DECADE CLASS “2070-2079” “1920-1929” ARTIFICIAL NEURAL NETWORK (ANN)
  • 54. INPUT LAYER HIDDEN LAYERS OUTPUT LAYER Surface Temperature Map “2000-2009” DECADE CLASS “2070-2079” “1920-1929” BACK-PROPAGATE THROUGH NETWORK = EXPLAINABLE AI ARTIFICIAL NEURAL NETWORK (ANN)
  • 55. INPUT LAYER HIDDEN LAYERS OUTPUT LAYER Layer-wise Relevance Propagation Surface Temperature Map “2000-2009” DECADE CLASS “2070-2079” “1920-1929” BACK-PROPAGATE THROUGH NETWORK = EXPLAINABLE AI ARTIFICIAL NEURAL NETWORK (ANN) [Barnes et al. 2020, JAMES] [Labe and Barnes 2021, JAMES]
  • 56. LAYER-WISE RELEVANCE PROPAGATION (LRP) Volcano Great White Shark Timber Wolf Image Classification LRP https://heatmapping.org/ LRP heatmaps show regions of “relevance” that contribute to the neural network’s decision-making process for a sample belonging to a particular output category Neural Network WHY WHY WHY Backpropagation – LRP
  • 57. LAYER-WISE RELEVANCE PROPAGATION (LRP) Volcano Great White Shark Timber Wolf Image Classification LRP https://heatmapping.org/ LRP heatmaps show regions of “relevance” that contribute to the neural network’s decision-making process for a sample belonging to a particular output category Neural Network WHY WHY WHY Backpropagation – LRP
  • 58. LAYER-WISE RELEVANCE PROPAGATION (LRP) Volcano Great White Shark Timber Wolf Image Classification LRP https://heatmapping.org/ LRP heatmaps show regions of “relevance” that contribute to the neural network’s decision-making process for a sample belonging to a particular output category Neural Network Backpropagation – LRP WHY WHY WHY
  • 59. LAYER-WISE RELEVANCE PROPAGATION (LRP) Image Classification LRP https://heatmapping.org/ NOT PERFECT Crock Pot Neural Network Backpropagation – LRP WHY
  • 60. [Adapted from Adebayo et al., 2020] EXPLAINABLE AI IS NOT PERFECT THERE ARE MANY METHODS
  • 61. [Adapted from Adebayo et al., 2020] THERE ARE MANY METHODS EXPLAINABLE AI IS NOT PERFECT
  • 62. OUTPUT LAYER Layer-wise Relevance Propagation “2000-2009” DECADE CLASS “2070-2079” “1920-1929” BACK-PROPAGATE THROUGH NETWORK = EXPLAINABLE AI WHY? = LRP HEAT MAPS [Labe and Barnes 2021, JAMES]
  • 63. Layer-wise Relevance Propagation BACK-PROPAGATE THROUGH NETWORK = EXPLAINABLE AI WHY? = LRP HEAT MAPS Machine Learning Black Box [Labe and Barnes 2021, JAMES]
  • 64. Layer-wise Relevance Propagation BACK-PROPAGATE THROUGH NETWORK = EXPLAINABLE AI WHY? = LRP HEAT MAPS Find regions of “relevance” that contribute to the neural network’s decision-making process [Labe and Barnes 2021, JAMES]
  • 65. 1960-1999: ANNUAL MEAN TEMPERATURE TRENDS Greenhouse gases fixed to 1920 levels [AEROSOLS PREVAIL] Industrial aerosols fixed to 1920 levels [GREENHOUSE GASES PREVAIL] All forcings [STANDARD CESM-LE] DATA
  • 66. 1960-1999: ANNUAL MEAN TEMPERATURE TRENDS Greenhouse gases fixed to 1920 levels [AEROSOLS PREVAIL] Industrial aerosols fixed to 1920 levels [GREENHOUSE GASES PREVAIL] All forcings [STANDARD CESM-LE] DATA
  • 67. 1960-1999: ANNUAL MEAN TEMPERATURE TRENDS Greenhouse gases fixed to 1920 levels [AEROSOLS PREVAIL] Industrial aerosols fixed to 1920 levels [GREENHOUSE GASES PREVAIL] All forcings [STANDARD CESM-LE] DATA
  • 68. 1960-1999: ANNUAL MEAN TEMPERATURE TRENDS Greenhouse gases fixed to 1920 levels [AEROSOLS PREVAIL] Industrial aerosols fixed to 1920 levels [GREENHOUSE GASES PREVAIL] All forcings [STANDARD CESM-LE] DATA
  • 69. CLIMATE MODEL DATA PREDICT THE YEAR FROM MAPS OF TEMPERATURE AEROSOLS PREVAIL GREENHOUSE GASES PREVAIL STANDARD CLIMATE MODEL [Labe and Barnes 2021, JAMES]
  • 70. OBSERVATIONS PREDICT THE YEAR FROM MAPS OF TEMPERATURE AEROSOLS PREVAIL GREENHOUSE GASES PREVAIL STANDARD CLIMATE MODEL [Labe and Barnes 2021, JAMES]
  • 71. OBSERVATIONS SLOPES PREDICT THE YEAR FROM MAPS OF TEMPERATURE AEROSOLS PREVAIL GREENHOUSE GASES PREVAIL STANDARD CLIMATE MODEL [Labe and Barnes 2021, JAMES]
  • 72. HOW DID THE ANN MAKE ITS PREDICTIONS?
  • 73. HOW DID THE ANN MAKE ITS PREDICTIONS? WHY IS THERE GREATER SKILL FOR GHG+?
  • 74. RESULTS FROM LRP [Labe and Barnes 2021, JAMES] Low High
  • 75. RESULTS FROM LRP [Labe and Barnes 2021, JAMES] Low High
  • 76. RESULTS FROM LRP [Labe and Barnes 2021, JAMES] Low High
  • 77. RESULTS FROM LRP [Labe and Barnes 2021, JAMES] Low High
  • 79.
  • 80.
  • 82. Could we detect whether we were under the influence of stratospheric aerosol injection (SAI) using regional climate patterns?
  • 86.
  • 87.
  • 90. CAN WE DETECT A SAI WORLD? LOGISTIC REGRESSION
  • 91. CLIMATOLOGICAL MAPS OF ARISE-SAI-1.5 IN 2050-2069 MEAN STATE
  • 96. N Y HIDDEN LAYERS INPUT LAYER INPUT LAYER SAI WORLD? or or map of near-surface temperature map of near-surface temperature map of total precipitation map of total precipitation Years Since SAI Injection OUTPUT LOGISTIC REGRESSION ARTIFICAL NEURAL NETWORK softmax
  • 97. N Y HIDDEN LAYERS INPUT LAYER INPUT LAYER SAI WORLD? or or map of near-surface temperature map of near-surface temperature map of total precipitation map of total precipitation Years Since SAI Injection OUTPUT LOGISTIC REGRESSION ARTIFICAL NEURAL NETWORK softmax
  • 98. CAN WE DETECT A SAI WORLD?
  • 99.
  • 100.
  • 102. HOW DID THE ML MODEL KNOW?
  • 104. CAN WE DETECT A SAI WORLD?
  • 110. N Y HIDDEN LAYERS INPUT LAYER INPUT LAYER SAI WORLD? or or map of near-surface temperature map of near-surface temperature map of total precipitation map of total precipitation Years Since SAI Injection OUTPUT LOGISTIC REGRESSION ARTIFICAL NEURAL NETWORK softmax
  • 114. MACHINE LEARNING IS JUST ANOTHER TOOL TO ADD TO OUR WORKFLOW. 1)
  • 115. MACHINE LEARNING IS NO LONGER A BLACK BOX. 2)
  • 116. WE CAN LEARN NEW SCIENCE FROM EXPLAINABLE AI. 3)
  • 117. KEY POINTS 1. Machine learning is just another tool to add to our scientific workflow 2. We can use explainable AI (XAI) methods to peer into the black box of machine learning 3. We can learn new science by using XAI methods in conjunction with existing statistical tools Zachary Labe zachary.labe@noaa.gov @ZLabe Labe, Z.M. and E.A. Barnes (2021), Detecting climate signals using explainable AI with single-forcing large ensembles. Journal of Advances in Modeling Earth Systems, DOI:10.1029/2021MS002464 Labe, Z.M., E.A. Barnes, and J.W. Hurrell (2023), Identifying the regional emergence of climate patterns in a simulation of stratospheric aerosol injection, to be submitted in December 2022