SPACE WEATHER MISSION 02
SOLAR STORM
PREDICTION
SPACE WEATHER: SOLAR STORM PREDICTION
What are Solar Flares?
FLARES
Agents Short wavelength
EM radiation
Effects Ionisation and
heating of upper
atmosphere
Impacts GPS and HF
communication
SPACE WEATHER: SOLAR STORM PREDICTION
Why Solar Flare prediction is important?
FLARES
Speed of Light
No warning
Agents Short wavelength
EM radiation
Effects Ionisation and
heating of upper
atmosphere
Impacts GPS and HF
communication
SPACE WEATHER: SOLAR STORM PREDICTION
How does NOAA forecast flares?
5
Sunspot morphology and Persistence (assume the Sun does not change)
SPACE WEATHER: SOLAR STORM PREDICTION
Goal
Develop a solar flare forecasting model
capable of warning stakeholders at least an
hour in advance.
SPACE WEATHER: SOLAR STORM PREDICTION
Target Breakthroughs
1. Dataset Preparation: Satellites->useful data
2. Software: Build scientific process
3. Prediction: Beat Persistence
4. Science: Visualize Results
• Discover Flare Precursors
• Providing new physical insight
• New Physics?
SPACE WEATHER: SOLAR STORM PREDICTION
Target Breakthroughs
1. Dataset Preparation: Satellites->useful data
2. Software: Build scientific process
3. Prediction: Beat Persistence
4. Science: Visualize Results
• Discover Flare Precursors
• Providing new physical insight
• New Physics?
SPACE WEATHER: SOLAR STORM PREDICTION
NASA Solar Dynamic Observatory
9
SPACE WEATHER: SOLAR STORM PREDICTION
SDO/AIA Image Channels
Hotter and Higher
Photosphere Chromosphere Corona Hot Corona
SPACE WEATHER: SOLAR STORM PREDICTION
SDO/AIA Image Channels
Goal: Use AIA to forecast
GOES X-ray flux
1 hr Ahead
SPACE WEATHER: SOLAR STORM PREDICTION
Target Breakthroughs
1. Dataset Preparation: Satellites->useful data
2. Software: Build scientific process
3. Prediction: Beat Persistence
4. Science: Visualize Results
• Discover Flare Precursors
• Providing new physical insight
• New Physics?
Challenges
1. Instrument Issues: Corrections
2. Class imbalance: Oversampling
3. High dynamic range: Log Transform
SPACE WEATHER: SOLAR STORM PREDICTION
Preprocessing
SPACE WEATHER: SOLAR STORM PREDICTION
Preprocessing - Log
AIA Data Distribution AIA log(Data) Distribution
SPACE WEATHER: SOLAR STORM PREDICTION
Preprocessing - Log
SPACE WEATHER: SOLAR STORM PREDICTION
Preprocessing - PCA
SPACE WEATHER: SOLAR STORM PREDICTION
Dimensionality Reduction - PCA
The 3 RGB channels in this image contain
97% of the information
from the 8 AIA channels
SPACE WEATHER: SOLAR STORM PREDICTION
Target Breakthroughs
1. Dataset Preparation: Satellites->useful data
2. Software: Build scientific process
3. Prediction: Beat Persistence
4. Science: Visualize Results
• Discover Flare Precursors
• Providing new physical insight
• New Physics?
SPACE WEATHER: SOLAR STORM PREDICTION
Target Breakthroughs
1. Dataset Preparation: Satellites->useful data
2. Software: Build scientific process
3. Prediction: Beat Persistence
4. Science: Visualize Results
• Discover Flare Precursors
• Providing new physical insight
• New Physics?
Components
1. Analysis of Magnetic Complexity
2. Deep Learning
SPACE WEATHER: SOLAR STORM PREDICTION
Target Breakthroughs
1. Dataset Preparation: Satellites->useful data
2. Software: Build scientific process
3. Prediction: Beat Persistence
4. Science: Visualize Results
• Discover Flare Precursors
• Providing new physical insight
• New Physics?
Components
1. Analysis of Magnetic Complexity
2. Deep Learning
SPACE WEATHER: SOLAR STORM PREDICTION
Our Fractal Sun
SPACE WEATHER: SOLAR STORM PREDICTION
Our Fractal Sun
SPACE WEATHER: SOLAR STORM PREDICTION
Connecting the Sun
100G
b
150G
y
200Ga
x
a,x
b,y
100G
a,y
200G
150G
SPACE WEATHER: SOLAR STORM PREDICTION
Network Centrality
SPACE WEATHER: SOLAR STORM PREDICTION
Eigenvalue Centrality
-4H
SPACE WEATHER: SOLAR STORM PREDICTION
Eigenvalue Centrality
-2H
SPACE WEATHER: SOLAR STORM PREDICTION
Eigenvalue Centrality
Flare
SPACE WEATHER: SOLAR STORM PREDICTION
Eigenvalue Centrality
+2H
SPACE WEATHER: SOLAR STORM PREDICTION
Eigenvalue Centrality
+4H
SPACE WEATHER: SOLAR STORM PREDICTION
Flare Detection from Topology
-4 -4 -2 -2 0 0 +2 +2 +4 +4
-4 -4 -2 -2 0 0 +2 +2 +4 +4
SPACE WEATHER: SOLAR STORM PREDICTION
Flare Detection from Topology
-4 -4 -2 -2 0 0 +2 +2 +4 +4
-4 -4 -2 -2 0 0 +2 +2 +4 +4
We know the information is there!
Let’s bring deep learning into the picture!
SPACE WEATHER: SOLAR STORM PREDICTION
Target Breakthroughs
1. Dataset Preparation: Satellites->useful data
2. Software: Build scientific process
3. Prediction: Beat Persistence
4. Science: Visualize Results
• Discover Flare Precursors
• Providing new physical insight
• New Physics?
Components
1. Analysis of Magnetic Complexity
2. Deep Learning
SPACE WEATHER: SOLAR STORM PREDICTION
Deep Learning
cs231n.github.io/classification
SPACE WEATHER: SOLAR STORM PREDICTION
Deep Learning
cs231n.github.io/classification
SPACE WEATHER: SOLAR STORM PREDICTION
Deep Learning
cs231n.github.io/classification
X-Ray Flux
3.2x10-5
W m-2
SPACE WEATHER: SOLAR STORM PREDICTION
Deep Learning
SPACE WEATHER: SOLAR STORM PREDICTION
Deep Learning: Convolutional Networks
SPACE WEATHER: SOLAR STORM PREDICTION
Deep Learning: Convolutional Networks
SPACE WEATHER: SOLAR STORM PREDICTION
Deep Learning: Convolutional Networks
SPACE WEATHER: SOLAR STORM PREDICTION
Deep Learning: Convolutional Networks
SPACE WEATHER: SOLAR STORM PREDICTION
Deep Learning: Convolutional Networks
SPACE WEATHER: SOLAR STORM PREDICTION
Deep Learning: Convolutional Networks
SPACE WEATHER: SOLAR STORM PREDICTION
Deep Learning: Convolutional Networks
SPACE WEATHER: SOLAR STORM PREDICTION
FlareNet
SPACE WEATHER: SOLAR STORM PREDICTION
Target Breakthroughs
1. Dataset Preparation: Satellites->useful data
2. Software: Build scientific process
3. Prediction: Beat Persistence
4. Science: Visualize Results
• Discover Flare Precursors
• Providing new physical insight
• New Physics?
SPACE WEATHER: SOLAR STORM PREDICTION
Solar Flare Forecast
We faced many challenges...
SPACE WEATHER: SOLAR STORM PREDICTION
Solar Flare Forecast
10:31 PM last night...
SPACE WEATHER: SOLAR STORM PREDICTION
Solar Flare Forecast
SPACE WEATHER: SOLAR STORM PREDICTION
Solar Flare Forecast
FlareNet is able to produce an upper level of X-ray flux activity!
SPACE WEATHER: SOLAR STORM PREDICTION
Solar Flare Forecast
...but why?
SPACE WEATHER: SOLAR STORM PREDICTION
Target Breakthroughs
1. Dataset Preparation: Satellites->useful data
2. Software: Build scientific process
3. Prediction: Beat Persistence
4. Science: Visualize Results
• Discover Flare Precursors
• Providing new physical insight
• New Physics?
SPACE WEATHER: SOLAR STORM PREDICTION
Analysis Scripts: Saliency
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013). Deep Inside Convolutional
Networks: Visualising Image Classification Models and Saliency Maps.
SPACE WEATHER: SOLAR STORM PREDICTION
Analysis Scripts: Saliency
Simonyan, K., Vedaldi, A., & Zisserman, A. (2013). Deep Inside Convolutional
Networks: Visualising Image Classification Models and Saliency Maps.
?
SPACE WEATHER: SOLAR STORM PREDICTION
Analysis Scripts: Saliency
SPACE WEATHER: SOLAR STORM PREDICTION
FlareNet
Block 2
Filter 8
Texture
Block 3
Filter 7
Structure
SPACE WEATHER: SOLAR STORM PREDICTION
FlareNet
Block 2
Filter 8
Texture
Block 3
Filter 7
Structure
Not just any structure!
FlareNet learned the
importance of active regions
SPACE WEATHER: SOLAR STORM PREDICTION
Solar Flare Forecast
SPACE WEATHER: SOLAR STORM PREDICTION
Solar Flare Forecast
SPACE WEATHER: SOLAR STORM PREDICTION
ACHIEVEMENTS
• DIMENSIONALITY REDUCTION
• TOPOLOGICAL MODEL OF SOLAR MAGNETIC FIELD
• TRAINED CONVOLUTIONAL NEURAL NETWORK
• A FLARE FORECASTING TOOL
SPACE WEATHER: SOLAR STORM PREDICTION
ACHIEVEMENTS
SPACE WEATHER: SOLAR STORM PREDICTION
AKNOWLEDGEMENTS
SPACE WEATHER: SOLAR STORM PREDICTION
PREDICTING THE SUN
SPACE WEATHER: SOLAR STORM PREDICTION
Questions

FDL 2017 Solar Storm Prediction Presentation

  • 1.
    SPACE WEATHER MISSION02 SOLAR STORM PREDICTION
  • 3.
    SPACE WEATHER: SOLARSTORM PREDICTION What are Solar Flares? FLARES Agents Short wavelength EM radiation Effects Ionisation and heating of upper atmosphere Impacts GPS and HF communication
  • 4.
    SPACE WEATHER: SOLARSTORM PREDICTION Why Solar Flare prediction is important? FLARES Speed of Light No warning Agents Short wavelength EM radiation Effects Ionisation and heating of upper atmosphere Impacts GPS and HF communication
  • 5.
    SPACE WEATHER: SOLARSTORM PREDICTION How does NOAA forecast flares? 5 Sunspot morphology and Persistence (assume the Sun does not change)
  • 6.
    SPACE WEATHER: SOLARSTORM PREDICTION Goal Develop a solar flare forecasting model capable of warning stakeholders at least an hour in advance.
  • 7.
    SPACE WEATHER: SOLARSTORM PREDICTION Target Breakthroughs 1. Dataset Preparation: Satellites->useful data 2. Software: Build scientific process 3. Prediction: Beat Persistence 4. Science: Visualize Results • Discover Flare Precursors • Providing new physical insight • New Physics?
  • 8.
    SPACE WEATHER: SOLARSTORM PREDICTION Target Breakthroughs 1. Dataset Preparation: Satellites->useful data 2. Software: Build scientific process 3. Prediction: Beat Persistence 4. Science: Visualize Results • Discover Flare Precursors • Providing new physical insight • New Physics?
  • 9.
    SPACE WEATHER: SOLARSTORM PREDICTION NASA Solar Dynamic Observatory 9
  • 10.
    SPACE WEATHER: SOLARSTORM PREDICTION SDO/AIA Image Channels Hotter and Higher Photosphere Chromosphere Corona Hot Corona
  • 11.
    SPACE WEATHER: SOLARSTORM PREDICTION SDO/AIA Image Channels Goal: Use AIA to forecast GOES X-ray flux 1 hr Ahead
  • 12.
    SPACE WEATHER: SOLARSTORM PREDICTION Target Breakthroughs 1. Dataset Preparation: Satellites->useful data 2. Software: Build scientific process 3. Prediction: Beat Persistence 4. Science: Visualize Results • Discover Flare Precursors • Providing new physical insight • New Physics? Challenges 1. Instrument Issues: Corrections 2. Class imbalance: Oversampling 3. High dynamic range: Log Transform
  • 13.
    SPACE WEATHER: SOLARSTORM PREDICTION Preprocessing
  • 14.
    SPACE WEATHER: SOLARSTORM PREDICTION Preprocessing - Log AIA Data Distribution AIA log(Data) Distribution
  • 15.
    SPACE WEATHER: SOLARSTORM PREDICTION Preprocessing - Log
  • 16.
    SPACE WEATHER: SOLARSTORM PREDICTION Preprocessing - PCA
  • 17.
    SPACE WEATHER: SOLARSTORM PREDICTION Dimensionality Reduction - PCA The 3 RGB channels in this image contain 97% of the information from the 8 AIA channels
  • 18.
    SPACE WEATHER: SOLARSTORM PREDICTION Target Breakthroughs 1. Dataset Preparation: Satellites->useful data 2. Software: Build scientific process 3. Prediction: Beat Persistence 4. Science: Visualize Results • Discover Flare Precursors • Providing new physical insight • New Physics?
  • 19.
    SPACE WEATHER: SOLARSTORM PREDICTION Target Breakthroughs 1. Dataset Preparation: Satellites->useful data 2. Software: Build scientific process 3. Prediction: Beat Persistence 4. Science: Visualize Results • Discover Flare Precursors • Providing new physical insight • New Physics? Components 1. Analysis of Magnetic Complexity 2. Deep Learning
  • 20.
    SPACE WEATHER: SOLARSTORM PREDICTION Target Breakthroughs 1. Dataset Preparation: Satellites->useful data 2. Software: Build scientific process 3. Prediction: Beat Persistence 4. Science: Visualize Results • Discover Flare Precursors • Providing new physical insight • New Physics? Components 1. Analysis of Magnetic Complexity 2. Deep Learning
  • 21.
    SPACE WEATHER: SOLARSTORM PREDICTION Our Fractal Sun
  • 22.
    SPACE WEATHER: SOLARSTORM PREDICTION Our Fractal Sun
  • 23.
    SPACE WEATHER: SOLARSTORM PREDICTION Connecting the Sun 100G b 150G y 200Ga x a,x b,y 100G a,y 200G 150G
  • 24.
    SPACE WEATHER: SOLARSTORM PREDICTION Network Centrality
  • 25.
    SPACE WEATHER: SOLARSTORM PREDICTION Eigenvalue Centrality -4H
  • 26.
    SPACE WEATHER: SOLARSTORM PREDICTION Eigenvalue Centrality -2H
  • 27.
    SPACE WEATHER: SOLARSTORM PREDICTION Eigenvalue Centrality Flare
  • 28.
    SPACE WEATHER: SOLARSTORM PREDICTION Eigenvalue Centrality +2H
  • 29.
    SPACE WEATHER: SOLARSTORM PREDICTION Eigenvalue Centrality +4H
  • 30.
    SPACE WEATHER: SOLARSTORM PREDICTION Flare Detection from Topology -4 -4 -2 -2 0 0 +2 +2 +4 +4 -4 -4 -2 -2 0 0 +2 +2 +4 +4
  • 31.
    SPACE WEATHER: SOLARSTORM PREDICTION Flare Detection from Topology -4 -4 -2 -2 0 0 +2 +2 +4 +4 -4 -4 -2 -2 0 0 +2 +2 +4 +4 We know the information is there! Let’s bring deep learning into the picture!
  • 32.
    SPACE WEATHER: SOLARSTORM PREDICTION Target Breakthroughs 1. Dataset Preparation: Satellites->useful data 2. Software: Build scientific process 3. Prediction: Beat Persistence 4. Science: Visualize Results • Discover Flare Precursors • Providing new physical insight • New Physics? Components 1. Analysis of Magnetic Complexity 2. Deep Learning
  • 33.
    SPACE WEATHER: SOLARSTORM PREDICTION Deep Learning cs231n.github.io/classification
  • 34.
    SPACE WEATHER: SOLARSTORM PREDICTION Deep Learning cs231n.github.io/classification
  • 35.
    SPACE WEATHER: SOLARSTORM PREDICTION Deep Learning cs231n.github.io/classification X-Ray Flux 3.2x10-5 W m-2
  • 36.
    SPACE WEATHER: SOLARSTORM PREDICTION Deep Learning
  • 37.
    SPACE WEATHER: SOLARSTORM PREDICTION Deep Learning: Convolutional Networks
  • 38.
    SPACE WEATHER: SOLARSTORM PREDICTION Deep Learning: Convolutional Networks
  • 39.
    SPACE WEATHER: SOLARSTORM PREDICTION Deep Learning: Convolutional Networks
  • 40.
    SPACE WEATHER: SOLARSTORM PREDICTION Deep Learning: Convolutional Networks
  • 41.
    SPACE WEATHER: SOLARSTORM PREDICTION Deep Learning: Convolutional Networks
  • 42.
    SPACE WEATHER: SOLARSTORM PREDICTION Deep Learning: Convolutional Networks
  • 43.
    SPACE WEATHER: SOLARSTORM PREDICTION Deep Learning: Convolutional Networks
  • 44.
    SPACE WEATHER: SOLARSTORM PREDICTION FlareNet
  • 45.
    SPACE WEATHER: SOLARSTORM PREDICTION Target Breakthroughs 1. Dataset Preparation: Satellites->useful data 2. Software: Build scientific process 3. Prediction: Beat Persistence 4. Science: Visualize Results • Discover Flare Precursors • Providing new physical insight • New Physics?
  • 46.
    SPACE WEATHER: SOLARSTORM PREDICTION Solar Flare Forecast We faced many challenges...
  • 47.
    SPACE WEATHER: SOLARSTORM PREDICTION Solar Flare Forecast 10:31 PM last night...
  • 48.
    SPACE WEATHER: SOLARSTORM PREDICTION Solar Flare Forecast
  • 49.
    SPACE WEATHER: SOLARSTORM PREDICTION Solar Flare Forecast FlareNet is able to produce an upper level of X-ray flux activity!
  • 50.
    SPACE WEATHER: SOLARSTORM PREDICTION Solar Flare Forecast ...but why?
  • 51.
    SPACE WEATHER: SOLARSTORM PREDICTION Target Breakthroughs 1. Dataset Preparation: Satellites->useful data 2. Software: Build scientific process 3. Prediction: Beat Persistence 4. Science: Visualize Results • Discover Flare Precursors • Providing new physical insight • New Physics?
  • 52.
    SPACE WEATHER: SOLARSTORM PREDICTION Analysis Scripts: Saliency Simonyan, K., Vedaldi, A., & Zisserman, A. (2013). Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps.
  • 53.
    SPACE WEATHER: SOLARSTORM PREDICTION Analysis Scripts: Saliency Simonyan, K., Vedaldi, A., & Zisserman, A. (2013). Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. ?
  • 54.
    SPACE WEATHER: SOLARSTORM PREDICTION Analysis Scripts: Saliency
  • 55.
    SPACE WEATHER: SOLARSTORM PREDICTION FlareNet Block 2 Filter 8 Texture Block 3 Filter 7 Structure
  • 56.
    SPACE WEATHER: SOLARSTORM PREDICTION FlareNet Block 2 Filter 8 Texture Block 3 Filter 7 Structure Not just any structure! FlareNet learned the importance of active regions
  • 57.
    SPACE WEATHER: SOLARSTORM PREDICTION Solar Flare Forecast
  • 58.
    SPACE WEATHER: SOLARSTORM PREDICTION Solar Flare Forecast
  • 59.
    SPACE WEATHER: SOLARSTORM PREDICTION ACHIEVEMENTS • DIMENSIONALITY REDUCTION • TOPOLOGICAL MODEL OF SOLAR MAGNETIC FIELD • TRAINED CONVOLUTIONAL NEURAL NETWORK • A FLARE FORECASTING TOOL
  • 60.
    SPACE WEATHER: SOLARSTORM PREDICTION ACHIEVEMENTS
  • 61.
    SPACE WEATHER: SOLARSTORM PREDICTION AKNOWLEDGEMENTS
  • 62.
    SPACE WEATHER: SOLARSTORM PREDICTION PREDICTING THE SUN
  • 63.
    SPACE WEATHER: SOLARSTORM PREDICTION Questions