Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

On Calibration of Modern Neural Networks (2017)

628 views

Published on

"On Calibration of Modern Neural Networks",
Chuan Guo, Geoff Pleiss, Yu Sun and Kilian Q. Weinberger, ICML2017.

[Link] https://arxiv.org/abs/1706.04599
[Vimeo] https://vimeo.com/238242536

Published in: Engineering
  • Be the first to comment

  • Be the first to like this

On Calibration of Modern Neural Networks (2017)

  1. 1. Terry Taewoong Um (terry.t.um@gmail.com) University of Waterloo Department of Electrical & Computer Engineering Terry Taewoong Um ON CALIBRATION OF MODERN NE URAL NETWORKS 1
  2. 2. TODAY’S PAPER Terry Taewoong Um (terry.t.um@gmail.com) https://vimeo.com/238242536
  3. 3. GOAL Terry Taewoong Um (terry.t.um@gmail.com) Softmax output (ෝ𝒑) != Confidence (ෝ𝒒)
  4. 4. MEASURING MISCALIBRATION Terry Taewoong Um (terry.t.um@gmail.com)
  5. 5. MEASURING MISCALIBRATION Terry Taewoong Um (terry.t.um@gmail.com)
  6. 6. MEASURING MISCALIBRATION Terry Taewoong Um (terry.t.um@gmail.com) What factors cause misclalibration?
  7. 7. WHAT CAUSES MISCALIBRATION? Terry Taewoong Um (terry.t.um@gmail.com)
  8. 8. OVERFITTING Terry Taewoong Um (terry.t.um@gmail.com)
  9. 9. CALIBRATION Temperature scaling
  10. 10. COMPARISON TO RELATED WORKS Terry Taewoong Um (terry.t.um@gmail.com) Histogram Binning Plot Scaling Bayesian Binning into Quantiles (BBQ)
  11. 11. FINDINGS & CONCLUSION Terry Taewoong Um (terry.t.um@gmail.com)
  12. 12. MY THOUGHTS Terry Taewoong Um (terry.t.um@gmail.com)
  13. 13. TODAY’S PAPER Terry Taewoong Um (terry.t.um@gmail.com) https://vimeo.com/238242536

×