Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Who is Afraid of Big Bad Minima?

15 views

Published on

Presentation NeurIPS 2019, paper arXiv:1907.08226

Published in: Science
  • Be the first to comment

  • Be the first to like this

Who is Afraid of Big Bad Minima?

  1. 1. Stefano Sarao Mannelli - NeurIPS 2019 Stefano Sarao Mannelli in collaboration with Giulio Biroli, Chiara Cammarota, Florent Krzakala and Lenka Zdeborov� NeurIPS 2019 IPhT SACLAY Who is Afraid of Big Bad Minima?
  2. 2. Stefano Sarao Mannelli - NeurIPS 2019 Spiked Matrix-Tensor Model
  3. 3. Stefano Sarao Mannelli - NeurIPS 2019 Spiked Matrix-Tensor Model minus log-likelihood
  4. 4. Stefano Sarao Mannelli - NeurIPS 2019 Spiked Matrix-Tensor Model Global minimum
  5. 5. Stefano Sarao Mannelli - NeurIPS 2019 Spiked Matrix-Tensor Model Global minimum presence of spurious minima
  6. 6. Stefano Sarao Mannelli - NeurIPS 2019 Trivial GF does not work Phase Diagram G F works spuriosity with
  7. 7. Stefano Sarao Mannelli - NeurIPS 2019 Trivial GF does not work Phase Diagram G F works spuriosity with Landscape Trivialization via Kac-Rice formula
  8. 8. Stefano Sarao Mannelli - NeurIPS 2019 Trivial GF does not work Phase Diagram G F works spuriosity with Landscape Trivialization via Kac-Rice formula Dynamics via DMFT
  9. 9. Stefano Sarao Mannelli - NeurIPS 2019 Trivial GF does not work Phase Diagram G F works spuriosity with
  10. 10. Stefano Sarao Mannelli - NeurIPS 2019 Explanation trivialgradient-flow easy gradient-flow hard Loss snr : 1/ Fix
  11. 11. Stefano Sarao Mannelli - NeurIPS 2019 Explanation trivialgradient-flow easy gradient-flow hard Loss snr : 1/ Fix
  12. 12. Stefano Sarao Mannelli - NeurIPS 2019 Thank you! :)

×