Download to read offline
Uploaded bySravanthi Sinha
DEEP LEARNING SUMMIT ASIA 2016
This document discusses how deep learning and drones can help find meteorites on Earth more efficiently. Currently, it takes about 100 hours for humans to manually find one meteorite. The document proposes using a drone equipped with cameras and deep learning to automatically scan terrain and detect meteorites. It describes how the team trained several deep learning models on a dataset of meteorite images augmented through techniques like rotation and brightness adjustment. An initial prototype called the Adelie Meteorite Hunter was able to correctly identify meteorites with a low error rate. Ongoing work involves improving the models, drone hardware, and expanding the image dataset to allow fully autonomous meteorite detection missions.
DEEP LEARNING SUMMIT ASIA 2016
- 1. 1 How Deep Learningand Drones Can Save the World from Asteroids? @SravanthiSinha
- 2. Are asteroids athreat to the Earth? @SravanthiSinha
- 4. 4 What’s an Asteroid? Credit:NASA, JAXA and ESA (montage by Emily Lakdawalla)
- 5.
- 6. Where do theylive?
- 7. 7 What's the solutionand why find meteorites? @SravanthiSinha
- 8. 8 Composition affects threat assessmentand deflection technologies Why find meteorites? @SravanthiSinha
- 9. - It takes100 man hours to find one meteorite - To increase meteorite finds, the efficiency must be increased - We have trajectories, but finding meteorites is difficult 9 Current approach to find meteorites @SravanthiSinha
- 10. Use a dronecombined with Deep learning to increase fresh meteorite finds 10 @SravanthiSinha
- 11. 11 Why Deep Learningis the best solution? @SravanthiSinha
- 12. 12 Traditional Computer Vision- Anomaly Detection @SravanthiSinha
- 13.
- 14. 14 2 wrong classifications outof 17000 patches! Our Deep Learning Solution @SravanthiSinha
- 15. 15 2 correctly labelledmeteorites… 124 incorrectly labelled patches… out of 17000 patches Our Deep Learning Solution @SravanthiSinha
- 16.
- 17.
- 18. 18 How we solvedthe problem? @SravanthiSinha
- 19. rotations 19 reflection resolution brightnesssaturation Our meteorite pictures 320 Internet meteorites in field 280 Internet meteorites photoshopped 35 635 images... tiny dataset ! 32 augmentations per image 21000 images... respectable dataset ! Dataset Augmentation @SravanthiSinha
- 20. 20 ~15 million naturalimages Leveraging Big Data @SravanthiSinha
- 21. 21 GoogLeNet AlexNet ~6 millionparameters ~61 million parameters Leveraging Pre-trained Networks @SravanthiSinha
- 22.
- 23. 23 Hardware / Software Eachmodel ~2 hours to train On a CPU it would be ~1 week ! @SravanthiSinha
- 24.
- 25. 25 The ADELIE MeteoriteHunter
- 26. 26 The ADELIE MeteoriteHunter
- 27. 27 The ADELIE MeteoriteHunter Functionality in place
- 28. 28 The ADELIE MeteoriteHunter
- 29. 29 The ADELIE MeteoriteHunter
- 30. 30 The ADELIE MeteoriteHunter
- 31. 31 The ADELIE MeteoriteHunter
- 32. 32 The ADELIE MeteoriteHunter
- 33. 33 The ADELIE MeteoriteHunter
- 34. 34 The ADELIE MeteoriteHunter
- 35. 35 The ADELIE MeteoriteHunter Archive images for future learning.
- 36. 36 The ADELIE MeteoriteHunter
- 37. 37 The ADELIE MeteoriteHunter
- 38. 38 The ADELIE MeteoriteHunter
- 39. Image processing ○ Fasterinference time ○ Weak classifier ○ Reduce false positives Improved hardware ○ Autonomous height control (LIDAR) ○ Better camera resolution ○ Longer battery life ○ Additional sensors (IR, hyperspectral?, etc.) 39 @SravanthiSinha Ongoing work..
- 40. Amar Shah -Data Scientist, PhD Student, Cambridge Robert Citron - Planetary Scientist, PhD Student, UC Berkeley Christopher Watkins, Data Scientist, PhD Student, CSIRO, Melbourne Sravanthi Sinha, Full-Stack Software Developer, Holberton School, San Francisco Peter Jenniskens, Project Mentor, Meteor Astronomer, SETI Institute 40 Team @SravanthiSinha
Editor's Notes
- #4 This has already happened at least once. The likely reason you don’t see any dinosaurs around the neighborhood.
- #5 ITOKAVA EFFECT
- #6 ITOKAVA EFFECT
- #8 How to deflect an Asteroid?
- #10 Out of 800 trajectories, we only have 27 recovered meteorites . We need to increase that > 40 meteorite types > 100 asteroid families Within each family, there’s a range of properties Can Deep learning improve our ability to locate freshly fallen meteorites?
- #11 OUR IDEA/APPROACH
- #40 WORK IN PROGRESS
- #41 Acknowledgement to the team involved