Deep Learning Summit (DLS01-3)
Deep learning is having a profound impact on AI applications. With the future of neural network-inspired computing in mind, re:Invent is hosting the first ever Deep Learning Summit. Designed for developers to learn about the latest in deep learning research and emerging trends, attendees will hear from industry thought leaders—members of the academic and venture capital communities—who will share their perspectives in 30-minute Lightning Talks. The Summit will be held on Thursday, November 30th at the Venetian from 1-5pm. The Deep Learning Revolution - Terrence Sejnowski, The Salk Institute for Biological Studies Eye, Robot: Computer Vision and Autonomous Robotics - Aaron Ames & Pietro Perona, California Institute of Technology Exploiting the Power of Language - Alexander Smola, Amazon Web Services Reducing Supervision: Making More with Less - Martial Herbert, Carnegie Mellon University Learning Where to Look in Video - Kristen Grauman, University of Texas Look, Listen, Learn: The Intersection of Vision and Sound - Antonio Torralba, MIT Investing in the Deep Learning Future - Matt Ocko, Data Collective Venture Capital
Recommended
Recommended
More Related Content
More from Amazon Web Services
More from Amazon Web Services (20)
Recently uploaded
Recently uploaded (20)
Deep Learning Summit (DLS01-3)
- 1. Eye, Robot: Computer Vision and Autonomous Robotics Pietro Perona, California Institute of Technology, AWS
- 2. <<Video of Cassie with flying robots>>
- 3. if found - put here video of chilren playing not necessary - skip if not found • Navigation • Social interaction
- 4. 4
- 5. • Trajectories: xi(t), i={1,…,N} • Actions: head-butt, fall, show card • Goals: vendetta, win match • Cause-effect: ✴ (Materazzi XX?) -> (Zidane upset) ✴ (Zidane head-butt)->(Materazzi falls), ✴ (referee shows card)->(Zidane out), ✴ (Zidane out)->(France loses game) What is behavior? • Description • Phenomena • Mechanisms
- 6. images, trajectories pose, movemes, actions, activities, objects, scenes plans, goals, behavior, relationships ... group-level goals and plans individual goals and plans motor programs sensor-based control IMAGING,TRACKING RECOGNITION COGNITION SOCIAL NETWORK PREFRONTAL CORTEX MOTOR CORTEX, BASAL GANGLIA etc. SPINAL CORD SENSORYREPRESENTATIONAL Action Perception World interaction, cooperation, competition SOCIAL INTERACTION
- 8. Zidane in a dish
- 10. Marla B. Sokolowski Nature Reviews Genetics 2, 879-892 (2001) Courtship in Drosophila
- 13. Approach
- 14. Circle
- 15. APPROACH ATTACK ATTEMPT TO MOUNT CHASE CIRCLE EAT GROOM LICKMOUNT SNIFF BODY SNIFF UROGENITAL THRUST WALK AWAYDRINKSNIFF NOSE Mouse Actions
- 16. Framework
- 17. Parametrization
- 20. [Cao et al., 2017]
- 21. Ethograms [Dankert et al., Nature Methods, April 2009] by hand it would have taken (20+24+10)*1/3 * 3 * 7 = 400h
- 22. Levels of understanding • Description • Phenomena • Mechanisms
- 23. Case study 1: Navigation From phenomena to mechanisms `by hand’
- 24. Analysis by synthesis [Braitenberg, 1984]
- 26. [Ames & Egerstedt 2017]
- 27. [Branson et al. Nature Methods, Jun. ’09]
- 28. ‘T-Stops’
- 29. ‘X-Stops’
- 31. Try implementing it with 105 neurons http://www.news.wisc.edu/newsphotos/images/fruit_fly_research03_6801.JPG
- 37. [Zabala ’12] Causation vs correlation
- 38. Autonomous Car
- 39. Case study 2: Mechanism inference [Eyjolfsdottir 2016,2017]
- 40. Fly-centric features v: visual input x: trajectories len w-len w-ang fwd side yaw flies walls reproduce eat fight escape h v x
- 41. h1 i ^ h2 i+1 ^ h2 i ^ h1 i+1 ^ xi+1 ^ h2 i-1 ^ h1 i-1 ^ xi-1 ^ xi ^ generative Model architecture Simulation: - prediction as input - compute vi on the fly … … h1 i+1 h2 i+1 vi-1 xi-1 vi xi vi+1 xi+1 h1 i h2 i h1 i-1 h2 i-1 yi yi ^ discriminative h2 i+1 ^ h1 i+1 ^ xi+1 ^ vi xi h1 i h2 i yi yi ^ yi yi ^ [Eyjolfsdottir 2016,2017]
- 42. Classification
- 44. Discovery
- 45. Discovery: FlyBowl tSNE dimensionality reduction female male right wing extension left wing extension hl i: hidden states of unsupervised model
- 46. Discovery: Handwriting stroke length writer identity
- 47. Prediction
- 49. Simulation
- 50. simulated real
- 53. Summary • Social behavior • Description • Phenomena • Mechanisms • Cause and effect?
- 54. Collaborators Kristin Branson Heiko Dankert David Anderson Michael Dickinson + Carlos Gonzalez Shay Ohayon Roian Egnor Michael Maire John Bender Tim Lebestky Alice Robie Erik Hoopfer Xavi Burgos Piotr Dollar Eyrún Eyjólfsdóttir Cristina Segalin Grant van Horn