Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI Summit
Making Aerial Micro-Drones a Reality
S...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Big data applications using aerial drones
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
This talk
Designing insect-sized micro drones
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why flying insect robotics?
1. small scale
l
2. ...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Just shrink?
?
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Small is different
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
7
Inspiration from nature
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
8
Abridged history of insect-scale drones
2005 2...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
First Wireless Fly-Sized Drone to Lift Off [ICRA...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
UW Wireless Robofly: Design Challenges
• Piezo-a...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
UW Wireless Robofly: Design Challenges
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Lightest Wireless Robot to Fly
Liftoff of a ...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
In the next few months
Fully wireless and batter...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Mechanical drones consumes lots of power
Need re...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Living IoT:
A Flying Wireless Platform on Live I...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.Sensing + tracking + communication + data analysi...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Bio-based solution
• No need for mechanical
pr...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Bee carrying humidity sensor and microcontroller
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Challenge 1: Small weight & low power
1. Size/We...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Challenge 2: Can’t control bee motion!
Wirelessl...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Building low-weight hardware
• 2D tracking of ...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Making low-weight hardware
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Programmable general-purpose design
• Programmab...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• Building low-weight hardware
• 2D tracking of ...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why can’t we use GPS?
GPS
Problem: GPS is power ...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
But, amplitude only gives range, not angle
How d...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Search for the angle using beamforming
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Evaluating 2D localization
0
0.1
0.2
0.3
0.4
0.5...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Other sensors on the platform
QVGA Camera 3-axis...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Data Analytics using Edge Computing
• Upload ima...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Machine learning on data across bees
• Predict p...
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Conclusions
• Aerial micro-drone that
piggyback ...
Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Shyam Gollakota
Upcoming SlideShare
Loading in …5
×

Making Aerial Micro-Drones a Reality (AIS306) - AWS re:Invent 2018

283 views

Published on

The concept of insect-scale aerial drones has long been in the realm of science fiction rather than reality, especially since powering such small drones is fundamentally difficult. In this talk, Shyam Gollakota will share his work on robofly, the first honeybee-sized wireless drone to successfully lift off. He will also discuss an alternative biology-based solution that integrates sensing, computing, and communication functions onto live-flying bumblebees. Data generated from this mobile IoT platform can feed AI models that have the potential to generate valuable intelligence for applications ranging from precision irrigation to environmental sensing.

  • Be the first to comment

  • Be the first to like this

Making Aerial Micro-Drones a Reality (AIS306) - AWS re:Invent 2018

  1. 1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. AI Summit Making Aerial Micro-Drones a Reality Shyam Gollakota, University of Washington
  2. 2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Big data applications using aerial drones
  3. 3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. This talk Designing insect-sized micro drones
  4. 4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why flying insect robotics? 1. small scale l 2. airborne 3. low cost $ confined spaces any terrain swarms
  5. 5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Just shrink? ?
  6. 6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Small is different
  7. 7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. 7 Inspiration from nature
  8. 8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. 8 Abridged history of insect-scale drones 2005 20182007 Berkeley Micro-robotic Insect 2005 120 mg, 3 cm 120 Hz flapping freq. Harvard microrobotic fly 2007 60 mg, 3 cm lift > weight More than a decade Require a wire for power, comm. and controls
  9. 9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. First Wireless Fly-Sized Drone to Lift Off [ICRA’18]
  10. 10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. UW Wireless Robofly: Design Challenges • Piezo-actuators require 200 V potential  Novel 50 mg circuit for 200 V voltage boost conversion • Batteries are too heavy and have no capacity for lifeofff  Go battery-free; use solar cells to transfer power • Computation/control has to be done onboard  Design algorithms to approximate required analog signal on low-power microcontrollers
  11. 11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. UW Wireless Robofly: Design Challenges
  12. 12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Lightest Wireless Robot to Fly Liftoff of a 190 mg Laser-Powered Aerial Vehicle: The Lightest Wireless Robot to Fly Johannes James, Vikram Iyer, Yogesh Chukewad, Shyam Gollakota, Sawyer Fuller, ICRA’18
  13. 13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. In the next few months Fully wireless and battery-free sustained flight
  14. 14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Mechanical drones consumes lots of power Need recharging every 10-20 minutes!
  15. 15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Living IoT: A Flying Wireless Platform on Live Insects
  16. 16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.Sensing + tracking + communication + data analysis Idea: Use live insects to carry wireless sensors
  17. 17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Bio-based solution • No need for mechanical propulsion • Bees are introduced in farms for pollination • Fabricating tiny circuits
  18. 18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Bee carrying humidity sensor and microcontroller
  19. 19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Challenge 1: Small weight & low power 1. Size/Weight 2. Power ~100 mg = 70 mg battery + 30 mg electronics
  20. 20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Challenge 2: Can’t control bee motion! Wirelessly track the 2D location of bee  Map the sensor value to the location in the farm
  21. 21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Building low-weight hardware • 2D tracking of the bees Our Solutions
  22. 22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Making low-weight hardware
  23. 23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Programmable general-purpose design • Programmable microcontroller • Interfaces temperature and humidity sensors • Supports wireless communication • Weighs < 30 mg • Fabricating tiny circuits
  24. 24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  25. 25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  26. 26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. • Building low-weight hardware • 2D tracking of the bees Our Solutions
  27. 27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Why can’t we use GPS? GPS Problem: GPS is power expensive Solution: Passive receiver circuit
  28. 28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. But, amplitude only gives range, not angle How do we exact the 2D location?
  29. 29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Search for the angle using beamforming
  30. 30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Evaluating 2D localization 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 0 2 4 6 8 10 12 14 CDF Localization error (m) 2D x y
  31. 31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Other sensors on the platform QVGA Camera 3-axis accelerometer
  32. 32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  33. 33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Data Analytics using Edge Computing • Upload images to edge device • Perform machine learning across real-time data (e.g., video, temperature, humidity data) collected from hundreds of bees
  34. 34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Machine learning on data across bees • Predict plant disease based on images and trajectory of the bees • Improve bee tracking using simultaneous localization and mapping (SLAM) algorithms
  35. 35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Conclusions • Aerial micro-drone that piggyback on live insects • Mechanical micro-drones that imitate nature
  36. 36. Thank you! © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved. Shyam Gollakota

×