Presentation by Tessie Hartjes and Iris Huijben of team Blue Jay Eindhoven for the meetup Girl Code meets IOT. https://www.bluejayeindhoven.nl/ Topic: Blue Jay, the first domestic drone Tessie: Co-founder of team Blue Jay and Team Manager Iris: Developer specialised in object recognition and navigation

1. How neural networks can make a drone
your next best friend
Tessie Hartjes
MASTER Electrical Engineering
Electromechanics & power electronics
BACHELOR Innovation Science
Track: Energie
Iris Huijben
MASTER Electrical Engineering
Track: Care and Cure - Signal Processing
BACHELOR Pyschology & Technology
Track: Robotica
How neural networks can make a drone
your next best friend
Blue Jay Eindhoven
10-08-2016

2. 01
2015 - 2016

3. www.bluejayeindhoven.nl
The first domestic drone
Showing the useful potential of drones
02

4. www.bluejayeindhoven.nl
03

5. www.bluejayeindhoven.nl
Biggest challenge
04
Accurate indoor navigation
Flying indoor and between people = no room for error!
- The drone will fly more stable when it ‘flies itself’ (autonomous)
- But, existing solutions aren’t accurate enough

6. www.bluejayeindhoven.nl
Our solution
04
Visible light communication: cm exact indoor navigation
Online database
- Every LED lamp has its own recognizable frequency
- An online database holds the position of every lamp and is
accessed by the drone
- The camera of your smartphone registers the composed light and
calculates your position with respect to the known configuration of
the lamps
Unique and precise solution within robotics domain but one problem: people only walk in the x- and y-plane  need
for sensor fusion

7. www.bluejayeindhoven.nl
Our solution
04
Sensor fusion
LiDAR
Light detection and ranging sensor
Altitude measurement based on timing
differences of laser beams
Optical flow
Relative x and y displacement
A camera that ‘sees’ relative movement through
image displacement

8. www.bluejayeindhoven.nl
Blue Jay as assistent
05
Object recognition
Navigation
Face recognition

9. www.bluejayeindhoven.nl
Neural networks for flexibility
06

10. www.bluejayeindhoven.nl
Training and testing
07
-45
-35
-25
-15
-5
5
15
25
35
45
-45 -35 -25 -15 -5 5 15 25 35 45
Output(degrees)
Target (degrees)
Target-output correspondence
Yaw
Pitch

11. www.bluejayeindhoven.nl
Training and testing
08
16.664 pictures

12. www.bluejayeindhoven.nl
Challenges & user cases
09
Object avoidance
Health care
Recognizing new
people and objects
Noise reduction
Assistance / guidance
Fire safety

14. www.bluejayeindhoven.nl