Research paper on indoor drone application with acoustic localization. Paper was accepted to the ISEEE 2019 conference (International Symposium on Electrical and Electronics Engineering).
1. Indoor Drone Application with Acoustic Localization
Ali AnΔ±l DEMΔ°RΓALI, Egemen BALBAN, Abdurrahman YILMAZ,
Gizem Melike CΔ°DAL, HΓΌseyin ΓVET
YΔ±ldΔ±z Technical University, Δ°stanbul, Turkey
alianildemircali1@gmail.com, abdurrahmanyilmaz953@gmail.com
YΔ±ldΔ±z Technical University, Δ°stanbul, Turkey,
huseyinuvet@gmail.com
Abstract
This paper investigates the design of a rotary wing unmanned
aerial vehicle (UAV) and the method used for this UAV to
determine its mathematical location indoors. The optimal
method used for the location determination was established
upon research. By reducing the signal loss caused by the
indoor area and with the use of acoustic localization that
measure distance by 3-dimensional vectors with velocity of
ultrasonic sound wave, the determined method allowed the
instantaneous observation of the UAVβs mathematical
location in 3-dimensional space. Furthermore, this method
enabled a balanced and efficient autonomous flight indoors.
1. Introduction
Drones such as unmanned aerial vehicles, can be tracked and have
their mathematical locations determined outdoors, given that they
are equipped with a GPS (Global Positioning System) and 4 or
more satellites. However, this situation cannot be realized in
indoor applications. The main reason for this is that the walls have
a signal reducing effect which causes great deviation in the
process of mathematical location determination.[1][2][4][5]
Hence, it is not possible to track an aerial vehicle and receive data
regarding its location using GPS signals indoors. Other methods
like laser based or wireless and even image processing have also
been tried for location determination for indoor flights. The usage
of wireless communication modules such as Bluetooth or Wi-Fi
for data transaction was attempted as a solution, but it was
unsuccessful due to the fact that the mathematical location
determination had a precision range between 3-5 meters[1][5][12]
Another method is using the laser technique with LIDAR sensor
or SLAM for mapping. However these systems having extremely
high prices, besides that in an exceptional case for aerial vehicle,
the laser module would have an incorrect angle and the mapping
process would lose precision. Therefore, this method was found
to be insufficient indoors. .[1]
In the previous studies, indoor drone flight has been attempted,
but there have been no studies on its warehouse applications.[1]
Most of the studies up to now were on laser-based mapping and
communication protocols. Land vehicles, specifically forklifts
and similar vehicles, are widely used in the warehouse studies.
However, the usage of forklifts and similar vehicles pose a threat
to human life in warehouses considering the fact that several big
and heavy products are stored.
In this paper, the mathematical location of a drone flying in the
halls of a warehouse is determined using acoustic localization,
which is the method of measuring distances using ultrasonic
sound waves. By receiving the required data using the
aforementioned method, it will be possible for the aerial vehicle
to fly efficiently and autonomously in warehouses for security,
counting products or other purposes. The solution that this work
focuses on is an autonomous aerial vehicle capable of counting
the products on the shelves inside the warehouse.
2. Mathematical Model
2.1 Rotation Matrixes
The relationship between rotations and axes is shown in Fig.1.
Deviation, pitching and wobble rotation matrices are as follows.
π πΊ
π·
refers to the rotation matrix of the moving axis on the fixed
axis.
Deflection Rotation Matrixes:
π πΊ
π·(π) = [
πππ π π ππ π 0
βπ ππ π πππ π 0
0 0 1
] (1)
Rolling Rotation Matrixes:
π πΊ
π·(ΞΈ) = [
πππ ΞΈ 0 βπ ππ ΞΈ
0 1 0
π ππ ΞΈ 0 πππ ΞΈ
] (2)
Pitching Rotation Matrixes:
π πΊ
π·(Ο) = [
1 0 0
0 πππ Ο π ππ Ο
0 βπ ππ Ο πππ Ο
] (3)
The matrices (1), (2), (3) are multiplied to show the relationship
between the fixed axis and the body axis with a single matrix.
π πΊ
π·
= π πΊ
π·(π)π πΊ
π·(ΞΈ)π πΊ
π·(Ο)
2. π πΊ
π·
=
[
cπ cΞΈ c π s ΞΈ s Ο β s π c Ο cπ sΞΈ cΟ + sπ sΟ
sπ cΞΈ sπ s ΞΈ s Ο + c π c ΞΈ sπ sΞΈ cΟ β cπ sΟ
βπ ΞΈ c ΞΈ s Ο cΞΈ cΟ
]
(4) (c: Cos, s: Sin)
2.2 Equations of Motion
6 To obtain the dynamic model of the motorized UAV, Newton
Euler connection will be used to express the forces and torques
acting on a rigid body.
Newton- Euler Rquations:
The Newton- Euler relation allows us to write Euler 's 2 equations
of motion for a rigid body as a single equation with 6 variables.
[
ππΌ3π₯3 03π₯3
03π₯3 πΌ
] [ πΜ πΊ
Ρ‘Μ πΊ
] + [Ρ‘ πΊ Γ ππ πΊ
Ρ‘ πΊ
Γ πΌΡ‘ πΊ ] = [ πΉ πΊ
π πΊ ] (5)
In matrixes equations , π [kg] mass, πΌ [πππ 2
] moment of inertia,
π πΊ
= [ π’ π£ π€ ] [m/s] linear speed on frame axis, Ρ‘ πΊ
=
[ π π π ][πππ/π ] angular speed on frame axis, πΉ πΊ
[π] Forces on
UAV, π πΊ[ππ] Torques on UAV.
πΌ3π₯3 = [
πΌ π₯π₯ 0 0
0 πΌ π¦π¦ 0
0 0 πΌπ§π§
]
shows the moment of inertia matrix.
If we show the force and torque equations according to these
statements
πΉ πΊ = ππΌ3π₯3 πΜ πΊ + Ρ‘ πΊ Γ ππ πΊ = [
ππ’Μ
ππ£Μ
ππ€Μ
] +
[
0 βπ π
π 0 βπ
βπ π 0
] [
ππ’
ππ£
ππ€
] (6)
π πΊ
= πΌΡ‘Μ πΊ
+ Ρ‘ πΊ
Γ πΌΡ‘ πΊ
(7)
If angular and linear accelerations are drawn from these equations
[
π’Μ
π£Μ
π€Μ
] = [
ππ£ β ππ€
ππ€ β ππ’
ππ’ β ππ£
] +
[
1
π
πΉπ₯
πΊ
1
π
πΉπ¦
πΊ
1
π
πΉπ§
πΊ
]
(8)
2.3 Forces and Torque
(8) and (9). The expression of Force and Torque in the
expressions in equality will be obtained.
2.3.1 Forces
The forces acting on the UAV body are examined and shown
below in Figure 5.
Gravity:
Since it acts only in the opposite direction to the z-axis, it can be
expressed by the following matrix.
Fgravity
G
= RD
G
[
0
0
-mg
] = [
mgsin ΞΈ
-mgcos ΞΈ sin Ο
-mgcos ΞΈ cos Ο
] (10)
Thrust:
6 The total impulse force generated by the propeller is shown in
the figure below. refers to the impulse constant.. π[ππ 2]refers to
the impulse constant..
πΉπ‘βππ’π π‘
πΊ
= π β β¦π
2
6
π=1
(11)
Air Reesistance:
The negative force that the propeller is exposed to by the air when
moving at high speeds can be expressed as follows. It is
proportional to the square of the speed.
Fair
G
=
[
-
1
2
CAxΟu2
-
1
2
CAyΟu2
-
1
2
CAzΟu2
]
(12)
πΆ Express the air resistance, π΄ π₯, π΄ π¦, π΄ π§[π2
] Express the
sectional area, π[ππ/π3
] Express the air density.
Torque:
Deviation from engine speed differences, rollinf and pitching
movements occur. The torques that cause these movements are
shown below. π[πππ 2] express the drag forces.
Roll Torque:
π πππππππ = ππ
β3
2
(β¦2
2
+ β¦3
2
β β¦5
2
β β¦6
2
) (13)
This is due to the fact that the angle made with the eksen
β3
2
x -
axis in the torque equation is 60 Β°. This is shown in FIG. In Figure
x is the distance of the motor from the intersection of the x and y
axis. π[ππ 2] refers to the impulse constant
Fig. 1. The shown of the direction the rotors. (1,3,6) the
rotors are the green ones show that they turn to clockwise,
(2,4,5) the blue ones show that the rotors turn to counter
clock wise
Pitching Torque:
π πππ‘πβπππ = ππ(ββ¦1
2
+ β¦4
2
+
1
2
(ββ¦2
2
+ β¦3
2
+ β¦5
2
β
β¦6
2
) ) (14)
The expression
1
2
in the equation stems from the fact that the
angle of the 2,3,5 and 6 motors with the axis is 30Β°
Yawwing Torque:
π πππππππ‘πππ = π(ββ¦1
2
+ β¦2
2
ββ¦3
2
+ β¦4
2
β β¦5
2
+ β¦6
2
)
(15)
The expression d in the equation shows the drift coefficient.
Gyroscopic Effect of Propellers:
The rotation of the propellers has a gyroscopic effect on the UAV.
π ππ¦πππ ππππ = [
βπ½πΞΈΜβ¦r
βπ½πΟΜ β¦r
0
] (16)
3. π½π [πππ 2]Moment of inertia of propellers, β¦r[πππ/π ] Express
total impeller speed.
Reverse Deflection Torque:
Because of the different acceleration of the propellers, reverse
torque occurs in the deflection direction. β¦r
Μ [πππ/π 2] shows the
angular acceleration.
Οreverse = [
0
0
Jrβ¦r
Μ
] (17)
2.4 Force and Torque Equations
The force and torque equations we obtained, if we use the
equations (8) and (9).
[
π’Μ
π£Μ
π€Μ
] =
[
ππ£ β ππ€ + πsin ΞΈ β
1
2π
πΆπ΄ π₯ ππ’2
ππ€ β ππ’ β πcos ΞΈ sin Ο β
1
2π
πΆπ΄ π¦ ππ’2
ππ’ β ππ£ β πcos ΞΈ cos Ο +
1
m
πΉππ‘ππ β
1
2π
πΆπ΄ π§ ππ’2
]
(18)
[
πΜ
πΜ
πΜ
] =
[
πΌ π¦π¦βπΌ π§π§
πΌ π₯π₯
ππ +
1
πΌ π₯π₯
π π¦ππππππππ β
1
πΌ π₯π₯
π½πΞΈΜβ¦r
πΌ π§π§βπΌ π₯π₯
πΌ π¦π¦
ππ +
1
πΌ π¦π¦
π π¦π’ππ’π ππππ +
1
πΌ π¦π¦
π½πΟΜ β¦r
πΌ π₯π₯βπΌ π¦π¦
πΌ π§π§
ππ +
1
πΌ π§π§
π π ππππ +
1
πΌ π§π§
π½πβ¦r
Μ
]
(19)
πΉπ‘βππ’π π‘
πΊ
= π β β¦π
2
6
π=1
π ππππ = ππ
β3
2
(β¦2
2
+ β¦3
2
β β¦5
2
β β¦6
2
)
π πππ‘πβ = ππ(ββ¦1
2
+ β¦4
2
+
1
2
(ββ¦2
2
+ β¦3
2
+ β¦5
2
β β¦6
2
) )
π π¦ππ€ = π(ββ¦1
2
+ β¦2
2
ββ¦3
2
+ β¦4
2
β β¦5
2
+ β¦6
2
)
β¦r = ββ¦1 + β¦2 β β¦3 + β¦4 β β¦5 + β¦6
2.5 Battery Selection
πΌ = πΆπ β πΈπ
πΆπ = πΌ πΈπ
Er = Rated energy stored in Ah (rated capacity of the battery
given by the manufacturer)
I = current of charge or discharge in Amperes (A)
Cr = Discharge rate of the battery
equation to get the time of charge or charge or discharge "t"
according to current and rated capacity is:
π‘ = πΈπ πΌ
t = time, duration of charge or discharge (runtime) in hours
Relationship between Cr and t ;
πΆπ =
1
π‘
π‘ =
1
πΆπ
Matematical Localization
In this paper, drone move by the hall and localization of drone
measure with the vectoral distance to the microphones. At first
drone locate to the hall and microophones locations are known.
After that while drone move through the hall drone measure the
distance with sound velocity. So 3 different equations has
obtained below.
The referance distance of drone to the first microphone is |π΄|
The referance distance of drone to the second microphone is |π΅|
The referance distance of drone to the third microphone is |πΆ|
Distance equations:
π΄2
= 391,572
= π2
+ π2
+ π2
π΅2
= 402,192
= π2
+ π2
+ 2ππ + π2
+ π2
+ π2
+ 2ππ
πΆ2 = 432,92 = π2 + π2 + π2 + π2 + 2ππ
If you solve the equations.
|π| = 370.01
|π| = 119,95
|π| = 44,99
Fig. 2. Acoustic Localization Description
3. Component Selection
The drone that fly autonomously and read the barcodes on the
packages located on shelves throughout the warehouse hallways.
It must have a certain payload, because in addition to common
drone equipments such as battery, flight controller, motors and
electronic speed controllers, there is also a camera and a camera
lens for streaming or image processing, and there are movement
sensors located on its top and front for maintaining a safe
distance. Besides, the transmitter that will produce the ultrasonic
sound waves for location determination is also one of the
beneficial loads that will be located on the drone. Design of the
drone shown below in Fig.3. The aforementioned loads are given
in Table 1 along with their weights.
4. Fig. 3. Warehouse stock counting drone
Table 1. System Needs and Payloads
Material Qty Weight(gr) Total Weight(gr)
Li-Po Battery 2 782 1570
Frame 1 810 810
Motor 6 97 582
Camera Lens 1 245 245
ESC 6 28 168
Propeller 6 15 90
Camera 1 80 80
Flight Controller 1 75 75
Cables 1 75 75
Transmitter 1 60 60
Altitude Sensor 1 27 27
3DR Receiver 1 17 17
Power Module 1 16 16
PCB 1 15 15
Streaming Cables 1 15 15
Total 3845
4. Warehouse Solution
The ultrasonic sound waves transmitted from the drone are
received by the microphones located throughout the warehouse
halls. By measuring the time it takes for the transmitted sound
waves to be received by the microphones with known locations,
the mathematical location of the drone is determined. This
method is called acoustic localization. With this method, the
sensors can be tracked within an error range of 3-4 cm due to the
motion of the drone, and it is seen that these values are at a
sufficient level for a system that operates instantaneously. The
drone systemβs operation method inside the hall is shown in Fig.4.
Fig. 4. Ultrasonic sound wave transmitter and receivers location
on the hallway.The hallways dimensions is 120m length and 50m
width (The curves represent the ultrasonic waves)
precautions are taken. An altitude sensor is used to maintain a safe
distance between the drone, the floor and the ceiling in
unexpected situations. In order to balance the distance between
the shelves and maintain a safe location, the distance between the
drone and the shelves is limited using a laser distance sensor.
Fig. 5. Application Description
In operation drone fly betwenn shelves and follow a path to read
the barcodes on the boxes. The path that drone followed for this
opeation shown below in the Fig.6 with yellow fill and black
border.
Fig. 6. The yellow path that drone followed and read the
barcodes
5. Simulation and Experiments
5.1 Static Analysis
Drone designed for the warehouse application, after some
simulations and calculations for mechanic durability and software
5. accuracy. The stress analysis of the system shown below in Figure
7 and the strain analysis also shown in Fig.8.
Fig.7. Stress Analysis (Isometric View)
Fig.8. Stress Analysis with Deformation (Side View)
5.2 Experiments
For the localization accurasy, we located 4 reference microphone
and calculated that drones position and its shown in Fig.9. The
green circles are represent the reference microphones and the
hollow green circle represent the drone. We calculated the
position and made that simulation. After that we move the drone
to new attitude and the path that drone followed shown in the
Fig.10. They showed that the calculation and the simulation is
accurated for localization opeation.
Fig.9. Software Interface that shows the matematical
location microphones and the drone (The green ones are
microphones and the unfilled blue circle is the drone.)
Fig.10. Showing of the moving of the drone (Blue prints are the
path that drone follows.)
6. Conclusions
It is a difficult case for a drone to fly autonomously and
controlled stable while this drone is being designed for warehouse
product counting and this systemβs PID setting are being made.
Since the warehouse is an indoor area, its walls absorb and scatter
GPS signals. The deviation or absorption of the GPS signals in
turn cause an interruption in the process location determination
and a high error percentage. Therefore, using GPS signals as a
method for location determination is not suitable for an
autonomously flying drone operating indoors. In this study,
however, the drone system used the acoustic localization method
with ultrasonic sound waves for location determination, and the
instantaneous mathematical location of the drone was determined
in 3-dimensional space with an error margin of 4-5 cm.
Furthermore, it was observed that other methods that were used
to count products in warehouses pose a threat to workplace
security and this study aimed to solve this issue with a stable
drone system. For security, the aerial vehicle was equipped with
distance sensors, an altitude sensor, and an emergency stop relay
which is activated if the security barrier is breached. Thus, the
produced autonomous drone system minimizes risks in the
warehouse. In the future, this system can turn into a completely
autonomous one that does not require any supervision, and it can
be used for product counting or other purposes in warehouses of
any kind, whether it poses a low risk, or a high risk with big and
heavy product packages. Furthermore, it may surely clear the path
in front of multiple drone controlling systems..
7. References
[1] Johan Fogelberg (2013) Navigation and Autonomous
Control of a Hexacopter in Indoor Environments, Department of
Automatic Control Lund University: Department of Automatic
Control Lund University
[2] Wikipedia: Unmanned Aerial Vehicle. [Online]. Available:
http://en.wikipedia. org/wiki/UAV
[3] DIY Drones. [Online]. Available: http://diydrones.com/
[4] Aeroquad: The open source quadcopter / multicopter.
[Online]. Available: http://aeroquad.com/
6. [5] S. Lange, N. Sunderhauf, and P. Protzel, βA vision based
onboard approach for landing and position control of an
autonomous multirotor UAV in GPSdenied environments,β in
Advanced Robotics, 2009. ICAR 2009. International Conference
on, year = 2009, pages = 1β6, organization = IEEE.
[6] I. Sa and P. Corke, βSystem identification, estimation and
control for a cost effective open-source quadcopter,β in Robotics
and Automation (ICRA), 2012 IEEE International Conference on,
year = 2012, pages = 2202β2209, organization = IEEE,.
[7] R. W. Beard, βQuadrotor dynamics and control,β Brigham
Young University, 2008.
[8] R. C. Leishman, J. Macdonald, R. W. Beard, and T. W.
McLain, βQuadrotors & Accelerometers,β 2013. [9] J.
Macdonald, R. Leishman, R. Beard, and T. McLain, βAnalysis of
an Improved IMU-Based Observer for Multirotor Helicopters,β
Journal of Intelligent & Robotic Systems, pp. 1β13, 2013.
[10] S. J. Julier and J. K. Uhlmann, βA general method for
approximating nonlinear transformations of probability
distributions,β Robotics Research Group, Department of
Engineering Science, University of Oxford, Oxford, OC1 3PJ
United Kingdom, Tech. Rep, 1996.
[11] R. Van Der Merwe, βSigma-point Kalman filters for
probabilistic inference in dynamic state-space models,β Ph.D.
dissertation, University of Stellenbosch, 2004.
[12] S. M. Siddiqui, βIntegrated navigation and self alignment
using Square Root Unscented Kalman filtering,β in Applied
Sciences and Technology (IBCAST), 73 Bibliography 2013 10th
International Bhurban Conference on, year = 2013, pages = 73β
76, organization = IEEE,.
[13] R. Kandepu, B. Foss, and L. Imsland, βApplying the
unscented Kalman filter for nonlinear state estimation,β Journal
of Process Control, vol. 18, no. 7, pp. 753β768, 2008.
[14] L. Meier, P. Tanskanen, L. Heng, G. H. Lee, F. Fraundorfer,
and M. Pollefeys, βPIXHAWK: A micro aerial vehicle design for
autonomous flight using onboard computer vision,β Autonomous
Robots, vol. 33, no. 1-2, pp. 21β39, 2012.
[15] DIY Drones: APM:Copter. [Online]. Available:
http://copter.ardupilot.com/
[16] S. Bouabdallah, βDesign and control of quadrotors with
application to autonomous flying,β Ecole Polytechnique Federale
de Lausanne, 2007.