-

1. 1
(An Autonomous Institution, Aided by the Government of Karnataka, affiliated to VTU, Belagavi)
Fourth International Conference on “Emerging Research in Electronics,
Computer Science and Technology” ICERECT – 2022
Paper Presentation
Paper id: 297
Tittle of the Paper: SISR - Smart Indoor Surveillance Robot using IoT for day to
day usage.
Author(s):
1. Sanjay S Tippannavar
2. Madhu Sudan M P
3. Madhu Sudan R
4. Vivan Sanjay Athreya
5. Yashwanth S D

2. 2
2
Outline
1. Introduction
2. Literature Survey
3. Methodology
4. Design/Working
5. Results
6. Conclusion
7. References

3. One's life surveillance is a very important and necessary feature. High-quality cameras mounted as rigid fixtures at the
key locations or regions to be watched make up conventional surveillance systems. Security cameras are now widely
used, and thanks to technological advancements, they come in a variety of sizes and developed designs. Both wired
and wireless versions are offered for them. Since they may be installed anywhere, the wireless versions give far more
versatility. Since a person must always be on duty to oversee the traditional systems, this is nearly never achievable.
The answer is that smart security cameras that can be accessed online are an excellent method to keep an eye on the
area. Connecting the gadget to the internet will allow you to direct them to any distant area for monitoring. For the
property owners, it gives them a feeling of security while they are gone. The second stage of this surveillance system
is email notifications sent to the owner when motion is detected. The field of view of traditional surveillance systems'
fixed cameras is limited in relation to the area that has to be watched. Having a surveillance robot that can be
managed by login into the Raspberry Pi camera from any place would solve this problem. By travelling across the
various rooms of the user's home.
The suggested system is an interactive robot that can communicate in duplex and conduct surveillance tasks while
alerting the user to any intruders. The system stores the video data produced during this procedure. A computer or
laptop may be used to control the robot's movement. When connected to the internet, the user's device may access
the live stream of the camera view. Security systems have become more commonplace as the frequency of unlawful
break-ins has increased in order to prevent theft damages, either at home or abroad. Traditional security measures
provide some protection, but they also include an unmonitored dead zone. In order to improve security, this research
offers a remote security monitoring system. A self-propelled patrolling robot serves as a security robot in the security
system, gaining access to the typical surveillance system's blind spots.me, this device offers a live stream of their
surroundings.
3
3
Introduction

4. A comprehensive surveillance system has been the subject of several initiatives and systems
development with a shared objective. There are systems that use a variety of controllers, processors,
and features.
The author talks about a method for detecting intruders. The robot's camera, which is fixed,
broadcasts a live image of the invader. When the PIR sensor on the robot is activated, the GSM
module linked to the Node MCU tells the user of the intruder's presence as soon as the buzzer at the
user end begins to sound [1].
It is suggested to build a surveillance robot that can rotate autonomously while measuring the surface
on the horizontal and vertical axes. By keeping an eye on them, restricting their movement, and
sending live video via a wireless channel to a distant workstation, it gives the users control over their
behaviour. For processing video and transferring it over the internet to the user's PC, an Arduino
UNO is utilised [2].
4
4
Literature Review

5. An image-capture and image-storage equipped wireless robot is suggested. It feeds live video. An in-
person Wi-Fi hotspot web server is in charge of controlling the bot. It seeks to create an inexpensive
robot that is capable of carrying out a variety of duties. This involves the usage of the Arduino Uno
R3 Based Robot Control Board. For streaming video and audio transmission, this study makes use of
two devices. With the Blynk app, the robot's control functions are integrated. The wireless
communications to the robot are made possible by the Node-MCU ESP Module [7].
A brand-new, obstacle-avoiding vision-based robot is put into service for home surveillance. This
offers the framework for a back propagation neural network-based intelligent surveillance robot that
uses three ultrasonic sensors to avoid obstacles. In order to guide the robot to the intended area, the
operator uses a 2.4 GHz video transmitter [9].
5
5
Literature Review

6. 6
6
Methodology
Fig. 1 shows a block schematic of the proposed project.
Rechargeable 12V battery is used to power the robot. A motor
driver serves as an interface between the CPU and the dc
motors and is used by the raspberry pi to run the motor. The
motors need a lot of electricity to run, whereas the Raspberry
Pi just needs a modest level of current. The motor driver
takes in a low level of current signal before switching to a
greater level of current signal to drive the motor. Two servo
motors that are positioned on a base platform in such a
manner as to allow for the camera's freedom of movement in
all directions are used to install the camera module. Input to
the microcontroller for obstacle and motion detection,
respectively, comes from the ultrasonic sensor and PIR
sensor. To prevent the robot from colliding with any objects,
obstacle detection is used.

7. 7
7
Methodology
The following describes both the functionality and the process:
• The Raspberry Pi and other components begin to boot as soon as the
power source is switched on, and the camera begins to capture footage.
• Using the username and password, the user may sign in and connect to
the robot at this time.
• After successfully logging in, the user may manoeuvre the robot using a
straightforward UI.
• The robot continuously receives data from the ultrasonic sensor, and if
an obstruction is identified within the predetermined threshold range,
the PIR sensor is used to assess whether any people are present.
• The system uses a face detection module to determine if a human
presence has been detected and whether the person can be recognised.
• If the identified person is not recognised, a notice is issued about the
intruder along with the date, time, and intruder's photo, and the robot
tracks the intruder.

8. 8
8
Methodology
The Histogram of Oriented Gradients (HOG) is a feature descriptor
that works similarly to the Canny Edge Detector, Scale Invariant, and
Feature Transform (SIFT). It is used for object detection in computer
vision and image processing. The approach counts the number of
occurrences of gradient orientation in a certain area of a picture. This
technique is comparable to Edge Orientation Histograms and Scale
Invariant Feature Transformation (SIFT). The HOG descriptor is
primarily concerned with an object's structure or form. It outperforms
all other edge descriptors because it computes features based on both
the magnitude and angle of the gradient. In terms of picture areas, it
creates histograms based on the magnitude and direction of the
gradient.

9. 9
9
Results and Discussion
Front View of the Smart Indoor surveillance bot.
Back-view of the Smart Indoor surveillance bot.

10. 10
10
Results and Discussion
Detection of the trained face of the user on the
Surveillance Bot.
Detection of Intruder on the Surveillance Bot.

11. 11
11
Results and Discussion
Automatic Video captured when
unrecognized face has been detected.

12. 12
12
Results and Discussion
Recording stopped automatically
after no motion is detected.

13. The suggested system is built on the IoT idea, using a VNC server and smart devices connected
through networks to offer monitoring and remote-control features. The suggested system controls
the robot using Wi-Fi technology for faster connectivity and higher data rates. The raspberry pi
camera is used to identify motion and the presence of a human face in the face detection approach.
The suggested interior surveillance system is designed to give a nice user experience for controlling
the robot, monitoring the environment, and alerting when required. The user may see the live video
stream while also controlling the movement of the wheels and camera. A smart interior surveillance
robot controlled by a remote desktop or portable devices utilizing IoT is successfully developed.
The suggested technology provides a solution to a variety of difficulties or circumstances where
traditional surveillance cannot be installed. Because it is based on cutting-edge technology, the
suggested concept has immense potential. Because the Surveillance robot may be operated
remotely by the user, it has the potential to have an influence on the surveillance industry with the
introduction of new technologies. During product development, a prototype model is created and
implemented, which may be made more compact and aesthetically attractive.
More sensors, such as a humidity sensor or an air pressure detector, may be interfaced with the
device to widen the specified area. The robot may be modified to go on any kind of surface using
modern mechanical upgrades. Artificial intelligence may be applied to allow the robot to monitor
and record the behavior of an unknown human face.
13
13
Conclusion

14. [1]M. Sunitha, P. V. S. S. Datta Vinay, V. S. N. Lokesh and B. D. Kumar, ”IP Based Surveillance Robot Using IOT,” 2020 Fourth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (ISMAC), 2020, pp.
337-342, doi: 10.1109/I-SMAC49090.2020.9243519.
[2]RajKumar, K., Kumar, C. S., Yuvashree, C., Murugan, M. S. (2019). Portable surveillance robot using IoT. Int. Res. J. Eng. Technol(IRJET), 6, 94-97.
[3]H. R. and M. H. Safwat Hussain, ”Surveillance Robot Using Raspberry Pi and IoT,” 2018 International Conference on Design Innovations for 3Cs Compute Communicate Control (ICDI3C), 2018, pp. 46-51, doi:
10.1109/ICDI3C.2018.00018.
[4]Balaji, G., Haritha, L.R., Mahesh, M. and Kannan, A.R., 2021. Web Controlled Raspberry Pi Surveillance Robot. Annals of the Romanian Society for Cell Biology, pp.8582-8589.
[5]Nayyar, A., Puri, V., Nguyen, N.G. and Le, D.N., 2018. Smart surveillance robot for real-time monitoring and control system in environment and industrial applications. In Information Systems Design and Intelligent
Applications (pp. 229-243). Springer, Singapore.
[6]Suciu, G., Stefanescu, S., Beceanu, C., Ceaparu, M. (2020, June). WebRTC role in real-time communication and video conferencing. In 2020 Global Internet of Things Summit (GIoTS) (pp. 1-6). IEEE.
[7]Singh, Diksha, Pooja Zaware, and Anil Nandgaonkar. ”Wi-Fi surveillance bot with real time audio video streaming through Android mobile.” 2017 2nd IEEE International Conference on Recent Trends in Electronics,
Information Communication Technology (RTEICT). IEEE, 2017.
[8]Nunez, Lyndon, and Renato M. Toasa. ”Performance evaluation of˜ RTMP, RTSP and HLS protocols for IPTV in mobile networks.” 2020 15th Iberian Conference on Information Systems and Technologies (CISTI). IEEE, 2020.
[9]Widodo Budiharto. 2015. Intelligent surveillance robot with obstacle avoidance capabilities using neural network. Intell. Neuroscience 2015, Article 52 (January 2015), 1 pages. https://doi.org/10.1155/2015/745823.
[10]Symon, Aslam Forhad, et al. ”Design and development of a smart baby monitoring system based on Raspberry Pi and Pi camera.” 2017 4th International Conference on Advances in Electrical Engineering (ICAEE). IEEE,
2017.
[11]A. Imteaj, T. Rahman, M. K. Hossain, M. S. Alam and S. A. Rahat, ”An IoT based fire alarming and authentication system for workhouse using Raspberry Pi 3,” 2017 International Conference on Electrical, Computer and
Communication Engineering (ECCE), 2017, pp. 899-904, doi: 10.1109/ECACE.2017.7913031.
[12]Kanade, Prakash, and Prajna Alva. ”Raspberry PI project–ultrasonic distance sensor in civil engineering.” Journal Homepage: http://ijmr. net. in 8.10 (2020).
[13]D. Sunehra, B. Jhansi and R. Sneha, ”Smart Robotic Personal Assistant Vehicle Using Raspberry Pi and Zero UI Technology,” 2021 6th International Conference for Convergence in Technology (I2CT), 2021, pp. 1-6, doi:
10.1109/I2CT51068.2021.9417868.
[14]Joshi, Sayali N., Vaishnavi K. Patki, Priyanka S. Dixit, and H. Bhaldar. ”Design and development of human following trolley.” International Journal of Innovative Science and Research Technology 4, no. 4 (2019).
[15]S. S. Tippannavar, S. N and P. K. M. S, "Smart Home Automation Implemented using LabVIEW and Arduino," 2022 International Conference on Electronics and Renewable Systems (ICEARS), 2022, pp. 644-649, doi:
10.1109/ICEARS53579.2022.9752265.
14
14
References