The document summarizes a final year project presentation titled "Object Detection for Visually Impaired People" presented to the Department of Computer Science & Engineering at Dr. J.J. Magdum College of Engineering. The project aims to develop a mobile application using machine learning that can detect objects in the surroundings of a visually impaired user and provide audio output to help them navigate safely. The application would incorporate modules for object detection, recognition, text-to-speech, and speech-to-text to help identify obstacles in the user's path and alert them. The project was carried out by 4 students and implemented using Android Studio, TensorFlow, OpenCV and Google Cloud Vision API on Android smartphones.
1. Dr.J.J.Magdum College of Engineering ,Jaysingpur.
Department of Computer Science & Engineering
final year project presention
“Object Dtection for visually imparied people”
Project Guide Prof A.V.Gundavade.
2. Team members,
Name Roll No
Shradha Balasaheb Ketkale 54
Swachanda Chandrakant Loandhe 55
Muskan Mustak Mujawar 56
Sneha Suryakant Bansode 57
Object Detection for Visually Imparied People
3. Problem Statetment
• Visually Impaired People confront many problems in moving from one place to another ,i.e., navigation. Vision
is human’s power to notify him of the obstacles in his way . A solution which is easily available is needed to
solve the problems of blind people . The application developed can detect the objects in the user's
surroundings. It can alert the user of the obstacle s in his path way and this way helps the user to navigate
from one place to another saving him from tripping anywhere. It will also solve the problem of keeping a
special device or a walking stick.
Object Detection for Visually Imparied People
4. Purpose
• Our main aim is, an object recognition function with mobile application
should be able to detect certain items from the camera and return an audio
out put to announce what it is . In order to recognize object, machine
learning has to be involved.
Object Detection for Visually Imparied People
5. Literature review
• Prof. Seema Udgirkar, Shivaji Sarokar, Sujit Gore, Dinesh Kakuste, Suraj Chaskar, This
paper proposes a system in which two cameras are put on the glasses of a blind person.
• Daniyal Rajput, Faheem Ahmed, Habib Ahmed, Engr Zakir Ahmed Shaikh, Aamir
Shamshad , MATLAB Software is used for signal processing. The camcorder is used for
recording videos. Video processing methods are used after that.
• Khushboo Khurana, Reetu AwasthAwasthi , This system tries to detect multiple objects in
an image. That is the core specialty of the system. It is a system where N object detectors are
trained for N different objects.
Object Detection for Visually Imparied People
6. Introduction
• The application developed can detect the objects in the user's surroundings. It can
alert the user of the obstacles in his pathway and this way helps the user to
navigate from one place to another saving him from tripping anywhere.
• Thus in this a model has been proposed which makes the use of smartphone, a
common device available to anyone and used technology to make an application
which can help the blind user detect objects in his surroundings and help him in
navigating from one place to another. The output of the system is in audio form
that can be easily understandable for a blind user.
Object Detection for Visually Imparied People
7. Methodology
• Our main aim is, an object recognition function with mobile application should be able to detect certain
items from the camera and return an audio output to announce what it is . In order to recognize object,
machine learning has to be involved.
modules are :
• Object detection
• Object recognition
• Text to Speech
• Speech to text
• Word Recognition
Object Detection for Visually Imparied People
8. Implementation Tools
• Software Requirements:
Android Smartphone.
Android Studio
Google Cloud Cocodataset.
• Functional Requirements:
CNN and RCNN(regionbasedconvuctionalmodel),
K-means clustering algorithm, predictions(HMM hiddenmarkovmodel)
object recognition, image processing, cloud cocodataset.
PythonLibraries:TensorFlow, OpenCV, Google Cloud VisionAPI
• PerformanceRequirements:
Software: Android studio version 3.1.0
Operating System: windows 10
RAM: 4GB
Object Detection for Visually Imparied People
9. Module
• Capturing Images
• Detecting Images
• Recognize object
• Text to speech conversations.
• Word recognize
Object Detection for Visually Imparied People
10. Work Done
LOREM IPSUM
DOLOR SIT
AMET MAGNA
SED
01
LOREM IPSUM
DOLOR SIT
AMET
02 03
Object Detection for Visually Imparied People
11. Future Work
• Text to Speech
• Speech to text
• Word Recognition
Object Detection for Visually Imparied People