Dr.J.J.Magdum College of Engineering ,Jaysingpur.
Department of Computer Science & Engineering
final year project presention
“Object Dtection for visually imparied people”
Project Guide Prof A.V.Gundavade.
Team members,
Name Roll No
Shradha Balasaheb Ketkale 54
Swachanda Chandrakant Loandhe 55
Muskan Mustak Mujawar 56
Sneha Suryakant Bansode 57
Object Detection for Visually Imparied People
Problem Statetment
• Visually Impaired People confront many problems in moving from one place to another ,i.e., navigation. Vision
is human’s power to notify him of the obstacles in his way . A solution which is easily available is needed to
solve the problems of blind people . The application developed can detect the objects in the user's
surroundings. It can alert the user of the obstacle s in his path way and this way helps the user to navigate
from one place to another saving him from tripping anywhere. It will also solve the problem of keeping a
special device or a walking stick.
Object Detection for Visually Imparied People
Purpose
• Our main aim is, an object recognition function with mobile application
should be able to detect certain items from the camera and return an audio
out put to announce what it is . In order to recognize object, machine
learning has to be involved.
Object Detection for Visually Imparied People
Literature review
• Prof. Seema Udgirkar, Shivaji Sarokar, Sujit Gore, Dinesh Kakuste, Suraj Chaskar, This
paper proposes a system in which two cameras are put on the glasses of a blind person.
• Daniyal Rajput, Faheem Ahmed, Habib Ahmed, Engr Zakir Ahmed Shaikh, Aamir
Shamshad , MATLAB Software is used for signal processing. The camcorder is used for
recording videos. Video processing methods are used after that.
• Khushboo Khurana, Reetu AwasthAwasthi , This system tries to detect multiple objects in
an image. That is the core specialty of the system. It is a system where N object detectors are
trained for N different objects.
Object Detection for Visually Imparied People
Introduction
• The application developed can detect the objects in the user's surroundings. It can
alert the user of the obstacles in his pathway and this way helps the user to
navigate from one place to another saving him from tripping anywhere.
• Thus in this a model has been proposed which makes the use of smartphone, a
common device available to anyone and used technology to make an application
which can help the blind user detect objects in his surroundings and help him in
navigating from one place to another. The output of the system is in audio form
that can be easily understandable for a blind user.
Object Detection for Visually Imparied People
Methodology
• Our main aim is, an object recognition function with mobile application should be able to detect certain
items from the camera and return an audio output to announce what it is . In order to recognize object,
machine learning has to be involved.
modules are :
• Object detection
• Object recognition
• Text to Speech
• Speech to text
• Word Recognition
Object Detection for Visually Imparied People
Implementation Tools
• Software Requirements:
 Android Smartphone.
 Android Studio
 Google Cloud Cocodataset.
• Functional Requirements:
 CNN and RCNN(regionbasedconvuctionalmodel),
 K-means clustering algorithm, predictions(HMM hiddenmarkovmodel)
 object recognition, image processing, cloud cocodataset.
 PythonLibraries:TensorFlow, OpenCV, Google Cloud VisionAPI
• PerformanceRequirements:
 Software: Android studio version 3.1.0
 Operating System: windows 10
 RAM: 4GB
Object Detection for Visually Imparied People
Module
• Capturing Images
• Detecting Images
• Recognize object
• Text to speech conversations.
• Word recognize
Object Detection for Visually Imparied People
Work Done
LOREM IPSUM
DOLOR SIT
AMET MAGNA
SED
01
LOREM IPSUM
DOLOR SIT
AMET
02 03
Object Detection for Visually Imparied People
Future Work
• Text to Speech
• Speech to text
• Word Recognition
Object Detection for Visually Imparied People
THANK YOU
Object Detection for Visually Imparied People

Object detection.pptx

  • 1.
    Dr.J.J.Magdum College ofEngineering ,Jaysingpur. Department of Computer Science & Engineering final year project presention “Object Dtection for visually imparied people” Project Guide Prof A.V.Gundavade.
  • 2.
    Team members, Name RollNo Shradha Balasaheb Ketkale 54 Swachanda Chandrakant Loandhe 55 Muskan Mustak Mujawar 56 Sneha Suryakant Bansode 57 Object Detection for Visually Imparied People
  • 3.
    Problem Statetment • VisuallyImpaired People confront many problems in moving from one place to another ,i.e., navigation. Vision is human’s power to notify him of the obstacles in his way . A solution which is easily available is needed to solve the problems of blind people . The application developed can detect the objects in the user's surroundings. It can alert the user of the obstacle s in his path way and this way helps the user to navigate from one place to another saving him from tripping anywhere. It will also solve the problem of keeping a special device or a walking stick. Object Detection for Visually Imparied People
  • 4.
    Purpose • Our mainaim is, an object recognition function with mobile application should be able to detect certain items from the camera and return an audio out put to announce what it is . In order to recognize object, machine learning has to be involved. Object Detection for Visually Imparied People
  • 5.
    Literature review • Prof.Seema Udgirkar, Shivaji Sarokar, Sujit Gore, Dinesh Kakuste, Suraj Chaskar, This paper proposes a system in which two cameras are put on the glasses of a blind person. • Daniyal Rajput, Faheem Ahmed, Habib Ahmed, Engr Zakir Ahmed Shaikh, Aamir Shamshad , MATLAB Software is used for signal processing. The camcorder is used for recording videos. Video processing methods are used after that. • Khushboo Khurana, Reetu AwasthAwasthi , This system tries to detect multiple objects in an image. That is the core specialty of the system. It is a system where N object detectors are trained for N different objects. Object Detection for Visually Imparied People
  • 6.
    Introduction • The applicationdeveloped can detect the objects in the user's surroundings. It can alert the user of the obstacles in his pathway and this way helps the user to navigate from one place to another saving him from tripping anywhere. • Thus in this a model has been proposed which makes the use of smartphone, a common device available to anyone and used technology to make an application which can help the blind user detect objects in his surroundings and help him in navigating from one place to another. The output of the system is in audio form that can be easily understandable for a blind user. Object Detection for Visually Imparied People
  • 7.
    Methodology • Our mainaim is, an object recognition function with mobile application should be able to detect certain items from the camera and return an audio output to announce what it is . In order to recognize object, machine learning has to be involved. modules are : • Object detection • Object recognition • Text to Speech • Speech to text • Word Recognition Object Detection for Visually Imparied People
  • 8.
    Implementation Tools • SoftwareRequirements:  Android Smartphone.  Android Studio  Google Cloud Cocodataset. • Functional Requirements:  CNN and RCNN(regionbasedconvuctionalmodel),  K-means clustering algorithm, predictions(HMM hiddenmarkovmodel)  object recognition, image processing, cloud cocodataset.  PythonLibraries:TensorFlow, OpenCV, Google Cloud VisionAPI • PerformanceRequirements:  Software: Android studio version 3.1.0  Operating System: windows 10  RAM: 4GB Object Detection for Visually Imparied People
  • 9.
    Module • Capturing Images •Detecting Images • Recognize object • Text to speech conversations. • Word recognize Object Detection for Visually Imparied People
  • 10.
    Work Done LOREM IPSUM DOLORSIT AMET MAGNA SED 01 LOREM IPSUM DOLOR SIT AMET 02 03 Object Detection for Visually Imparied People
  • 11.
    Future Work • Textto Speech • Speech to text • Word Recognition Object Detection for Visually Imparied People
  • 12.
    THANK YOU Object Detectionfor Visually Imparied People