3. 3
• 285 million people are estimated to be visually impaired
worldwide .39 million are blind and 246 million people have low
vision. Blind people have issues all the time while travelling.
Blindness causes considerable social challenges. Blindness causes
injuries due to obstacles in their way.
• Blind People want to have an idea about their surroundings.
Introduction and Problem Statement
4. 4
Develop a system that would Identify the objects and somehow inform blind people so that they have
idea of their surroundings.
Introduction and Problem Statement
Solution of the problem:-
Why are we developing:-
An Android Application that identifies the objects using mobile camera and verbally informs users (Blind
or Visually Impaired).
What skills we expect to learn:-
Deep Neural Networks, Image Processing, Data Analysis, Voice recognition, Android Development etc.
Blind people don’t have an idea of their surroundings. They wonder how the outside world is and what
are the objects around them.
What problems does it solve:-
5. Related System Analysis
5
Weaknesses in Existing Applications
Application Name Weakness Targeted Project
Solution
Optasia It does not recognize objects and give alerts
according to the object.
Our solution will provide the
ability to detect and identify
objects in the way and alert the
user accordingly.
Blind Assistant Only detects if there is something in 1-2 feet of the
user.
Our solution will provide the
ability to detect and identify
objects in the way and alert the
user accordingly. The distance of
objects will be 20-30 feet.
Walk helper for Blind Only helps in finding routes and places that the user
has already added in the application. No information
regarding the surroundings
Our solution will provide the
ability to detect and identify
objects in the way and alert the
user accordingly.
6. Problem Solution
• We will use an Android phone’s camera to detect and recognize objects.
• Objects will be recognized based upon the training of the system and upon
recognition of an object . A voice alert will be given to the user.
• The alert will also provide some information regarding the location of the
object recognized.
6
7. Advantages of Proposed System
• It provides the ability to detect and identify some objects in the surroundings
• It will enable them to interact with the system using voice commands.
• It will help the blind people get an idea of their surroundings.
• The voice recognition will be adapted to every user, making them more efficient
than standard Android voice recognition system.
7
8. Scope and Modules
Scope:
• Android Application using Mobile’s Camera
• Detect and Identify Objects
• Inform user about the object and it’s whereabouts.
• Interfacing is using Voice commands
• Voice command recognition adaption using training session.
8
10. Scope and Modules
– Module 1: Android Application
• Provide an interface to interact with
• Recognize voice commands
• Adapt to the user’s voice
• Get Camera Feed
10
11. Scope and Modules
– Module 2: Object Recognition
• Get real time video feed from the smart phone’s camera.
• Feed will be broken down into frames.
• Background will be removed from every frame.
• Object will be extracted from the images.
• Compare objects with data in system, and notify accordingly.
11
12. Scope and Modules
– Module 3: Voice Recognition
• Voice feedback used to notify user about any object in camera’s sight.
• Use of a speech Recognition library for Interaction.
• Voice Commands Training for user’s voice adaption.
• User will be able to interact with the system using voice commands.
12
13. Data Gathering Approach
• We will use interview approach to gather information regarding the features
that should be available in the system.
13