Vexo is incorporated with machine learning and neural network algorithm

1. Vexo
w e m a k e i t h a p p e n

2. Hello!
We are Team Vexo
W e a r e h e r e t o g i v e a p r e s en t a t ion o n o u r
p r o je ct

3. –

4. Handwriting Recognition
Handwriting recognition (or HWR) is the ability of a
computer to receive and interpret intelligible
handwritten input from sources such as paper
documents, photographs, touch-screens and other
devices. The image of the written text may be sensed
"off line" from a piece of paper by optical scanning
(optical character recognition) or intelligent word
recognition. Alternatively, the movements of the pen
tip may be sensed "on line", for example by a pen-
based computer screen surface, a generally easier task
as there are more clues available.

5. Handwriting Recognition Softwares

6. Let’s start with
iSkysoft

7. iSkysoft is a perfect OCR tool for PDF files. It can
automatically recognize scanned PDF and make it
editable with built-in editing tools. And it provides
several OCR languages. Besides, you can easily edit
your PDF texts, images, links and other elements.
And it lets you to convert the PDF files to other
formats.

8. Key Features
➜Advanced OCR function
allows you to convert and
edit scanned PDFs easily.
➜Editing PDF texts, images,
and links is as easier as
making changes in Word.
➜Add signature, password,
watermarks, signs, free-
hand shapes in PDFs with
ease.
➜Easy provision of
markups and adding
annotations, wherever
necessary.
➜You can easily create
PDFs from a wide range of
document formats.
➜You can also convert the
PDF file to other formats
like Excel, MS Word and
more.

10. Pros
➜Available for Mac and
Windows
➜Great PDF creation and
editing feature
➜Significantly less
expensive than most
competitors
Cons
➜No dedicated mobile app
➜Only paid version available

11. TopOCR

13. TopOCR is designed to be simple and user-friendly for scanning
books and magazines with document cameras and scanners. It
combines a full featured Image Editor and Word Processor with
advanced multi-core image processing and three different OCR
engines. For document cameras, it also has a single-click Real-
Time Document Camera Image Preview and Capture Dialog that
makes it easy for you to properly position your documents for
scanning.

14. Pros
➜60+ recognition
language
➜Support major image
formats
➜Multi column document
analysis
Cons
➜Only online version
available
➜Free version is not
available now

15. MyScript

16. MyScript is the market leader in accurate, high-performance
handwriting recognition and digital ink management software
technology. MyScript technology combines digital ink management
with easy searching of handwritten text, as well as the accurate
recognition of complex mathematical equations, geometric
shapes, diagrams and music notation
MyScript uses b time-ordered digital ink stroke input for
conversion to digital form

17. Key Features
➜Use ICR technology
➜ Interactive note taking application
➜Supporting over 99 languages,
mathematical equations, geometric
shapes, diagrams and music notation

18. Pros
➜Available on both
mobile and desktop
operating system
➜Interactive note taking
application
Cons
➜MyScript cannot use
bitmapped input obtained
as image data from
scanners or cameras
➜Expensive

19. Google
Handwriting
Input

20. Google Handwriting Input is
handwriting recognition software developed
by Google, which works in touch input
devices. It is basically designed for android
smartphones. Google Handwriting Input is
an ICR handwriting recognition software

21. Key Features
➜A useful complement to touchscreen typing
or voice input
➜A fun way to enter emojis by drawing
➜Useful for languages that can be
challenging to type on a standard keyboard
➜Works across Android phones and tablets
running Android 4.0.3 and up

23. Pros
➜Free to use
➜A useful complement to
touchscreen typing or
voice input
➜A fun way to enter
emojis by drawing
➜Supports 87 languages
Cons
➜There’s a slight delay
while the app
translates scratch
into actual typed text.

25. persona
P h a r m a c e u t i s t
Data Entry
P o l i c e o f f i c e r s
Novelist
journalists

26. Identifying Users and User Behavior
Online survey has been through Google form to identify
users and user behavior
23 people participated in survey and obtained an
appealing response

27. 4%
22%
17%
15%
22%
7%
6%
6%1%
Users
Pharmaceutist Novelist Police officers
Data entry workers Journalists Students
Teachers Bank Employees others

28. 0
2
4
6
8
10
12
14
16
User persona non user persona
user persona buyer persona anti persona

29. ➜Made tasks faster and easier
➜Not available in regional
language
➜Sometimes software is unable
to recognize hard handwritings

30. Most of the available applications are expensive
Free software have poor performance
Most of the available software do not support regional
language

31. Vexo
Handwriting recognisation software
Now let’s see

32. BIG
CONCEPT

33. Vexo is incoparated
with machine learning
and neural network
algorithm

34. The main tasks of the application
is to provide a solution for
handwriting recognition based on
touch input, handwriting
recognition from live camera
frames or a picture file, learning
new characters, and learning
interactively based
on user's feedback

35. To be implemented using perceptron
architecture, learning parameters and
optimization algorithms

36. Torch
Algorithms used is
neural network model
and deep learning are
To be Implemented in
torch (free source)
platform With lua

37. Torch comes with a large ecosystem
of community- driven packages in
machine learning, computer vision,
signal processing, parallel
processing, image, video, audio and
networking among others, and builds
on top of the Lua community.

38. We have been doing our work in GitHub
which helped us to seek help from other
professionals in Neural Network and
Machine Learning

39. GitHub is a development platform
inspired by the way you work.
From open source to business, we
can host and review code, manage
projects, and build software alongside
millions of other developers.
GitHub brings teams together to work
through problems, move ideas forward,
and learn from each other along the
way.

40. Currently Vexois under
progress. Once the prototype is
ready Vexo has to be taught
and tested with handwritten
digits in “THE MNIST DATABASE”

41. ➜ Attending course and assignments on ML by Andrew NG on
coursera.
➜Read and studied first four chapters on Neural Networks and Deep
Learning by Michael Nielsen and attained few basic knowledge
➜Learned and implemented basics of python, git and lua to abasic
level
➜Installed and implemented torch and loaded MNIST data.
➜Understood, tried and practiced MNIST tutorial provided by Andrea
Ferretti on RNDuja Blog.

42. ➜ Train vexo with data found on
http://www.ee.surrey.ac.uk/CVSSP/demos/chars74k
➜Use a better data set on
https://lvdmatten.github.io/software/code/wride
.tar.gz/
➜ Study convolutional neural networks and their
implementation on
http://cs231n.github.io/convolutional-networks/

43. ➜Implement convolutional neural network architecture on
the old data set after filtering garbage data.
➜Use character segmentation code on MATLAB by Diego
Barragan, Technical University of Loja, Ecuador, available at
http://www.mathworks.com/matlabcentral/fileexchange/2
2922-image-segmentation---extractionfacilitating .
➜Used graph plotting tools to show graphs of loss vs time
and accuracy vs time.

44. The resulting system will
be a subset of a complex
OCR or ICR system
We expect a possible
future extensions of this
work

45. Reference
➜1st four chapters on Neural Network
and deep learning
➜www.ee.surrey.ac.uk
➜www.lvdmatten.github.io

46. Thanks!
Any questions?