- The document presents a neural network model for recognizing handwritten digits. It uses a dataset of 20x20 pixel grayscale images of digits 0-9.
- The proposed neural network has an input layer of 400 nodes, a hidden layer of 25 nodes, and an output layer of 10 nodes. It is trained using backpropagation to classify images.
- The model achieves an accuracy of over 96.5% on test data after 200 iterations of training, outperforming a logistic regression model which achieved 91.5% accuracy. Future work could involve classifying more complex natural images.
Image classification is perhaps the most important part of digital image analysis. In this paper, we compare the most widely used model CNN Convolutional Neural Network , and MLP Multilayer Perceptron . We aim to show how both models differ and how both models approach towards the final goal, which is image classification. Souvik Banerjee | Dr. A Rengarajan "Hand-Written Digit Classification" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-5 | Issue-4 , June 2021, URL: https://www.ijtsrd.compapers/ijtsrd42444.pdf Paper URL: https://www.ijtsrd.comcomputer-science/artificial-intelligence/42444/handwritten-digit-classification/souvik-banerjee
This is a presentation on Handwritten Digit Recognition using Convolutional Neural Networks. Convolutional Neural Networks give better results as compared to conventional Artificial Neural Networks.
Handwritten Digit Recognition and performance of various modelsation[autosaved]SubhradeepMaji
This presentation is all about handwritten digit recognition of different people using Convolution Neural Network and compare the performance of different models based on different sequence of layers.
Comparison of Learning Algorithms for Handwritten Digit RecognitionSafaa Alnabulsi
A 20 minutes seminar where I explained the performance of different classifiers in the Handwritten Digit Recognition problem.
The paper: http://yann.lecun.com/exdb/publis/pdf/lecun-95b.pdf
Image classification is perhaps the most important part of digital image analysis. In this paper, we compare the most widely used model CNN Convolutional Neural Network , and MLP Multilayer Perceptron . We aim to show how both models differ and how both models approach towards the final goal, which is image classification. Souvik Banerjee | Dr. A Rengarajan "Hand-Written Digit Classification" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-5 | Issue-4 , June 2021, URL: https://www.ijtsrd.compapers/ijtsrd42444.pdf Paper URL: https://www.ijtsrd.comcomputer-science/artificial-intelligence/42444/handwritten-digit-classification/souvik-banerjee
This is a presentation on Handwritten Digit Recognition using Convolutional Neural Networks. Convolutional Neural Networks give better results as compared to conventional Artificial Neural Networks.
Handwritten Digit Recognition and performance of various modelsation[autosaved]SubhradeepMaji
This presentation is all about handwritten digit recognition of different people using Convolution Neural Network and compare the performance of different models based on different sequence of layers.
Comparison of Learning Algorithms for Handwritten Digit RecognitionSafaa Alnabulsi
A 20 minutes seminar where I explained the performance of different classifiers in the Handwritten Digit Recognition problem.
The paper: http://yann.lecun.com/exdb/publis/pdf/lecun-95b.pdf
final Year Projects, Final Year Projects in Chennai, Software Projects, Embedded Projects, Microcontrollers Projects, DSP Projects, VLSI Projects, Matlab Projects, Java Projects, .NET Projects, IEEE Projects, IEEE 2009 Projects, IEEE 2009 Projects, Software, IEEE 2009 Projects, Embedded, Software IEEE 2009 Projects, Embedded IEEE 2009 Projects, Final Year Project Titles, Final Year Project Reports, Final Year Project Review, Robotics Projects, Mechanical Projects, Electrical Projects, Power Electronics Projects, Power System Projects, Model Projects, Java Projects, J2EE Projects, Engineering Projects, Student Projects, Engineering College Projects, MCA Projects, BE Projects, BTech Projects, ME Projects, MTech Projects, Wireless Networks Projects, Network Security Projects, Networking Projects, final year projects, ieee projects, student projects, college projects, ieee projects in chennai, java projects, software ieee projects, embedded ieee projects, "ieee2009projects", "final year projects", "ieee projects", "Engineering Projects", "Final Year Projects in Chennai", "Final year Projects at Chennai", Java Projects, ASP.NET Projects, VB.NET Projects, C# Projects, Visual C++ Projects, Matlab Projects, NS2 Projects, C Projects, Microcontroller Projects, ATMEL Projects, PIC Projects, ARM Projects, DSP Projects, VLSI Projects, FPGA Projects, CPLD Projects, Power Electronics Projects, Electrical Projects, Robotics Projects, Solor Projects, MEMS Projects, J2EE Projects, J2ME Projects, AJAX Projects, Structs Projects, EJB Projects, Real Time Projects, Live Projects, Student Projects, Engineering Projects, MCA Projects, MBA Projects, College Projects, BE Projects, BTech Projects, ME Projects, MTech Projects, M.Sc Projects, Final Year Java Projects, Final Year ASP.NET Projects, Final Year VB.NET Projects, Final Year C# Projects, Final Year Visual C++ Projects, Final Year Matlab Projects, Final Year NS2 Projects, Final Year C Projects, Final Year Microcontroller Projects, Final Year ATMEL Projects, Final Year PIC Projects, Final Year ARM Projects, Final Year DSP Projects, Final Year VLSI Projects, Final Year FPGA Projects, Final Year CPLD Projects, Final Year Power Electronics Projects, Final Year Electrical Projects, Final Year Robotics Projects, Final Year Solor Projects, Final Year MEMS Projects, Final Year J2EE Projects, Final Year J2ME Projects, Final Year AJAX Projects, Final Year Structs Projects, Final Year EJB Projects, Final Year Real Time Projects, Final Year Live Projects, Final Year Student Projects, Final Year Engineering Projects, Final Year MCA Projects, Final Year MBA Projects, Final Year College Projects, Final Year BE Projects, Final Year BTech Projects, Final Year ME Projects, Final Year MTech Projects, Final Year M.Sc Projects, IEEE Java Projects, ASP.NET Projects, VB.NET Projects, C# Projects, Visual C++ Projects, Matlab Projects, NS2 Projects, C Projects, Microcontroller Projects, ATMEL Projects, PIC Projects, ARM Projects, DSP Projects, VLSI Projects, FPGA Projects, CPLD Projects, Power Electronics Projects, Electrical Projects, Robotics Projects, Solor Projects, MEMS Projects, J2EE Projects, J2ME Projects, AJAX Projects, Structs Projects, EJB Projects, Real Time Projects, Live Projects, Student Projects, Engineering Projects, MCA Projects, MBA Projects, College Projects, BE Projects, BTech Projects, ME Projects, MTech Projects, M.Sc Projects, IEEE 2009 Java Projects, IEEE 2009 ASP.NET Projects, IEEE 2009 VB.NET Projects, IEEE 2009 C# Projects, IEEE 2009 Visual C++ Projects, IEEE 2009 Matlab Projects, IEEE 2009 NS2 Projects, IEEE 2009 C Projects, IEEE 2009 Microcontroller Projects, IEEE 2009 ATMEL Projects, IEEE 2009 PIC Projects, IEEE 2009 ARM Projects, IEEE 2009 DSP Projects, IEEE 2009 VLSI Projects, IEEE 2009 FPGA Projects, IEEE 2009 CPLD Projects, IEEE 2009 Power Electronics Projects, IEEE 2009 Electrical Projects, IEEE 2009 Robotics Projects, IEEE 2009 Solor Projects, IEEE 2009 MEMS Projects, IEEE 2009 J2EE P
The main objective of this paper is to recognize and predict handwritten digits from 0 to 9 where data set of 5000 examples of MNIST was given as input. As we know as every person has different style of writing digits humans can recognize easily but for computers it is comparatively a difficult task so here we have used neural network approach where in the machine will learn on itself by gaining experiences and the accuracy will increase based upon the experience it gains. The dataset was trained using feed forward neural network algorithm. The overall system accuracy obtained was 95.7% Jyoti Shinde | Chaitali Rajput | Prof. Mrunal Shidore | Prof. Milind Rane"Handwritten Digit Recognition" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-2 | Issue-2 , February 2018, URL: http://www.ijtsrd.com/papers/ijtsrd8384.pdf http://www.ijtsrd.com/engineering/electronics-and-communication-engineering/8384/handwritten-digit-recognition/jyoti-shinde
Neural network based image compression with lifting scheme and rlceSAT Publishing House
IJRET : International Journal of Research in Engineering and Technology is an international peer reviewed, online journal published by eSAT Publishing House for the enhancement of research in various disciplines of Engineering and Technology. The aim and scope of the journal is to provide an academic medium and an important reference for the advancement and dissemination of research results that support high-level learning, teaching and research in the fields of Engineering and Technology. We bring together Scientists, Academician, Field Engineers, Scholars and Students of related fields of Engineering and Technology.
In this presentation we discuss the convolution operation, the architecture of a convolution neural network, different layers such as pooling etc. This presentation draws heavily from A Karpathy's Stanford Course CS 231n
Artificial neural network for machine learninggrinu
An Artificial Neurol Network (ANN) is a computational model. It is based on the structure and functions of biological neural networks. It works like the way human brain processes information. ANN includes a large number of connected processing units that work together to process information. They also generate meaningful results from it.
Deep learning lecture - part 1 (basics, CNN)SungminYou
This presentation is a lecture with the Deep Learning book. (Bengio, Yoshua, Ian Goodfellow, and Aaron Courville. MIT press, 2017) It contains the basics of deep learning and theories about the convolutional neural network.
final Year Projects, Final Year Projects in Chennai, Software Projects, Embedded Projects, Microcontrollers Projects, DSP Projects, VLSI Projects, Matlab Projects, Java Projects, .NET Projects, IEEE Projects, IEEE 2009 Projects, IEEE 2009 Projects, Software, IEEE 2009 Projects, Embedded, Software IEEE 2009 Projects, Embedded IEEE 2009 Projects, Final Year Project Titles, Final Year Project Reports, Final Year Project Review, Robotics Projects, Mechanical Projects, Electrical Projects, Power Electronics Projects, Power System Projects, Model Projects, Java Projects, J2EE Projects, Engineering Projects, Student Projects, Engineering College Projects, MCA Projects, BE Projects, BTech Projects, ME Projects, MTech Projects, Wireless Networks Projects, Network Security Projects, Networking Projects, final year projects, ieee projects, student projects, college projects, ieee projects in chennai, java projects, software ieee projects, embedded ieee projects, "ieee2009projects", "final year projects", "ieee projects", "Engineering Projects", "Final Year Projects in Chennai", "Final year Projects at Chennai", Java Projects, ASP.NET Projects, VB.NET Projects, C# Projects, Visual C++ Projects, Matlab Projects, NS2 Projects, C Projects, Microcontroller Projects, ATMEL Projects, PIC Projects, ARM Projects, DSP Projects, VLSI Projects, FPGA Projects, CPLD Projects, Power Electronics Projects, Electrical Projects, Robotics Projects, Solor Projects, MEMS Projects, J2EE Projects, J2ME Projects, AJAX Projects, Structs Projects, EJB Projects, Real Time Projects, Live Projects, Student Projects, Engineering Projects, MCA Projects, MBA Projects, College Projects, BE Projects, BTech Projects, ME Projects, MTech Projects, M.Sc Projects, Final Year Java Projects, Final Year ASP.NET Projects, Final Year VB.NET Projects, Final Year C# Projects, Final Year Visual C++ Projects, Final Year Matlab Projects, Final Year NS2 Projects, Final Year C Projects, Final Year Microcontroller Projects, Final Year ATMEL Projects, Final Year PIC Projects, Final Year ARM Projects, Final Year DSP Projects, Final Year VLSI Projects, Final Year FPGA Projects, Final Year CPLD Projects, Final Year Power Electronics Projects, Final Year Electrical Projects, Final Year Robotics Projects, Final Year Solor Projects, Final Year MEMS Projects, Final Year J2EE Projects, Final Year J2ME Projects, Final Year AJAX Projects, Final Year Structs Projects, Final Year EJB Projects, Final Year Real Time Projects, Final Year Live Projects, Final Year Student Projects, Final Year Engineering Projects, Final Year MCA Projects, Final Year MBA Projects, Final Year College Projects, Final Year BE Projects, Final Year BTech Projects, Final Year ME Projects, Final Year MTech Projects, Final Year M.Sc Projects, IEEE Java Projects, ASP.NET Projects, VB.NET Projects, C# Projects, Visual C++ Projects, Matlab Projects, NS2 Projects, C Projects, Microcontroller Projects, ATMEL Projects, PIC Projects, ARM Projects, DSP Projects, VLSI Projects, FPGA Projects, CPLD Projects, Power Electronics Projects, Electrical Projects, Robotics Projects, Solor Projects, MEMS Projects, J2EE Projects, J2ME Projects, AJAX Projects, Structs Projects, EJB Projects, Real Time Projects, Live Projects, Student Projects, Engineering Projects, MCA Projects, MBA Projects, College Projects, BE Projects, BTech Projects, ME Projects, MTech Projects, M.Sc Projects, IEEE 2009 Java Projects, IEEE 2009 ASP.NET Projects, IEEE 2009 VB.NET Projects, IEEE 2009 C# Projects, IEEE 2009 Visual C++ Projects, IEEE 2009 Matlab Projects, IEEE 2009 NS2 Projects, IEEE 2009 C Projects, IEEE 2009 Microcontroller Projects, IEEE 2009 ATMEL Projects, IEEE 2009 PIC Projects, IEEE 2009 ARM Projects, IEEE 2009 DSP Projects, IEEE 2009 VLSI Projects, IEEE 2009 FPGA Projects, IEEE 2009 CPLD Projects, IEEE 2009 Power Electronics Projects, IEEE 2009 Electrical Projects, IEEE 2009 Robotics Projects, IEEE 2009 Solor Projects, IEEE 2009 MEMS Projects, IEEE 2009 J2EE P
The main objective of this paper is to recognize and predict handwritten digits from 0 to 9 where data set of 5000 examples of MNIST was given as input. As we know as every person has different style of writing digits humans can recognize easily but for computers it is comparatively a difficult task so here we have used neural network approach where in the machine will learn on itself by gaining experiences and the accuracy will increase based upon the experience it gains. The dataset was trained using feed forward neural network algorithm. The overall system accuracy obtained was 95.7% Jyoti Shinde | Chaitali Rajput | Prof. Mrunal Shidore | Prof. Milind Rane"Handwritten Digit Recognition" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-2 | Issue-2 , February 2018, URL: http://www.ijtsrd.com/papers/ijtsrd8384.pdf http://www.ijtsrd.com/engineering/electronics-and-communication-engineering/8384/handwritten-digit-recognition/jyoti-shinde
Neural network based image compression with lifting scheme and rlceSAT Publishing House
IJRET : International Journal of Research in Engineering and Technology is an international peer reviewed, online journal published by eSAT Publishing House for the enhancement of research in various disciplines of Engineering and Technology. The aim and scope of the journal is to provide an academic medium and an important reference for the advancement and dissemination of research results that support high-level learning, teaching and research in the fields of Engineering and Technology. We bring together Scientists, Academician, Field Engineers, Scholars and Students of related fields of Engineering and Technology.
In this presentation we discuss the convolution operation, the architecture of a convolution neural network, different layers such as pooling etc. This presentation draws heavily from A Karpathy's Stanford Course CS 231n
Artificial neural network for machine learninggrinu
An Artificial Neurol Network (ANN) is a computational model. It is based on the structure and functions of biological neural networks. It works like the way human brain processes information. ANN includes a large number of connected processing units that work together to process information. They also generate meaningful results from it.
Deep learning lecture - part 1 (basics, CNN)SungminYou
This presentation is a lecture with the Deep Learning book. (Bengio, Yoshua, Ian Goodfellow, and Aaron Courville. MIT press, 2017) It contains the basics of deep learning and theories about the convolutional neural network.
Towards neuralprocessingofgeneralpurposeapproximateprogramsParidha Saxena
Did validation of one of the machine learning algorithms of neural networks,and compared the results for its implementation on hardware (FPGA) using xilinx, with that of a sequential code execution(using FANN).
AILABS - Lecture Series - Is AI the New Electricity? Topic:- Classification a...AILABS Academy
This SlideShare by Prof. Dinabandhu contains
Examples of classification and estimation
ANN- Architecture and back Propagation
Classification and Estimation
Some Industrial Problems
Observation
Discussion and Q&A
Web Spam Classification Using Supervised Artificial Neural Network Algorithmsaciijournal
Due to the rapid growth in technology employed by the spammers, there is a need of classifiers that are
more efficient, generic and highly adaptive. Neural Network based technologies have high ability of
adaption as well as generalization. As per our knowledge, very little work has been done in this field using
neural network. We present this paper to fill this gap. This paper evaluates performance of three supervised
learning algorithms of artificial neural network by creating classifiers for the complex problem of latest
web spam pattern classification. These algorithms are Conjugate Gradient algorithm, Resilient Backpropagation learning, and Levenberg-Marquardt algorithm.
Web spam classification using supervised artificial neural network algorithmsaciijournal
Due to the rapid growth in technology employed by the spammers, there is a need of classifiers that are more efficient, generic and highly adaptive. Neural Network based technologies have high ability of adaption as well as generalization. As per our knowledge, very little work has been done in this field using neural network. We present this paper to fill this gap. This paper evaluates performance of three supervised learning algorithms of artificial neural network by creating classifiers for the complex problem of latest web spam pattern classification. These algorithms are Conjugate Gradient algorithm, Resilient Backpropagation learning, and Levenberg-Marquardt algorithm.
An Artificial Neural Network (ANN) is a computational model inspired by the structure and functioning of the human brain's neural networks. It consists of interconnected nodes, often referred to as neurons or units, organized in layers. These layers typically include an input layer, one or more hidden layers, and an output layer.
Simulation of Single and Multilayer of Artificial Neural Network using Verilogijsrd.com
Artificial neural network play an important role in VLSI circuit to find and diagnosis multiple fault in digital circuit. In this paper, the example of single layer and multi-layer neural network had been discussed secondly implement those structure by using verilog code and same idea must be implement in mat lab for getting number of iteration and verilog code gives us time taken to adjust the weight when error become almost equal to zero. The purposed aim at reducing resource requirement, without much compromises on the speed that neural network can be realized on single chip at lower cost.
X-TREPAN: A MULTI CLASS REGRESSION AND ADAPTED EXTRACTION OF COMPREHENSIBLE D...cscpconf
In this work, the TREPAN algorithm is enhanced and extended for extracting decision trees from neural networks. We empirically evaluated the performance of the algorithm on a set of databases from real world events. This benchmark enhancement was achieved by adapting Single-test TREPAN and C4.5 decision tree induction algorithms to analyze the datasets. The models are then compared with X-TREPAN for comprehensibility and classification accuracy. Furthermore, we validate the experimentations by applying statistical methods. Finally, the modified algorithm is extended to work with multi-class regression problems and the ability to comprehend generalized feed forward networks is achieved.
X-TREPAN : A Multi Class Regression and Adapted Extraction of Comprehensible ...csandit
In this work, the TREPAN algorithm is enhanced and extended for extracting decision trees
from neural networks. We empirically evaluated the performance of the algorithm on a set of
databases from real world events. This benchmark enhancement was achieved by adapting
Single-test TREPAN and C4.5 decision tree induction algorithms to analyze the datasets. The
models are then compared with X-TREPAN for comprehensibility and classification accuracy.
Furthermore, we validate the experimentations by applying statistical methods. Finally, the
modified algorithm is extended to work with multi-class regression problems and the ability to
comprehend generalized feed forward networks is achieved.
Hybrid PSO-SA algorithm for training a Neural Network for ClassificationIJCSEA Journal
In this work, we propose a Hybrid particle swarm optimization-Simulated annealing algorithm and present a comparison with i) Simulated annealing algorithm and ii) Back propagation algorithm for training neural networks. These neural networks were then tested on a classification task. In particle swarm optimization behaviour of a particle is influenced by the experiential knowledge of the particle as well as socially exchanged information. Particle swarm optimization follows a parallel search strategy. In simulated annealing uphill moves are made in the search space in a stochastic fashion in addition to the downhill moves. Simulated annealing therefore has better scope of escaping local minima and reach a global minimum in the search space. Thus simulated annealing gives a selective randomness to the search. Back propagation algorithm uses gradient descent approach search for minimizing the error. Our goal of global minima in the task being done here is to come to lowest energy state, where energy state is being modelled as the sum of the squares of the error between the target and observed output values for all the training samples. We compared the performance of the neural networks of identical architectures trained by the i) Hybrid particle swarm optimization-simulated annealing, ii) Simulated annealing and iii) Back propagation algorithms respectively on a classification task and noted the results obtained. Neural network trained by Hybrid particle swarm optimization-simulated annealing has given better results compared to the neural networks trained by the Simulated annealing and Back propagation algorithms in the tests conducted by us.
StarCompliance is a leading firm specializing in the recovery of stolen cryptocurrency. Our comprehensive services are designed to assist individuals and organizations in navigating the complex process of fraud reporting, investigation, and fund recovery. We combine cutting-edge technology with expert legal support to provide a robust solution for victims of crypto theft.
Our Services Include:
Reporting to Tracking Authorities:
We immediately notify all relevant centralized exchanges (CEX), decentralized exchanges (DEX), and wallet providers about the stolen cryptocurrency. This ensures that the stolen assets are flagged as scam transactions, making it impossible for the thief to use them.
Assistance with Filing Police Reports:
We guide you through the process of filing a valid police report. Our support team provides detailed instructions on which police department to contact and helps you complete the necessary paperwork within the critical 72-hour window.
Launching the Refund Process:
Our team of experienced lawyers can initiate lawsuits on your behalf and represent you in various jurisdictions around the world. They work diligently to recover your stolen funds and ensure that justice is served.
At StarCompliance, we understand the urgency and stress involved in dealing with cryptocurrency theft. Our dedicated team works quickly and efficiently to provide you with the support and expertise needed to recover your assets. Trust us to be your partner in navigating the complexities of the crypto world and safeguarding your investments.
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...John Andrews
SlideShare Description for "Chatty Kathy - UNC Bootcamp Final Project Presentation"
Title: Chatty Kathy: Enhancing Physical Activity Among Older Adults
Description:
Discover how Chatty Kathy, an innovative project developed at the UNC Bootcamp, aims to tackle the challenge of low physical activity among older adults. Our AI-driven solution uses peer interaction to boost and sustain exercise levels, significantly improving health outcomes. This presentation covers our problem statement, the rationale behind Chatty Kathy, synthetic data and persona creation, model performance metrics, a visual demonstration of the project, and potential future developments. Join us for an insightful Q&A session to explore the potential of this groundbreaking project.
Project Team: Jay Requarth, Jana Avery, John Andrews, Dr. Dick Davis II, Nee Buntoum, Nam Yeongjin & Mat Nicholas
Chatty Kathy - UNC Bootcamp Final Project Presentation - Final Version - 5.23...
Neural networks
1. Submitted By :-
Harshit Gupta (8816103024)
Muaaz Ehteshamuddin (8816103045)
Saurabh Tiwari (8816103051)
Mentor :-
Dr. Nishant Srivastava
Department of Computer Science and Engineering,
Jaypee University Anoopshahr.
2. Introduction
• Handwritten digits recognition being a challenging problem
is area of research in recent years.
• There are many concern areas regarding this problem, for
example - automatic processing of bank cheques, number
plates of vehicles, postal addresses, in mobile phones etc.
3. Related Work
• Calin Enachescu et. al proposed a neural computing method for
recognizing handwritten digits. With original NIST dataset, it
provided 96.74% accuracy, and with the images that are without
background it provided 96.56% accuracy.
•Mexican hat wavelet transformation technique was used for
preprocessing data and it gave the 99.17% accuracy on data set
4. •A wide range of researches has been performed on the MNIST
database to explore the potential and drawbacks of the best
recommended approach. The best methodology till date offers a
training accuracy of 99.81%.
5. Data Set
•Each training example is a 20 pixel by 20 pixel grayscale
image of the digit.
•Each pixel is represented by a floating point number indicating
the grayscale intensity at that location.
•The 20 by 20 grid of pixels is unrolled into a 400-dimensional
vector. Each of these training examples becomes a single row in
our data matrix X. This gives us a 5000 by 400 matrix X.
7. Logistic Regression
Form of regression that allows
the prediction of discrete
variables by a mix of
continuous and discrete
predictors. Logistic regression
is often used because the
relationship between the DV
(a discrete variable) and a
predictor is non-linear
Fig 2:-A Logistic Regression model
8. The activation function that is used is known as
the sigmoid function. The plot of the sigmoid function looks like
Fig 3 :-Sigmoid Function
Hypothesis
9. We can see that the value of the sigmoid function always lies
between 0 and 1. The value is exactly 0.5 at X=0. We can use
0.5 as the probability threshold to determine the classes. If
the probability is greater than 0.5, we classify it as Class-1
(Y=1) or else as Class-0 (Y=0). sigmoid function is
represented by,
The hypothesis for logistic regression then becomes,
(1)
(2)
10. If the weighted sum of inputs is greater than zero, the
predicted class is 1 and vice-versa. So the decision boundary
separating both the classes can be found by setting the
weighted sum of inputs to 0.
12. If the actual class is 1 and the model predicts 0, we should
highly penalize it and vice-versa. As you can see from the
below picture, for the plot -log(h(x))as h(x) approaches 1,
the cost is 0 and as h(x) nears 0, the cost is infinity(that is
we penalize the model heavily). Similarly for the plot -
log(1-h(x)) when the actual value is 0 and the model
predicts 0, the cost is 0 and the cost becomes infinity as
h(x) approaches 1.
13. Fig 4 :-Cost Function
We can combine both of the equations using:
(3)
14. The cost for all the training examples denoted by J(θ) can be
computed by taking the average over the cost of all the
training samples
We will use gradient descent to minimize the cost function.
The gradient w.r.t any parameter can be given by
(1)
(3)
(4)
15. Neural Network
A neural network is a series of
algorithm that attempts to
recognize underlying
relationships in a set of data
through a process that mimics
the way the human brain
operates.
Fig 5:-A simple Neural Network model
16. Proposed Methodology
Our neural network architecture consist of 3 layers. One input
layer with 400 units, hidden layer with 25 units and output layer
with 10 units each for one digits from 0 to 9. In this neural
network sigmoid function (eq1) is used. This sigmoid function
gives the value in the range [0,1].
(5)
17. Input Layer
• The 400 pixels extracted from each image is arranged as a
single row in the input vector X.
• The input layer in the neural network architecture consists of
400 neurons, with each neuron representing each pixel value of
vector X for the entire sample.
18. Hidden Layer
• Many structure is decided through assumption and then best
one is picked up by the test of cross validation test graph and
error graph.
• So after going through these process it decided to choose 1
hidden layer with 25 units.
19. Output Layer
• The targets for the entire 5000 sample dataset were arranged
in a vector Y of size (5000×1).
• One unit will give the value 1 and the rest will be 0.
• Therefore 10 units for each digits from 9 to 0.
21. • We can initialize all our weights as 0 but it will help in
logistic regression not here.
• When we back propagate all our nodes will update to all
same value repeatedly.
• Instead of this we can randomly initialize our weights .
Initializing Weights
22. Forward Pass
The 400 pixels was provided to the input layer which is further
multiplied with the weights connecting input and hidden layer
which is represented by
(6)
This net input is provided to the sigmoid function eq(1) and the
output is the value of the hidden layer
(7)
23. The values of hidden layer is further multiplied with the weights
connecting hidden and output layer which is represented by
(8)
This net input is provided to the sigmoid function eq(1) and the
output is the value of the output layer
(9)
24. Start
Initialize the weights
to some random
variables
For each
training
pair x , t
Receive Input signal x1 &
transmit to hidden unit
In hidden unit, calculate
o/p,
" 𝑍𝑖𝑛𝑗 = V0j + 𝑖=1
𝑛
=𝑋𝑖 𝑉𝑖𝑗
𝑍𝑖=f(𝑍𝑖𝑛𝑗),
j = 1 to p
i= 1 to n
Send 𝑍𝑖 to the output layer units
Calculate output signal
from
output layer,
𝑌𝑖𝑛𝑘 = W0k+ 𝑦=1
𝑝
𝑍𝑗𝑊𝑗𝑘
𝑌𝑘 = f(𝑌𝑖𝑛𝑘),
k = 1 to m
Target pair 𝑓𝑘
enters
C
B
A
NO
Yes
25. Cost Function
(10)
• This is the cost function we have to minimize.
• The additional term is used for Regularization.
K – No. of layers
m – No of training data
26. Reverse Pass
The gradient value for both output and hidden layers were
calculated for updating the weights
where δk and δj are the gradients of the output layer and hidden
layer respectively.
(11)
(12)
27. (13)
(14)
(15)
(16)
where, Wjk denotes the weight updates of the weights
connecting the hidden and output layer and Wij represents the
weight updates of the weights connecting the input and hidden
layer
• Since Backpropagation has some bugs therefore we can use
gradient checking to monitor it.
28. A
Compute error correction factor
𝑓𝑘= (𝑡 𝑘 − 𝑌𝑘 ) f’(𝑌𝑖𝑛𝑘)
(between output and hidden)
Find weight & bias correction
term
∆𝑊𝑗𝑘 = 𝛼𝛿 𝑘 𝑍𝑗, ∆𝑊0𝑘 = 𝛼𝛿 𝑘
Calculate error term 𝛿𝑖
(between hidden and input)
𝛿𝑖𝑛𝑗 = 𝑘=1
𝑚
𝛿 𝑘 𝑊𝑗𝑘
𝛿𝑗 = 𝛿𝑖𝑛𝑗 f’(𝑍𝑖𝑛𝑗)
Compute change in weights & bias based
On 𝛿𝑗, ∆𝑉𝑖𝑗 = 𝛼𝛿𝑗 𝑋𝑗, ∆𝑉0𝑗 = 𝛼𝛿𝑗
Update weight and bias on
hidden unit
𝑉𝑖𝑗 (new) =𝑉𝑖𝑗(old) +∆𝑉𝑖𝑗
𝑉0𝑗(new) =𝑉0𝑗 (old) + ∆𝑉0𝑗
Update weight and bias on
output unit
𝑊𝑗𝑘 (new) = 𝑊𝑗𝑘 (old) + ∆𝑊𝑗𝑘
𝑊0𝑘 (new)= 𝑊0𝑘 (old)+ ∆𝑊0𝑘
If specified
number of
epochs
reached or
𝑡 𝑘 = 𝑦 𝑘
C
B
Stop
NO
YES
30. Result
• The performance of the above neural network architecture was
tested on 1000 data set of 20*20 gray scale images.
• It was tested in Python 3.7 under windows 8 environment on
Intel i3 processor with 4GB RAM. The accuracy is the criteria
for assessment of the performance. The accuracy rate is given
by:-
31. • Training and testing was continued at the interval of 50 iteration
until we got the consistent accuracy for Neural Networks.
92
93
94
95
96
97
98
99
100
50 100 150 200 250
Fig 7:-No of iteration vs. accuracy
• The Accuracy is above 96.5% and highest is 99.32% on the test
data in 200 iterations for Neural Networks.
38. Future Work
•In future working will be done on natural images likes
number plates, debit cards etc with different backgrounds.
•These images will need some image preprocessing so that
images are converted into 20 pixel * 20 pixel format.
•Different classification will be use to compare with this
classification
39. Future Work
•In future working will be done on natural images likes
number plates, debit cards etc with different backgrounds.
•These images will need some image preprocessing so that
images are converted into 20 pixel * 20 pixel format.
•Different classification will be use to compare with this
classification
40.
41. Conclusion
•The Neural Network architecture with hidden neurons 25 and
maximum number of iterations 200 were found to provide more
accuracy than Logistic Regression.
43. [6] Y.Le Cuu, B.Boser, J.S. Denker, D. Henderson, R.E. Howard, W. Hubbard and
L.D. Jackel,” Handwritten Digit Recognition with a Back-Propagation Network,”
AT&T Bell Laboratories, Holmdel, N.J.07733 1990.
[7] Daniel Cruces Alvarez, Fernando Martin Rodriguez, Xulio Fernandez
Hermida,”Printed and Handwritten Digits Recognition Using Neural Networks”,
E.T.S.I.T. Ciudad Universitaria S/N.36200 Vigo.SPAIN 1998.
[8] Dewi Nasien, Siti S. Yuhaniz, Habibollah Haron,”Recognition of Isolated
Handwritten Latin Characters Using One Continuous Route of Freeman Chain
Code Representation and Feed forward Neural Network Classifier”, World
Academy of Science, Engineering and Technology 67 (2 ),2010
[9] Calin Enachescu, Cristian-Dumitru Miron,”Handwritten Digits Recognition
Using Neural Computing”, Scientific Bulletin of the Petru Maior University of
Tirgu Mures, Vol.6(XXIII), 2009, ISSN 1841-9267.
[10] Xiao-Xiao Niu and Ching Y. Suen, A novel hybrid CNN–SVM classifier for
recognizing handwritten digits, ELSEVIER, The Journal of the Pattern Recognition
Society, Vol. 45, 2012, 1318– 1325.
[11] Diego J. Romero, Leticia M. Seijas, Ana M. Ruedin, Directional Continuous
Wavelet Transform Applied to Handwritten Numerals Recognition Using Neural
Networks, JCS&T, Vol. 7 No. 1, 2007.