Your SlideShare is downloading. ×
0
F UNCT        IONAP ROXIM ION      PSarbjeet Singh     ATNITTTR chandigarh
CONT NT    E
Learning Paradigms•   Training data: A sample from the data source with the correct    classification /regression solution ...
Learning Paradigms Contd..• Unsupervised learning: Learning without training data.•   Examples:         • Data clustering....
Learning Tasks• There are Six learning  – Pattern Association  – Pattern Recognition  – Function Approximation  – Controll...
Function ApproximationConsider a non linear input – output mapping described by the functional relationshipwhere          ...
Function ApproximationTo get the knowledge about the function f(.), some set of examples are taken,            ℑ = {( xi ,...
Function ApproximationWhereΕ is a small positive number.Size N of training sample ℑ is large enough  and network is equipp...
SYST M IDE IF      E     NT ICATION      B OCK DIAGRAM       L                             di                  UNKNOW N   ...
System Identification• Let input-output relation of unknown  memoryless MIMO system i.e. time invariant  system is        ...
System Identificationxi denotes the input vector.d i denotes the desired response.ei denotes the error signal i.e. the dif...
INVERSE MODE ING             L  B OCK DIAGRAM   L                                         Error                           ...
Inverse Modeling• In this we construct an inverse model that  produces the vector x in response to the  vector d.• This ca...
Inverse Modeling• Here d i is used as input and xi as desired  response.• ei is the error signal between xi and yi  produc...
Application of neural network-FUNCTION APPROAXIMATION
Application of neural network-FUNCTION APPROAXIMATION
Application of neural network-FUNCTION APPROAXIMATION
Upcoming SlideShare
Loading in...5
×

Application of neural network-FUNCTION APPROAXIMATION

260

Published on

Application of neural network-FUNCTION APPROAXIMATION

Published in: Education, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
260
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
10
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Transcript of "Application of neural network-FUNCTION APPROAXIMATION"

  1. 1. F UNCT IONAP ROXIM ION PSarbjeet Singh ATNITTTR chandigarh
  2. 2. CONT NT E
  3. 3. Learning Paradigms• Training data: A sample from the data source with the correct classification /regression solution already assigned.• Two Types of Learning- – SUPERVISED – UNSUPERVISED• Supervised learning = Learning based on training data.• Two steps:• 1. Training step: Learn classifier /regressor from training data.• 2. Prediction step: Assign class labels/functional values to test data.• Example:- Perceptron, LDA, SVMs, linear/ridge/kernel ridge regression are all supervised methods.
  4. 4. Learning Paradigms Contd..• Unsupervised learning: Learning without training data.• Examples: • Data clustering. (Some authors do not distinguish between clustering and unsupervised learning.) • Dimension reduction techniques.• Data clustering: Divide input data into groups of similar points.• → Roughly the unsupervised counterpart to classification.• Note the difference: • Supervised case: Fit model to each class of training points, then use models to classify test points. • Clustering: Simultaneous inference of group structure and model.
  5. 5. Learning Tasks• There are Six learning – Pattern Association – Pattern Recognition – Function Approximation – Controlling – Filtering – Beam forming
  6. 6. Function ApproximationConsider a non linear input – output mapping described by the functional relationshipwhere d = f (x)Vector x is input.Vector d is output.The vector valued function f(.) is assumed to be unknown.
  7. 7. Function ApproximationTo get the knowledge about the function f(.), some set of examples are taken, ℑ = {( xi , d i )} N i =1A neural network is designed to approximate the unknown function in Euclidean sense over all inputs, given by the equation F ( x) − f ( x) < ε
  8. 8. Function ApproximationWhereΕ is a small positive number.Size N of training sample ℑ is large enough and network is equipped with an adequate number of free parameters,Thus approximation error ε can be reduced.The approximation problem discussed here would be example of supervised learning.
  9. 9. SYST M IDE IF E NT ICATION B OCK DIAGRAM L di UNKNOW N SYST M EInput +Vector ei xi Σ − NEURAL NE W T ORK M ODEL yi
  10. 10. System Identification• Let input-output relation of unknown memoryless MIMO system i.e. time invariant system is d = f (x)• Set of examples are used to train a neural network as a model of the system. ℑ={( xi , d i )}i = N 1Where yiVector denote the actual output of the neural network.
  11. 11. System Identificationxi denotes the input vector.d i denotes the desired response.ei denotes the error signal i.e. the differencebetween d i and yi .This error is used to adjust the free parameters of thenetwork to minimize the squared difference betweenthe outputsof the unknown system and neuralnetwork in a statistical sense and computed overentire training samples.
  12. 12. INVERSE MODE ING L B OCK DIAGRAM L Error ei System Output ModelInput di Output xiVector UNK NOW INVERSE xi N SYST M f(.) E MODEL y Σ i
  13. 13. Inverse Modeling• In this we construct an inverse model that produces the vector x in response to the vector d.• This can be given by the eqution :Where x=f −1 (d ) f −1 ( • ) denote inverse of f ( • ) .Again with the use of stated−1examples neuralnetwork approximation of f ( • ) is constructed.
  14. 14. Inverse Modeling• Here d i is used as input and xi as desired response.• ei is the error signal between xi and yi produced in response to d i .• This error is used to adjust the free parameters of the network to minimize the squared difference between the outputs of the unknown system and neural network in a statistical sense and computed over entire training samples.
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×