Digital image classification

3,187 views

Published on

Digital image classification
By Aleemuddin
Univ- Jamia MIllia Islamia
Place- New Delhi- INDIA

Published in: Technology, Art & Photos
0 Comments
5 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
3,187
On SlideShare
0
From Embeds
0
Number of Embeds
9
Actions
Shares
0
Downloads
368
Comments
0
Likes
5
Embeds 0
No embeds

No notes for slide

Digital image classification

  1. 1. DIGITAL IMAGE CLASSIFICATION Photogrammetry & RS divisionDigital Classification iirs
  2. 2. Main lecture topics• What is it and why use it?• Image space versus feature space• Distances in feature space• Decision boundaries in feature space• Unsupervised versus supervised training• Classification algorithms• Validation (how good is the result?)• Problems Photogrammetry & RS division Digital Classification iirs
  3. 3. What is Digital Image Classification· Multispectral classification is the process of sorting pixels intoa finite number of individual classes, or categories of data,based on their data file values. If a pixel satisfies a certain set ofcriteria , the pixel is assigned to the class that corresponds tothat criteria. Multispectral classification may be performed using a varietyof algorithms•Hard classification using supervised or unsupervisedapproaches.• Classification using fuzzy logic, and/or• Hybrid approaches often involving use of ancillaryinformation. Photogrammetry & RS division Digital Classification iirs
  4. 4. What is Digital Image Classification• grouping of similar features• separation of dissimilar ones• assigning class label to pixels• resulting in manageable size of classes Photogrammetry & RS division Digital Classification iirs
  5. 5. CLASSIFICATION METHODSMANUAL• visual interpretation• combination of spectral and spatial informationCOMPUTER ASSISTED• mainly spectral informationSTRATIFIED• using GIS functionality to incorporate• knowledge from other sources of information Photogrammetry & RS division Digital Classification iirs
  6. 6. Why use it?• To translate continuous variability of image data into map patterns that provide meaning to the user.• To obtain insight in the data with respect to ground cover and surface characteristics.• To find anomalous patterns in the image data set. Photogrammetry & RS division Digital Classification iirs
  7. 7. Why use it? (advantages)• Cost efficient in the analyses of large data sets• Results can be reproduced• More objective then visual interpretation• Effective analysis of complex multi-band (spectral) interrelationships Photogrammetry & RS division Digital Classification iirs
  8. 8. Dimensionality of Data• Spectral Dimensionality is determined by the number of sets of values being used in a process.• In image processing, each band of data is a set of values. An image with four bands of data is said to be four-dimensional (Jensen, 1996). Photogrammetry & RS division Digital Classification iirs
  9. 9. Measurement Vector• The measurement vector of a pixel is the set of data file values for one pixel in all n bands.• Although image data files are stored band- by-band, it is often necessary to extract the measurement vectors for individual pixels. Photogrammetry & RS division Digital Classification iirs
  10. 10. Photogrammetry & RS divisionDigital Classification iirs
  11. 11. Mean Vector•When the measurement vectors of several pixels are analyzed,a mean vector is often calculated.•This is the vector of the means of the data file values in eachband. It has n elements. Mean Vector µI = Photogrammetry & RS division Digital Classification iirs
  12. 12. Image space Single-band Image Multi-band Image• Image space (col,row)• array of elements corresponding to reflected or emitted energy from IFOV• spatial arrangement of the measurements of the reflected or emitted energy Photogrammetry & RS division Digital Classification iirs
  13. 13. Feature Space:• A feature space image is simply a graph of the data file values of one band of data against the values of another band. ANALYZING PATTERNS IN MULTISPECTRAL DATA PIXEL A: 34,25,117 PIXEL B: 34,24,119 PIXEL C: 11,77,51 Photogrammetry & RS division Digital Classification iirs
  14. 14. One-dimensional feature space Input layer No distinction between classes Distinction between classes Photogrammetry & RS division Digital Classification iirs
  15. 15. Feature Space Multi-dimensional Feature vectors Photogrammetry & RS divisionDigital Classification iirs
  16. 16. Feature space (scattergram) Low frequency High frequency Two/three dimensional graph or scattered diagram formation of clusters of points representing DN values in two/three spectral bands each cluster of points corresponds to a certain cover type on ground Photogrammetry & RS divisionDigital Classification iirs
  17. 17. Distances and clusters in feature space band y (units of 5 DN) . .. . Max y . ... . (0,0) band x (units of 5 DN) Min y .. Euclidian distance (0,0) Min x Max x Cluster Photogrammetry & RS divisionDigital Classification iirs
  18. 18. Spectral DistanceEuclidean Spectral distance is distance in n- dimensionalspectral space. It is a number that allows two measurementvectors to be compared for similarity. The spectral distancebetween two pixels can be calculated as follows:Where:D = spectral distancen = number of bands (dimensions)i = a particular banddi = data file value of pixel d in band iei = data file value of pixel e in band iThis is the equation for Euclidean distance—in two dimensions (when n = 2), itcan be simplified to the Pythagorean Theorem (c2 = a2 + b2), or in this case:D2 = (di - ei)2 + (dj - ej)2 Photogrammetry & RS division Digital Classification iirs
  19. 19. General steps used to extract information from General steps used to extract information from Remotely sensed data Remotely sensed data State the nature of classification problem State the nature of classification problem •Define region of interest •Define region of interest •Identify classes of interest •Identify classes of interest Acquire appropriate Remotely sensed and ground reference data Acquire appropriate Remotely sensed and ground reference data Image processing of Remotely sensed data to extract thematic Image processing of Remotely sensed data to extract thematic information information •Radiometric correction •Radiometric correction •Geometric correction •Geometric correction •Select appropriate image classification logic and algorithm •Select appropriate image classification logic and algorithm oSupervised oSupervised -Parallelepiped and/or minimum distance -Parallelepiped and/or minimum distance -Maximum likelihood -Maximum likelihood -others -others oUnsupervised oUnsupervised -Chain method -Chain method -Multipass isodata -Multipass isodata -others -others oHybrid oHybrid •Extract data from training sites. •Extract data from training sites. •Select most appropriate bands •Select most appropriate bands •Extract training statistics from final band selection •Extract training statistics from final band selection •Extract thematic information. •Extract thematic information. Error evaluation of classification map Error evaluation of classification map Output Output Photogrammetry & RS divisionDigital Classification iirs
  20. 20. Image classification process 2 4 Definition of the clusters in Selection of the the feature space1 image data 3 5 Validation of the result Photogrammetry & RS division Digital Classification iirs
  21. 21. • It is also important for the analyst to realize that there is a fundamental difference between information classes and spectral classes.• * Information classes are those that human beings define.• * Spectral classes are those that are inherent in the remote sensor data and must be identified and then labeled by the analyst. Photogrammetry & RS division Digital Classification iirs
  22. 22. SUPERVISED CLASSIFICATION :• The identity and location of some of the land cover types such as urban, agriculture, wetland are known a priori through a combination of field work and experience.• The analyst attempts to locate specific sites in the remotely sensed data that represent homogenous examples of these known land cover types known as training sites.• Multivariate statistical parameters are calculated for these training sites.• Every pixel both inside and outside the training sites is evaluated and assigned to the class of which it has the highest likelihood of being a member. Photogrammetry & RS division Digital Classification iirs
  23. 23. Supervised image classificationSteps in supervisedclassification • Identification of sample areas (training areas) • Partitioning of the A class sample feature space • Is a number of training pixels •Forms a cluster in feature spaceA cluster • Is the representative for a class • Includes a minimum number of observations (30*n) • Is distinct Photogrammetry & RS division Digital Classification iirs
  24. 24. UNSUPERVISED CLASSIFICATION :• The identities of land cover types to be specified as classes within a scene are generally not known a priori because ground reference information is lacking or surface features within the scene are not well defined.• The computer is required to group pixels with similar spectral characteristics into unique clusters according to some statistically determined criteria.• Analyst then combine and relabels the spectral clusters into information classes. Photogrammetry & RS division Digital Classification iirs
  25. 25. Unsupervised image classification• Clustering algorithm• User defined cluster parameters• Class mean vectors are arbitrarily set by algorithm (iteration 0)• Class allocation of feature vectors• Compute new class mean vectors• Class allocation (iteration 2)• Re-compute class mean vectors• Iterations continue until convergence threshold has been reached• Final class allocation• Cluster statistics reporting Photogrammetry & RS division Digital Classification iirs
  26. 26. Supervised vs. Unsupervised Training• In supervised training, it is important to have a set of desired classes in mind, and then create the appropriate signatures from the data.• Supervised classification is usually appropriate when you want to identify relatively few classes, when you have selected training sites that can be verified with ground truth data, or when you can identify distinct, homogeneous regions that represent each class.• On the other hand, if you want the classes to be determined by spectral distinctions that are inherent in the data so that you can define the classes later, then the application is better suited to unsupervised training. Unsupervised training enables you to define many classes easily, and identify classes that are not in contiguous, easily recognized regions. Photogrammetry & RS division Digital Classification iirs
  27. 27. UNSUPERVISED APPROACH• based on spectral groupings• considers only spectral distance measures• minimum user interaction• requires interpretation after classification SUPERVISED APPROACH • based on spectral groupings • incorporates prior knowledge • maximum user interaction Photogrammetry & RS division Digital Classification iirs
  28. 28. SUPERVISED CLASSIFICATION• In supervised training, you rely on your own pattern recognition skills and a priori knowledge of the data to help the system determine the statistical criteria (signatures) for data classification.• To select reliable samples, you should know some information—either spatial or spectral—about the pixels that you want to classify. Photogrammetry & RS division Digital Classification iirs
  29. 29. The challenge: The problem is that all pixels, or rather their feature vector, must be compared to predifined clusters, and that rules for that comparison must be set up. The clusters have to be defined with the help of training sets Photogrammetry & RS divisionDigital Classification iirs
  30. 30. Partition of a feature space class a • decide on decision class c boundaries class b • assign a class to each pixel class d Photogrammetry & RS divisionDigital Classification iirs
  31. 31. Training Samples and Feature Space Objects• Training samples (also called samples) are sets of pixels that represent what is recognized as a discernible pattern, or potential class. The system calculates statistics from the sample pixels to create a parametric signature for the class. Photogrammetry & RS division Digital Classification iirs
  32. 32. Selecting Training Samples• Training data for a class should be collected from homogeneous environment.• Each site is usually composed of many pixels-the general rule is that if training data is being collected from n bands then >10n pixels of training data is to be collected for each class. This is sufficient to compute variance-covariance matrices required by some classification algorithms. Photogrammetry & RS division Digital Classification iirs
  33. 33. There are a number of ways to collect training site data- •using a vector layer • defining a polygon in the image • identifying a training sample of contiguous pixels with similar spectral characteristics • identifying a training sample of contiguous pixels within a certain area, with or without similar spectral characteristics • using a class from a thematic raster layer from an image file of the same area (i.e., the result of an unsupervised classification) Once the training sites are collected, The mean ,standard deviation, variance etc. are computed for each class. Photogrammetry & RS divisionDigital Classification iirs
  34. 34. Evaluating Signatures• There are tests to perform that can help determine whether the signature data are a true representation of the pixels to be classified for each class. You can evaluate signatures that were created either from supervised or unsupervised training. Photogrammetry & RS division Digital Classification iirs
  35. 35. Evaluation of Signatures• Ellipse—view ellipse diagrams and scatterplots of data file values for every pair of bands. Photogrammetry & RS division Digital Classification iirs
  36. 36. Evaluation of Signatures…………..Signature separability is a statistical measure of distance between two signatures. Separability can be calculated for any combination of bands that is used in the classification, enabling you to rule out any bands that are not useful in the results of the classification.1. Euclidian Distance: Where: D = spectral distance n = number of bands (dimensions) i = a particular band di = data file value of pixel d in band i ei = data file value of pixel e in band i Photogrammetry & RS division Digital Classification iirs
  37. 37. Signature Seperability………2. Divergence Photogrammetry & RS division Digital Classification iirs
  38. 38. Signature Seperability………3. Transformed DivergenceThe scale of the divergence values can range from 0 to 2,000. As ageneral rule, if the result is greater than 1,900, then the classes can beseparated. Between 1,700 and 1,900, the separation is fairly good. Below1,700, the separation is poor (Jensen, 1996). Photogrammetry & RS division Digital Classification iirs
  39. 39. Signature Seperability………4. Jeffries-Matusita Distance Range of JM is between 0 and 1414. The JM distance has a saturatingbehavior with increasing class separation like transformed divergence.However, it is not as computationally efficient as transformed divergence”(Jensen, 1996). Photogrammetry & RS division Digital Classification iirs
  40. 40. SELECTING APPROPRIATE CLASSIFICATION ALGORITHM• Various supervised classification algorithms may be used to assign an unknown pixel to one of the classes.• The choice of particular classifier depends on nature of input data and output required.• Parametric classification algorithms assume that the observed measurement vectors Xc , obtained for each class in each spectral band during the training phase are Gaussian in nature.• Non Parametric classification algorithms make no such assumptions.• There are many classification algorithms i.e. Parallelepiped, Minimum distance, Maximum Likelihood etc. Photogrammetry & RS division Digital Classification iirs
  41. 41. PARALLELEPIPED CLASSIFICATION ALGORITHM In the parallelepiped decision rule, the data file values of the candidate pixel are compared to upper and lower limits. These limits can be either:1. the minimum and maximum data file values of each band in the signature,2. the mean of each band, plus and minus a number of standard deviations, or3. any limits that you specify, based on your knowledge of the data and signatures. There are high and low limits for every signature in every band. When a pixel’s data file values are between the limits for every band in a signature, then the pixel is assigned to that signature’s class. Photogrammetry & RS division Digital Classification iirs
  42. 42. • Therefore, if the low and high decision boundaries are defined asLck= µck - Sckand Hck= µck + Sck• The parallelepiped algorithm becomesLck ≤ BVijk ≤ Hck Photogrammetry & RS divisionDigital Classification iirs
  43. 43. Means and Standard Deviations Partitioned Feature Space 255 255Band 2 Band 2 0 0 0 Band 1 255 0 Band 1 255 Feature Space Partitioning - Box classifier Photogrammetry & RS division Digital Classification iirs
  44. 44. Class “unknown” Photogrammetry & RS divisionDigital Classification iirs
  45. 45. Points a and b are pixels in the image to be classified. Pixel a has a brightness value of 40 in band 4 and 40 in band 5. Pixel b has a brightness value of 10 in band 4 and 40 in band 5. The boxes represent the parallelepiped decision rule associated with a ±1s classification. The vectors (arrows) represent the distance from a and b to the mean of all classes in a minimum distance to means classification algorithm. Photogrammetry & RS divisionDigital Classification iirs
  46. 46. Photogrammetry & RS divisionDigital Classification iirs
  47. 47. Overlap RegionIn cases where a pixel may fall into the overlap region of two or more parallelepipeds, you must define how the pixel can be classified.• The pixel can be classified by the order of the signatures.• The pixel can be classified by the defined parametric decision rule.• The pixel can be left unclassified. Photogrammetry & RS division Digital Classification iirs
  48. 48. ADVANTAGES: Fast and simple. Gives a broad classification thus narrows down the number ofpossible classes to which each pixel can be assigned before moretime consuming calculations are made. Not dependent on normal distributions.DISADVANTAGES: Since parallelepiped has corners, pixels that are actually quite far,spectrally from the mean of the signature may be classified Parallelepiped Corners Compared to the Signature Ellipse Photogrammetry & RS divisionDigital Classification iirs
  49. 49. MINIMUM DISTANCE TO MEANS CLASSIFICATION ALGORITHM This decision rule is computationally simple and commonly used. Requires mean vectors for each class in each band µck from the training data. Euclidean distance is calculated for all the pixels with all the signature means D = √ (BVijk- µck)2 + (BVijl- µcl)2Whereµck and µcl represent the mean vectors for class c measured in bands k and l Any unknown pixel will definitely be assigned to one of any classes, there will be no unclassified pixel. Photogrammetry & RS division Digital Classification iirs
  50. 50. MINIMUM DISTANCE TO MEANS Histogram of training set 300 200 100 0 0 31 63 95 127 159 191 223 255Decision rule:Priority to the shortest distance to the class mean Photogrammetry & RS division Digital Classification iirs
  51. 51. Feature Space Partitioning - Minimum Distance to Mean Classifier 255 "Unknown" Mean vectors Band 2 255 0 Band 2 0 Band 1 255 255 0 0 Band 1 255 Band 2 0 0 Band 1 255 Threshold Distance Photogrammetry & RS division Digital Classification iirs
  52. 52. ADVANTAGES:• Since every pixel is spectrally closer to either one sample mean or other so there are no unclassified pixels.• Fastest after parallelepiped decision rule.DISADVANTAGES:• Pixels which should be unclassified will become classified.• Does not consider class variability. Photogrammetry & RS divisionDigital Classification iirs
  53. 53. Mahalanobis Decision Rule• Mahalanobis distance is similar to minimum distance, except that the covariance matrix is used in the equation. Variance and covariance are figured in so that clusters that are highly varied lead to similarly varied classes, Photogrammetry & RS division Digital Classification iirs
  54. 54. Advantages• Takes the variability of classes into account, unlike minimum distance or parallelepiped.• May be more useful than minimum distance in cases where statistical criteria (as expressed in the covariance matrix) must be taken into accountDisadvantages• Tends to overclassify signatures with relatively large values in the covariance matrix.• Slower to compute than parallelepiped or minimum distance.• Mahalanobis distance is parametric, meaning that it relies heavily on a normal distribution of the data in each input band. Photogrammetry & RS division Digital Classification iirs
  55. 55. Maximum Likelihood/Bayesian Decision Rule• The maximum likelihood decision rule is based on the probability that a pixel belongs to a particular class. The basic equation assumes that these probabilities are equal for all classes, and that the input bands have normal distributions.• If you have a priori knowledge that the probabilities are not equal for all classes, you can specify weight factors for particular classes. This variation of the maximum likelihood decision rule is known as the Bayesian decision rule (Hord, 1982). Photogrammetry & RS division Digital Classification iirs
  56. 56. • The equation for the maximum likelihood/Bayesian classifier is as follows: The pixel is assigned to the class, c, for which D is the lowest. Photogrammetry & RS division Digital Classification iirs
  57. 57. Photogrammetry & RS divisionDigital Classification iirs
  58. 58. Advantages• The most accurate of the classifiers (if the input samples/clusters have a normal distribution), because it takes the most variables into consideration.• Takes the variability of classes into account by using the covariance matrix, as does Mahalanobis distance.Disadvantages• An extensive equation that takes a long time to compute. The computation time increases with the number of input bands.• Maximum likelihood is parametric, meaning that it relies heavily on a normal distribution of the data in each input band.• Tends to overclassify signatures with relatively large values in the covariance matrix. Photogrammetry & RS division Digital Classification iirs
  59. 59. UNSUPERVISED CLASSIFICATION• It requires only a minimum amount of initial input from the analyst.• Numerical operations are performed that search for natural groupings of the spectral properties of pixels.• User allows computer to select the class means and covariance matrices to be used in the classification.• Once the data are classified, the analyst attempts a posteriori to assign these natural or spectral classes to the information classes of interest.• Some clusters may be meaningless because they represent mixed classes.• Clustering algorithm used for the unsupervised classification generally vary according to the efficiency with which the clustering takes place.• Two commonly used methods are- – Chain method – Isodata clustering Photogrammetry & RS division Digital Classification iirs
  60. 60. CHAIN METHOD• Operates in two pass mode( it passes through the registered multispectral dataset two times).• In the first pass the program reads through the dataset and sequentially builds clusters.• A mean vector is associated with each cluster.• In the second pass a minimum distance to means classification algorithm is applied to whole dataset on a pixel by pixel basis whereby each pixel is assigned to one of the mean vectors created in pass 1.• The first pass automatically creates the cluster signatures to be used by supervised classifier. Photogrammetry & RS division Digital Classification iirs
  61. 61. PASS 1: CLUSTER BUILDING• During the first pass the analyst is required to supply four types of information-• R , the radius distance in spectral space used to determine when a new cluster should be formed.• C, a spectral space distance parameter used when merging clusters when N is reached.• N , the number of pixels to be evaluated between each major merging of clusters.• Cmax maximum no. of clusters to be identified.PASS 2: Assignment of pixels to one of the Cmax clusters using minimum distance classification logic Photogrammetry & RS division Digital Classification iirs
  62. 62. Original brightness values of pixels 1, 2, and 3 as measured in Bands 4 and 5 of the hypothetical remote sensed data. Photogrammetry & RS divisionDigital Classification iirs
  63. 63. The distance (D) in 2-dimensional spectral space between pixel 1(cluster 1) and pixel 2 (potential cluster 2) in the first iteration iscomputed and tested against the value of R=15, the minimumacceptable radius. In this case, D does not exceed R. Therefore, wemerge clusters 1 and 2 as shown in the next illustration. Photogrammetry & RS divisionDigital Classification iirs
  64. 64. Pixels 1 and 2 now represent cluster #1. Note that the location of cluster 1 hasmigrated from 10,10 to 15,15 after the first iteration. Now, pixel 3 distance(D=15.81) is computed to see if it is greater than the minimum threshold, R=15. Itis, so pixel location 3 becomes cluster #2. This process continues until all 20clusters are identified. Then the 20 clusters are evaluated using a distance measure,C (not shown), to merge the clusters that are closest to one another. Photogrammetry & RS division Digital Classification iirs
  65. 65. How clusters migrate during the several iterations of a clustering algorithm. The final ending point represents the mean vector that would be used in phase 2 of the clustering process when the minimum distance classification is performed. Photogrammetry & RS divisionDigital Classification iirs
  66. 66. • Note: As more points are added to a cluster, the meanshifts less dramatically since the new computed mean isweighted by the number of pixels currently in a cluster.The ending point is the spectral location of the finalmean vector that is used as a signature in the minimumdistance classifier applied in pass 2.• Some clustering algorithms allow the analyst toinitially seed the mean vector for several of theimportant classes. The seed data are usually obtained ina supervised fashion, as discussed previously. Othersallow the analyst to use a priori information to direct theclustering process. Photogrammetry & RS divisionDigital Classification iirs
  67. 67. Pass 2: Assignment of Pixels to One of the Cmax Clusters Using Minimum Distance Classification Logic The final cluster mean data vectors are used in a minimum distance to means classification algorithm to classify all the pixels in the image into one of the Cmax clusters. Photogrammetry & RS divisionDigital Classification iirs
  68. 68. ISODATA ClusteringThe Iterative Self-Organizing Data Analysis Technique (ISODATA)represents a comprehensive set of heuristic (rule of thumb) procedures thathave been incorporated into an iterative classification algorithm.The ISODATA algorithm is a modification of the k-means clusteringalgorithm, which includes a) merging clusters if their separation distance inmultispectral feature space is below a user-specified threshold and b) rulesfor splitting a single cluster into two clusters.ISODATA is iterative because it makes a large number of passesthrough the remote sensing dataset until specified results areobtained, instead of just two passes.ISODATA does not allocate its initial mean vectors based on theanalysis of pixels rather, an initial arbitrary assignment of all Cmaxclusters takes place along an n-dimensional vector that runs betweenvery specific points in feature space. Photogrammetry & RS division Digital Classification iirs
  69. 69. ISODATA algorithm normally requires the analyst to specify- Cmax : maximum no. of clusters to be identified. T:maximum % of pixels whose class values are allowed to be unchanged between iterations. M :maximum no. of times isodata is to classify pixels and recalculate cluster mean vectors. Minimum members in a cluster Maximum standard deviation for a cluster. Split separation value (if the valuse is changed from 0.0, it takes the place of S.D. ) Minimum distance between cluster means. Photogrammetry & RS division Digital Classification iirs
  70. 70. Phase 1: ISODATA Cluster Building using manypasses through the dataset. a) ISODATA initial distribution of five hypothetical mean vectors using ±1s standard deviations in both bands as beginning and ending points. b) In the first iteration, each candidate pixel is compared to each cluster mean and assigned to the cluster whose mean is closest in Euclidean distance. c) During the second iteration, a new mean is calculated for each cluster based on the actual spectral locations of the pixels assigned to each cluster, instead of the initial arbitrary calculation. This involves analysis of several parameters to merge or split clusters. After the new cluster mean vectors are selected, every pixel in the scene is assigned to one of the new clusters. d) This split–merge–assign process continues until there is little change in class assignment between iterations (the T threshold is reached) or the maximum number of iterations is reached (M). Photogrammetry & RS division Digital Classification iirs
  71. 71. a) Distribution of 20 ISODATA mean vectors after just one iteration b) Distribution of 20 ISODATA mean vectors after 20 iterations. The bulk of the important feature space (the gray background) is partitioned rather well after just 20 iterations. Photogrammetry & RS divisionDigital Classification iirs
  72. 72. Sources of Uncertainty in Image Classification1.Non-representative training areas2. High variability in the spectral signatures for a land cover class3. Mixed land cover within the pixel area Photogrammetry & RS divisionDigital Classification iirs
  73. 73. Evaluating Classification• After a classification is performed, these methods are available for testing the accuracy of the classification:• Thresholding—Use a probability image file to screen out misclassified pixels.• Accuracy Assessment —Compare the classification to ground truth or other data. Photogrammetry & RS division Digital Classification iirs
  74. 74. Accuracy AssessmentAccuracy assessment is a general term forcomparing the classification to geographical datathat are assumed to be true, in order to determinethe accuracy of the classification process. Usually,the assumed-true data are derived from groundtruth data. Photogrammetry & RS division Digital Classification iirs
  75. 75. Accuracy Assesement……• Assessing accuracy of a remote sensing output is one of the most important steps in any classification exercise!!• Without an accuracy assessment the output or results is of little value. Photogrammetry & RS division Digital Classification iirs
  76. 76. There are a number of issues relevant to the generationand assessment of errors in a classification.These include:• the nature of the classification;• Sample design and• assessment sample size. Photogrammetry & RS division Digital Classification iirs
  77. 77. Nature of Classification:– 1) Class definition problems occur when trying to extract information from a image, such as tree height, which is unrealistic. If this happens the error rate will increase.– 2) A common problem is classifying remotely sensed data is to use inappropriate class labels, such as cliff, lake or river all of which are landforms and not cover-types. Similarly a common error is that of using class labels which define land-uses. These features are commonly made up of several cover classes.– 3) The final point here, in terms of the potential for generation of error is the mislabeling of classes. The most obvious example of this is to label a training site water when in fact it is something else. This will result in, at best a skewing of your class statistics if your training site samples are sufficiently large, or at worst shifting the training statistics entirely if your sites are relatively small. Photogrammetry & RS division Digital Classification iirs
  78. 78. Sample Design:• In addition to being independent of the original training sample the sample used must be of a design that will insure consistency and objectivity.• A number of sampling techniques can be used. Some of these include random, systematic, and stratified random.• Of the three the systematic sample is the least useful. This approach to sampling may result in a sample distribution which favours a particular class depending on the distribution of the classes within the map.• Only random sample designs can guarantee an unbiased sample.• The truly random strategy however may not yield a sample design that covers the entire map area, and so may be less than ideal.• In many instances the stratified random sampling strategy is the most useful tool to use. In this case the map area is stratified based on either a systematic breakdown followed by a random sample design in each of the systematic subareas, or alternatively through the application of a random sample within each of the map classes. The use of this approach will ensure that one has an adequate cover for the entire map as well as generating a sufficient number of samples for each of the classes on the map Photogrammetry & RS division Digital Classification iirs
  79. 79. Sample Size:• The size of the sample used must be sufficiently large to be statistically representative of the map area. The number of points considered necessary varies, depending on the method used to estimate.• What this means is that when using a systematic or random sample size, the number of points are kept to a manageable number. Because the number of points contained within a stratified area is usually high, that is greater than 10000, the number of samples used to test the accuracy of the classes through a stratified random sample will be high as well, so the cost for using a highly accurate sampling strategy is a large number of samples Photogrammetry & RS division Digital Classification iirs
  80. 80. ERROR MATRIXOnce a classification has been sampled a contingency table (also referred to as an error matrix or confusion matrix) is developed.• This table is used to properly analyze the validity of each class as well as the classification as a whole.• In this way the we can evaluate in more detail the efficacy of the classification. Photogrammetry & RS division Digital Classification iirs
  81. 81. One way to assess accuracy is to go out in the field and observe the actual land class at a sample of locations, and compare to the land classification it was assigned on the thematic map.• There are a number of ways to quantitatively express the amount of agreement between the ground truth classes and the remote sensing classes.• One way is to construct a confusion error matrix, alternatively called a error matrix• This is a row by column table, with as many rows as columns.• Each row of the table is reserved for one of the information, or remote sensing classes used by the classification algorithm.• Each column displays the corresponding ground truth classes in an identical order. Photogrammetry & RS division Digital Classification iirs
  82. 82. OVERALL ACCURACY• The diagonal elements tally the number of pixels classified correctly in each class.• But just because 83% classifications were accurate overall, does not mean that each category was successfully classified at that rate. Photogrammetry & RS division Digital Classification iirs
  83. 83. USERS ACCURACY• A user of the imagery who is particularly interested in class A, say, might wish to know what proportion of pixels assigned to class A were correctly assigned.• In this example 35 of the 39 pixels were correctly assigned to class A, and the user accuracy in this category of 35/39 = 90% Photogrammetry & RS division Digital Classification iirs
  84. 84. In general terms, for a particular category is user accuracy computed as:• which, for an error matrix set up with the row and column assignments as stated, is computed as the user accuracy• Evidently, a user accuracy can be computed for each row. Photogrammetry & RS division Digital Classification iirs
  85. 85. PRODUCERS ACCURACY• Contrasted to user accuracy is producer accuracy, which has a slightly different interpretation.• Producers accuracy is a measure of how much of the land in each category was classified correctly.• It is found, for each class or category, as The Producer’s accuracy for class A is 35/50 = 70% Photogrammetry & RS division Digital Classification iirs
  86. 86. So from this assessment we have three measures of accuracy which address subtly different issues:– overall accuracy : takes no account of source of error(errors of omission or commission)– user accuracy : measures the proportion of each TM class which is correct.– producer accuracy : measures the proportion of the land base which is correctly classified. Photogrammetry & RS division Digital Classification iirs
  87. 87. KAPPA COEFFICENT• Another measure of map accuracy is the kappa coefficient, which is a measure of the proportional (or percentage) improvement by the classifier over a purely random assignment to classes.For an error matrix with r rows, and hence the same number of columns, let – A = the sum of r diagonal elements, which is the numerator in the computation of overall accuracy – Let B = sum of the r products (row total x column total).• Then• where N is the number of pixels in the error matrix(the sum of all r individual cell values). Photogrammetry & RS division Digital Classification iirs
  88. 88. For the above error matrix, – A = 35 + 37 + 41 = 113 – B = (39 * 50) + (50 * 40) + (47 * 46) = 6112 – N = 136 Thus This can be tested statistically. Photogrammetry & RS divisionDigital Classification iirs
  89. 89. Fuzzy Classification• The Fuzzy Classification method takes into account that there are pixels of mixed make-up, that is, a pixel cannot be definitively assigned to one category.• Fuzzy classification is designed to help you work with data that may not fall into exactly one category or another. Fuzzy classification works using a membership function, wherein a pixel’s value is determined by whether it is closer to one class than another.• Like traditional classification, fuzzy classification still uses training, but the biggest difference is that “it is also possible to obtain information on the various constituent classes found in a mixed pixel. . .” Photogrammetry & RS division Digital Classification iirs
  90. 90. Photogrammetry & RS divisionDigital Classification iirs
  91. 91. Expert Classification• The expert classification provides a rules-based approach to multispectral image classification, post- classification refinement, and GIS modeling. In essence, an expert classification system is a hierarchy of rules, or a decision tree, that describes the conditions under which a set of low level constituent information gets abstracted into a set of high level informational classes. Photogrammetry & RS division Digital Classification iirs
  92. 92. Components of a Typical Rule-based Expert System Photogrammetry & RS divisionDigital Classification iirs

×