DIGITAL IMAGE
PROCESSING
INTRODUCTION
Chapter 1
1
Introduction
“One picture is worth more than ten
thousand words”
Anonymous
2
References
“Digital Image Processing”,
Rafael C. Gonzalez & Richard E. Woods,
Addison-Wesley, 2008
And
“Computer Vision and image processing :
A practical approach using cvip tools
Scott E umbaugh, Prentice hall 1998
http://www.mathworks.com/help/images/index.html
3
Fundamentals of Digital
Image Processing
A Practical Approach
with Examples in Matlab
 Chris Solomon
 2011 by John Wiley & Sons,
Ltd
4
5
Course Outlines
 Ch1 : Introduction
 Ch2 : Digital Image Fundamentals
 Ch3 : Intensity Transformation and Spatial
Filtering
 Ch4 : Filtering in The Frequency Domain
 Ch5 : Image Restoration and Reconstruction
 Ch8 : Image Compression
 Ch9 : Morphological Image Processing
 Ch10: Image Segmentation
6
Contents
This lecture will cover:
 What is a digital image?
 What is digital image processing?
 History of digital image processing
 State of the art examples of digital image processing
 Key stages in digital image processing
7
Computer imaging
 It’s defined as the acquisition and processing
of visual information by computer.
 The ultimate receiver of information is:
 Computer
 Human visual system
 So we have two categories:-
 Computer vision
 Image processing
8
Computer vision and image processing
In computer vision:
The processed output images
are for use by computer.
In Image processing:
The output images are for
human consumption
9
Computer vision
 One of the computer vision fields is image analysis.
 It involves the examination of image data to
facilitate solving a vision problem.
 Image analysis has 2 topics:
 Feature extraction: acquiring higher level image
information
 Pattern classification taking these higher level of
information and identifying objects within the image
10
 Image Processing
image in → image out
 Image Analysis
image in → measurements out
 Image Understanding
image in → high-level description out
11
What is a Digital Image?
A digital image is a representation of a two-
dimensional image as a finite set of digital values,
called picture elements or pixels
12
What is a Digital Image? (cont…)
 It is an approximation of a real scene.
 It is a representation of a two-dimensional image.
 It composed of a finite number of elements called pixels or
picture elements.
 Pixel values represent gray levels (intensity).
Remember digitization implies that a digital image is an approximation
of a real scene
1 pixel
13
What is a Digital Image? (cont…)
Common image formats include:
 1 sample per point (B&W or Grayscale)
 3 samples per point (Red, Green, and Blue)
For most of this course we will focus on grey-scale
images
14
RGB Coloring System
15
What is Digital Image Processing?
Digital image processing focuses on two major tasks
 Improvement of pictorial information for human
interpretation
 Processing of image data for storage, transmission and
representation for autonomous machine perception ‫فهم‬
-
‫إدراك‬
Some argument about where image processing ends
and fields such as image analysis and computer
vision start
16
What is DIP? (cont…)
The continuum ‫استمرارية‬from image processing to
computer vision can be broken up into low-, mid- and
high-level processes
Low Level Process
Input: Image
Output: Image
Examples: Noise
removal, image
sharpening
Mid Level Process
Input: Image
Output: Attributes
Examples: Object
recognition,
segmentation
High Level Process
Input: Attributes
Output: Understanding
Examples: Scene
understanding,
autonomous navigation
In this course we will
stop here
17
History of Digital Image Processing
Early 1920s: One of the first applications of
digital imaging was in the news-
paper industry (5 levels)
 The Bartlane cable picture
transmission service
 Images were transferred by submarine cable
between London and New York
 Pictures were coded for cable transfer and
reconstructed at the receiving end on a telegraph
printer
Early digital image
18
History of DIP (cont…)
Mid to late 1920s: Improvements to the
Bartlane system resulted in higher quality
images
 New reproduction
processes based
on photographic
techniques
 Increased number
of tones in
reproduced images
Improved
digital image Early 15 tone digital
image
19
History of DIP (cont…)
1960s: Improvements in computing technology and
the onset of the space race led to a surge of work in
digital image processing
 1964: Computers used to
improve the quality of
images of the moon taken
by the Ranger 7 probe
 Such techniques were used
in other space missions
including the Apollo landings
A picture of the moon taken
by the Ranger 7 probe
minutes before landing
20
History of DIP (cont…)
1970s: Digital image processing begins to be
used in medical applications
 1979: Sir Godfrey N.
Hounsfield & Prof. Allan M.
Cormack share the Nobel
Prize in medicine for the
invention of tomography‫سطحى‬ ‫رسم‬,
the technology behind
Computerised Axial
Tomography (CAT) scans
 A computerized axial tomography scan is an x-ray procedure that
combines many x-ray images with the aid of a computer to generate cross-
sectional views and, if needed, three-dimensional images of the internal
organs and structures of the body.
Typical head slice CAT
image
21
History of DIP (cont…)
1980s - Today: The use of digital image processing
techniques has exploded and they are now used for
all kinds of tasks in all kinds of areas
 Image enhancement/restoration
 Artistic effects
 Medical visualisation
 Industrial inspection
 Law enforcement
 Human computer interfaces
3
3
Examples: Image Enhancement
One of the most common uses of DIP techniques:
improve quality, remove noise etc
23
Examples: The Hubble Telescope
Launched in 1990 the Hubble
telescope can take images of
very distant objects
However, an incorrect mirror
made many of Hubble’s
images useless
Image processing
techniques were
used to fix this
24
Examples: Artistic Effects
Artistic effects are used
to make images more
visually appealing, to
add special effects and
to make composite
images
25
Examples: Medicine
Take slice from MRI scan of canine heart, and find
boundaries between types of tissue
 Image with gray levels representing tissue density
 Use a suitable filter to highlight edges
Original MRI Image of a Dog Heart Edge Detection Image
26
Examples: GIS
Geographic Information Systems
 Digital image processing techniques are used extensively
to manipulate satellite imagery
 Terrain‫تضاريس‬ classification
 Meteorology ‫الجوية‬ ‫األرصاد‬
27
Examples: GIS (cont…)
Night-Time Lights of the
World data set
 Global inventory of human
settlement
 Not hard to imagine the
kind of analysis that might
be done using this data
28
Examples: Industrial Inspection
Human operators are
expensive, slow and
unreliable
Make machines do the
job instead
Industrial vision systems
are used in all kinds of
industries
Can we trust them?
29
Examples: PCB Inspection
Printed Circuit Board (PCB) inspection
 Machine inspection is used to determine that all components
are present and that all solder joints are acceptable
 Both conventional imaging and x-ray imaging are used
30
Examples: Law Enforcement
Image processing techniques
are used extensively by law
enforcers
 Number plate recognition for
speed cameras/automated toll
systems
 Fingerprint recognition
 Enhancement of CCTV images
31
Examples: HCI
Try to make human computer
interfaces more natural
 Face recognition
 Gesture ‫ايماءة‬recognition
Does anyone remember the
user interface from “Minority
Report”?
These tasks can be extremely
difficult
32
Key Stages in Digital Image Processing
Image
Acquisition
Image
Restoration
Morphological
Processing
Segmentation
Representation
& Description
Image
Enhancement
Object
Recognition
Problem Domain
Colour Image
Processing
Image
Compression
33
Key Stages in Digital Image Processing:
Image Aquisition
Image
Acquisition
Image
Restoration
Morphological
Processing
Segmentation
Representation
& Description
Image
Enhancement
Object
Recognition
Problem Domain
Colour Image
Processing
Image
Compression
34
Image Enhancement:
taking an image and improving it visually
Image
Acquisition
Image
Restoration
Morphological
Processing
Segmentation
Representation
& Description
Image
Enhancement
Object
Recognition
Problem Domain
Colour Image
Processing
Image
Compression
35
Image Restoration :
taking an image with some known or estimated degradation and restoring it to its
original appearing
Image
Acquisition
Image
Restoration
Morphological
Processing
Segmentation
Representation
& Description
Image
Enhancement
Object
Recognition
Problem Domain
Colour Image
Processing
Image
Compression
36
Key Stages in Digital Image Processing:
Morphological Processing
extracting image component that are useful in the representation and description of region shape, such
as boundaries, skeletons, and the convex hull
Image
Acquisition
Image
Restoration
Morphological
Processing
Segmentation
Representation
& Description
Image
Enhancement
Object
Recognition
Problem Domain
Colour Image
Processing
Image
Compression
37
Key Stages in Digital Image Processing:
Segmentation
subdivides an image into its constituent
Image
Acquisition
Image
Restoration
Morphological
Processing
Segmentation
Representation
& Description
Image
Enhancement
Object
Recognition
Problem Domain
Colour Image
Processing
Image
Compression
38
Key Stages in Digital Image Processing:
Object Recognition
Image
Acquisition
Image
Restoration
Morphological
Processing
Segmentation
Representation
& Description
Image
Enhancement
Object
Recognition
Problem Domain
Colour Image
Processing
Image
Compression
39
Key Stages in Digital Image Processing:
Representation & Description
Image
Acquisition
Image
Restoration
Morphological
Processing
Segmentation
Representation
& Description
Image
Enhancement
Object
Recognition
Problem Domain
Colour Image
Processing
Image
Compression
40
 Types of neighborhoods
41
Image compression:
reducing the massive amount of data needed to represent an image
Image
Acquisition
Image
Restoration
Morphological
Processing
Segmentation
Representation
& Description
Image
Enhancement
Object
Recognition
Problem Domain
Colour Image
Processing
Image
Compression
42
Key Stages in Digital Image Processing:
Colour Image Processing
Image
Acquisition
Image
Restoration
Morphological
Processing
Segmentation
Representation
& Description
Image
Enhancement
Object
Recognition
Problem Domain
Colour Image
Processing
Image
Compression
43
Summary
We have looked at:
 What is a digital image?
 What is digital image processing?
 History of digital image processing
 State of the art examples of digital image processing
 Key stages in digital image processing
Next week we start to see how it all works…
44

Lec_1_Introduction.pdf

  • 1.
  • 2.
    Introduction “One picture isworth more than ten thousand words” Anonymous 2
  • 3.
    References “Digital Image Processing”, RafaelC. Gonzalez & Richard E. Woods, Addison-Wesley, 2008 And “Computer Vision and image processing : A practical approach using cvip tools Scott E umbaugh, Prentice hall 1998 http://www.mathworks.com/help/images/index.html 3
  • 4.
    Fundamentals of Digital ImageProcessing A Practical Approach with Examples in Matlab  Chris Solomon  2011 by John Wiley & Sons, Ltd 4
  • 5.
  • 6.
    Course Outlines  Ch1: Introduction  Ch2 : Digital Image Fundamentals  Ch3 : Intensity Transformation and Spatial Filtering  Ch4 : Filtering in The Frequency Domain  Ch5 : Image Restoration and Reconstruction  Ch8 : Image Compression  Ch9 : Morphological Image Processing  Ch10: Image Segmentation 6
  • 7.
    Contents This lecture willcover:  What is a digital image?  What is digital image processing?  History of digital image processing  State of the art examples of digital image processing  Key stages in digital image processing 7
  • 8.
    Computer imaging  It’sdefined as the acquisition and processing of visual information by computer.  The ultimate receiver of information is:  Computer  Human visual system  So we have two categories:-  Computer vision  Image processing 8
  • 9.
    Computer vision andimage processing In computer vision: The processed output images are for use by computer. In Image processing: The output images are for human consumption 9
  • 10.
    Computer vision  Oneof the computer vision fields is image analysis.  It involves the examination of image data to facilitate solving a vision problem.  Image analysis has 2 topics:  Feature extraction: acquiring higher level image information  Pattern classification taking these higher level of information and identifying objects within the image 10
  • 11.
     Image Processing imagein → image out  Image Analysis image in → measurements out  Image Understanding image in → high-level description out 11
  • 12.
    What is aDigital Image? A digital image is a representation of a two- dimensional image as a finite set of digital values, called picture elements or pixels 12
  • 13.
    What is aDigital Image? (cont…)  It is an approximation of a real scene.  It is a representation of a two-dimensional image.  It composed of a finite number of elements called pixels or picture elements.  Pixel values represent gray levels (intensity). Remember digitization implies that a digital image is an approximation of a real scene 1 pixel 13
  • 14.
    What is aDigital Image? (cont…) Common image formats include:  1 sample per point (B&W or Grayscale)  3 samples per point (Red, Green, and Blue) For most of this course we will focus on grey-scale images 14
  • 15.
  • 16.
    What is DigitalImage Processing? Digital image processing focuses on two major tasks  Improvement of pictorial information for human interpretation  Processing of image data for storage, transmission and representation for autonomous machine perception ‫فهم‬ - ‫إدراك‬ Some argument about where image processing ends and fields such as image analysis and computer vision start 16
  • 17.
    What is DIP?(cont…) The continuum ‫استمرارية‬from image processing to computer vision can be broken up into low-, mid- and high-level processes Low Level Process Input: Image Output: Image Examples: Noise removal, image sharpening Mid Level Process Input: Image Output: Attributes Examples: Object recognition, segmentation High Level Process Input: Attributes Output: Understanding Examples: Scene understanding, autonomous navigation In this course we will stop here 17
  • 18.
    History of DigitalImage Processing Early 1920s: One of the first applications of digital imaging was in the news- paper industry (5 levels)  The Bartlane cable picture transmission service  Images were transferred by submarine cable between London and New York  Pictures were coded for cable transfer and reconstructed at the receiving end on a telegraph printer Early digital image 18
  • 19.
    History of DIP(cont…) Mid to late 1920s: Improvements to the Bartlane system resulted in higher quality images  New reproduction processes based on photographic techniques  Increased number of tones in reproduced images Improved digital image Early 15 tone digital image 19
  • 20.
    History of DIP(cont…) 1960s: Improvements in computing technology and the onset of the space race led to a surge of work in digital image processing  1964: Computers used to improve the quality of images of the moon taken by the Ranger 7 probe  Such techniques were used in other space missions including the Apollo landings A picture of the moon taken by the Ranger 7 probe minutes before landing 20
  • 21.
    History of DIP(cont…) 1970s: Digital image processing begins to be used in medical applications  1979: Sir Godfrey N. Hounsfield & Prof. Allan M. Cormack share the Nobel Prize in medicine for the invention of tomography‫سطحى‬ ‫رسم‬, the technology behind Computerised Axial Tomography (CAT) scans  A computerized axial tomography scan is an x-ray procedure that combines many x-ray images with the aid of a computer to generate cross- sectional views and, if needed, three-dimensional images of the internal organs and structures of the body. Typical head slice CAT image 21
  • 22.
    History of DIP(cont…) 1980s - Today: The use of digital image processing techniques has exploded and they are now used for all kinds of tasks in all kinds of areas  Image enhancement/restoration  Artistic effects  Medical visualisation  Industrial inspection  Law enforcement  Human computer interfaces 3 3
  • 23.
    Examples: Image Enhancement Oneof the most common uses of DIP techniques: improve quality, remove noise etc 23
  • 24.
    Examples: The HubbleTelescope Launched in 1990 the Hubble telescope can take images of very distant objects However, an incorrect mirror made many of Hubble’s images useless Image processing techniques were used to fix this 24
  • 25.
    Examples: Artistic Effects Artisticeffects are used to make images more visually appealing, to add special effects and to make composite images 25
  • 26.
    Examples: Medicine Take slicefrom MRI scan of canine heart, and find boundaries between types of tissue  Image with gray levels representing tissue density  Use a suitable filter to highlight edges Original MRI Image of a Dog Heart Edge Detection Image 26
  • 27.
    Examples: GIS Geographic InformationSystems  Digital image processing techniques are used extensively to manipulate satellite imagery  Terrain‫تضاريس‬ classification  Meteorology ‫الجوية‬ ‫األرصاد‬ 27
  • 28.
    Examples: GIS (cont…) Night-TimeLights of the World data set  Global inventory of human settlement  Not hard to imagine the kind of analysis that might be done using this data 28
  • 29.
    Examples: Industrial Inspection Humanoperators are expensive, slow and unreliable Make machines do the job instead Industrial vision systems are used in all kinds of industries Can we trust them? 29
  • 30.
    Examples: PCB Inspection PrintedCircuit Board (PCB) inspection  Machine inspection is used to determine that all components are present and that all solder joints are acceptable  Both conventional imaging and x-ray imaging are used 30
  • 31.
    Examples: Law Enforcement Imageprocessing techniques are used extensively by law enforcers  Number plate recognition for speed cameras/automated toll systems  Fingerprint recognition  Enhancement of CCTV images 31
  • 32.
    Examples: HCI Try tomake human computer interfaces more natural  Face recognition  Gesture ‫ايماءة‬recognition Does anyone remember the user interface from “Minority Report”? These tasks can be extremely difficult 32
  • 33.
    Key Stages inDigital Image Processing Image Acquisition Image Restoration Morphological Processing Segmentation Representation & Description Image Enhancement Object Recognition Problem Domain Colour Image Processing Image Compression 33
  • 34.
    Key Stages inDigital Image Processing: Image Aquisition Image Acquisition Image Restoration Morphological Processing Segmentation Representation & Description Image Enhancement Object Recognition Problem Domain Colour Image Processing Image Compression 34
  • 35.
    Image Enhancement: taking animage and improving it visually Image Acquisition Image Restoration Morphological Processing Segmentation Representation & Description Image Enhancement Object Recognition Problem Domain Colour Image Processing Image Compression 35
  • 36.
    Image Restoration : takingan image with some known or estimated degradation and restoring it to its original appearing Image Acquisition Image Restoration Morphological Processing Segmentation Representation & Description Image Enhancement Object Recognition Problem Domain Colour Image Processing Image Compression 36
  • 37.
    Key Stages inDigital Image Processing: Morphological Processing extracting image component that are useful in the representation and description of region shape, such as boundaries, skeletons, and the convex hull Image Acquisition Image Restoration Morphological Processing Segmentation Representation & Description Image Enhancement Object Recognition Problem Domain Colour Image Processing Image Compression 37
  • 38.
    Key Stages inDigital Image Processing: Segmentation subdivides an image into its constituent Image Acquisition Image Restoration Morphological Processing Segmentation Representation & Description Image Enhancement Object Recognition Problem Domain Colour Image Processing Image Compression 38
  • 39.
    Key Stages inDigital Image Processing: Object Recognition Image Acquisition Image Restoration Morphological Processing Segmentation Representation & Description Image Enhancement Object Recognition Problem Domain Colour Image Processing Image Compression 39
  • 40.
    Key Stages inDigital Image Processing: Representation & Description Image Acquisition Image Restoration Morphological Processing Segmentation Representation & Description Image Enhancement Object Recognition Problem Domain Colour Image Processing Image Compression 40
  • 41.
     Types ofneighborhoods 41
  • 42.
    Image compression: reducing themassive amount of data needed to represent an image Image Acquisition Image Restoration Morphological Processing Segmentation Representation & Description Image Enhancement Object Recognition Problem Domain Colour Image Processing Image Compression 42
  • 43.
    Key Stages inDigital Image Processing: Colour Image Processing Image Acquisition Image Restoration Morphological Processing Segmentation Representation & Description Image Enhancement Object Recognition Problem Domain Colour Image Processing Image Compression 43
  • 44.
    Summary We have lookedat:  What is a digital image?  What is digital image processing?  History of digital image processing  State of the art examples of digital image processing  Key stages in digital image processing Next week we start to see how it all works… 44