The document discusses computer vision and machine vision. It explains that computer vision extracts scene information from images and video, such as geometry and objects. Machine vision is used in engineered environments with special markers or cameras. Basic useful information that can be obtained from a camera includes the location of markers and object segmentation. Commercial tracking systems use infrared or visible light and cameras to track markers.
The credit default swap is connected to the CDO. The CDO is connected to the bond. Bond is connected to tranche. And it's all a house of cards!
The Big Short helped many understand for the first time what actually happened during The Great Recession and this webinar will help you understand how connected data analysis and graph theory can prevent it from happening again.
The credit default swap is connected to the CDO. The CDO is connected to the bond. Bond is connected to tranche. And it's all a house of cards!
The Big Short helped many understand for the first time what actually happened during The Great Recession and this webinar will help you understand how connected data analysis and graph theory can prevent it from happening again.
Dmitry Berg, Olga Zvereva - Identification Of Autopoietic Communication Patte...AIST
Dmitry Berg, Olga Zvereva (Ural Federal University)
Identification Of Autopoietic Communication Patterns In Social And Economic Networks
AIST Conference 2015 http://aistconf.org
International global companies in food industry McDonalds and Bur.docxnormanibarber20063
International global companies in food industry McDonalds and Burger King and 2 in hospitality Marriott and Hilton – Compare the two in food industry and the two in hospitality.
SHOW:
1. percentage of each of the 2 in sales: Domestic vs global (McDonalds & Burger King and Marriott & Hilton)
2. profit of each of the same 2 companies: domestic vs. global. (McDonalds & Burger King and Marriott & Hilton)
3. 2 challenges/barriers faced by each of these 2 companies globally. (McDonalds & Burger King and Marriott & Hilton)
Must cite sources used, must be scholarly, no history to be used. Just facts of 1, 2, 3
must show domestic sales, global sales, domestic profit, global profit and global challenges for each.
VZVerizon (VZ))QuarterDateRevenueSG&A13/30/903019.0845.726/29/903076.0849.139/28/903099.0891.3412/31/903105.0964.053/29/912996.0787.866/28/913081.0842.179/30/913104.0899.8812/31/913099.0989.393/31/923019.0818.6106/30/923149.0921.3119/30/923167.0876.51212/31/923254.01135.0133/31/933163.0871.7146/30/933220.0831.8159/30/933290.0875.21612/31/933317.01041.0173/31/943373.0927.9186/30/943394.0918.7199/30/943415.0913.42012/30/943609.01573.0213/31/953450.01034.0226/30/953564.01061.0239/29/953261.01035.02412/29/953265.05682.0253/31/963208.0788.0266/30/963224.0981.8279/30/967377.02182.02812/31/967405.02112.0293/31/977416.02470.0306/30/977708.02149.0319/30/977374.02338.03212/31/977696.02090.0333/31/987651.02304.0346/30/987928.02414.0359/30/987910.02792.03612/31/988077.02054.0373/31/997967.02018.0386/30/9914510.0399/30/9914660.04012/31/9915260.0413/31/0014530.0426/30/0016770.0439/30/0016530.04412/31/0016870.0453/31/0116270.0466/30/0116910.0479/30/0117000.04812/31/0117010.0493/31/0216430.04945.0506/30/0216750.05793.0519/30/0217110.05204.05212/31/0216910.05883.0533/31/0316490.04292.0546/30/0316830.05673.0559/30/0317060.04891.05612/31/0317200.010070.0573/31/0417060.05675.0586/30/0417760.05000.0599/30/0418210.05132.06012/31/0412730.03539.0613/31/0518180.05214.0626/30/0518050.05110.0639/30/0518490.05195.06412/31/0515300.04061.0653/31/0621230.05873.0666/30/0621890.06353.0679/30/0622460.06384.06812/31/0622610.06345.0693/31/0722580.06343.0706/30/0723270.06320.0719/30/0723770.06349.07212/31/0723840.06955.0733/31/0823830.06401.0746/30/0824120.06528.0759/30/0824750.06879.07612/31/0824640.07090.0773/31/0926590.07561.0786/30/0926860.07871.0799/30/0927260.08111.08012/31/0927090.07174.0813/31/1026910.07698.0826/30/1026770.09970.0839/30/1026480.08407.08412/31/1026400.05291.0853/31/1126990.07284.0866/30/1127540.07373.0879/30/1127910.07689.08812/31/1128440.013280.0893/31/1228240.07700.0906/30/1228550.07877.0919/30/1229010.08366.09212/31/1230040.016010.0933/31/1329420.08148.0946/30/1329790.08047.0959/30/1330280.08037.09612/31/1331060.02857.0973/31/1430820.08332.0986/30/1431480.07550.0999/30/1431590.08277.010012/31/1433190.016860.01013/31/1531980.07939.01026/30/1532220.07974.01039/30/1533160.08309.010412/31/1534250.05764.01053/31/1632170.07600.01066/30/1630530.09.
Fast and accurate metrics. Is it actually possible?Bogdan Storozhuk
This talk is a story about complete redesign of one data structure from Dropwizard Metrics library to achieve some way of measuring histogram without outliers, approximations and with acceptable performance. We will talk about hard and controversial decisions programmer should make to design fast, concise but in the same time very simple data structures. You will learn about: memory consumption optimizations, minimizing allocations, decreasing GC pressure, achieving thread safety.
Dmitry Berg, Olga Zvereva - Identification Of Autopoietic Communication Patte...AIST
Dmitry Berg, Olga Zvereva (Ural Federal University)
Identification Of Autopoietic Communication Patterns In Social And Economic Networks
AIST Conference 2015 http://aistconf.org
International global companies in food industry McDonalds and Bur.docxnormanibarber20063
International global companies in food industry McDonalds and Burger King and 2 in hospitality Marriott and Hilton – Compare the two in food industry and the two in hospitality.
SHOW:
1. percentage of each of the 2 in sales: Domestic vs global (McDonalds & Burger King and Marriott & Hilton)
2. profit of each of the same 2 companies: domestic vs. global. (McDonalds & Burger King and Marriott & Hilton)
3. 2 challenges/barriers faced by each of these 2 companies globally. (McDonalds & Burger King and Marriott & Hilton)
Must cite sources used, must be scholarly, no history to be used. Just facts of 1, 2, 3
must show domestic sales, global sales, domestic profit, global profit and global challenges for each.
VZVerizon (VZ))QuarterDateRevenueSG&A13/30/903019.0845.726/29/903076.0849.139/28/903099.0891.3412/31/903105.0964.053/29/912996.0787.866/28/913081.0842.179/30/913104.0899.8812/31/913099.0989.393/31/923019.0818.6106/30/923149.0921.3119/30/923167.0876.51212/31/923254.01135.0133/31/933163.0871.7146/30/933220.0831.8159/30/933290.0875.21612/31/933317.01041.0173/31/943373.0927.9186/30/943394.0918.7199/30/943415.0913.42012/30/943609.01573.0213/31/953450.01034.0226/30/953564.01061.0239/29/953261.01035.02412/29/953265.05682.0253/31/963208.0788.0266/30/963224.0981.8279/30/967377.02182.02812/31/967405.02112.0293/31/977416.02470.0306/30/977708.02149.0319/30/977374.02338.03212/31/977696.02090.0333/31/987651.02304.0346/30/987928.02414.0359/30/987910.02792.03612/31/988077.02054.0373/31/997967.02018.0386/30/9914510.0399/30/9914660.04012/31/9915260.0413/31/0014530.0426/30/0016770.0439/30/0016530.04412/31/0016870.0453/31/0116270.0466/30/0116910.0479/30/0117000.04812/31/0117010.0493/31/0216430.04945.0506/30/0216750.05793.0519/30/0217110.05204.05212/31/0216910.05883.0533/31/0316490.04292.0546/30/0316830.05673.0559/30/0317060.04891.05612/31/0317200.010070.0573/31/0417060.05675.0586/30/0417760.05000.0599/30/0418210.05132.06012/31/0412730.03539.0613/31/0518180.05214.0626/30/0518050.05110.0639/30/0518490.05195.06412/31/0515300.04061.0653/31/0621230.05873.0666/30/0621890.06353.0679/30/0622460.06384.06812/31/0622610.06345.0693/31/0722580.06343.0706/30/0723270.06320.0719/30/0723770.06349.07212/31/0723840.06955.0733/31/0823830.06401.0746/30/0824120.06528.0759/30/0824750.06879.07612/31/0824640.07090.0773/31/0926590.07561.0786/30/0926860.07871.0799/30/0927260.08111.08012/31/0927090.07174.0813/31/1026910.07698.0826/30/1026770.09970.0839/30/1026480.08407.08412/31/1026400.05291.0853/31/1126990.07284.0866/30/1127540.07373.0879/30/1127910.07689.08812/31/1128440.013280.0893/31/1228240.07700.0906/30/1228550.07877.0919/30/1229010.08366.09212/31/1230040.016010.0933/31/1329420.08148.0946/30/1329790.08047.0959/30/1330280.08037.09612/31/1331060.02857.0973/31/1430820.08332.0986/30/1431480.07550.0999/30/1431590.08277.010012/31/1433190.016860.01013/31/1531980.07939.01026/30/1532220.07974.01039/30/1533160.08309.010412/31/1534250.05764.01053/31/1632170.07600.01066/30/1630530.09.
Fast and accurate metrics. Is it actually possible?Bogdan Storozhuk
This talk is a story about complete redesign of one data structure from Dropwizard Metrics library to achieve some way of measuring histogram without outliers, approximations and with acceptable performance. We will talk about hard and controversial decisions programmer should make to design fast, concise but in the same time very simple data structures. You will learn about: memory consumption optimizations, minimizing allocations, decreasing GC pressure, achieving thread safety.
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)MdTanvirMahtab2
This presentation is about the working procedure of Shahjalal Fertilizer Company Limited (SFCL). A Govt. owned Company of Bangladesh Chemical Industries Corporation under Ministry of Industries.
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...Amil Baba Dawood bangali
Contact with Dawood Bhai Just call on +92322-6382012 and we'll help you. We'll solve all your problems within 12 to 24 hours and with 101% guarantee and with astrology systematic. If you want to take any personal or professional advice then also you can call us on +92322-6382012 , ONLINE LOVE PROBLEM & Other all types of Daily Life Problem's.Then CALL or WHATSAPP us on +92322-6382012 and Get all these problems solutions here by Amil Baba DAWOOD BANGALI
#vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore#blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #blackmagicforlove #blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #Amilbabainuk #amilbabainspain #amilbabaindubai #Amilbabainnorway #amilbabainkrachi #amilbabainlahore #amilbabaingujranwalan #amilbabainislamabad
Cosmetic shop management system project report.pdfKamal Acharya
Buying new cosmetic products is difficult. It can even be scary for those who have sensitive skin and are prone to skin trouble. The information needed to alleviate this problem is on the back of each product, but it's thought to interpret those ingredient lists unless you have a background in chemistry.
Instead of buying and hoping for the best, we can use data science to help us predict which products may be good fits for us. It includes various function programs to do the above mentioned tasks.
Data file handling has been effectively used in the program.
The automated cosmetic shop management system should deal with the automation of general workflow and administration process of the shop. The main processes of the system focus on customer's request where the system is able to search the most appropriate products and deliver it to the customers. It should help the employees to quickly identify the list of cosmetic product that have reached the minimum quantity and also keep a track of expired date for each cosmetic product. It should help the employees to find the rack number in which the product is placed.It is also Faster and more efficient way.
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Dr.Costas Sachpazis
Terzaghi's soil bearing capacity theory, developed by Karl Terzaghi, is a fundamental principle in geotechnical engineering used to determine the bearing capacity of shallow foundations. This theory provides a method to calculate the ultimate bearing capacity of soil, which is the maximum load per unit area that the soil can support without undergoing shear failure. The Calculation HTML Code included.
Welcome to WIPAC Monthly the magazine brought to you by the LinkedIn Group Water Industry Process Automation & Control.
In this month's edition, along with this month's industry news to celebrate the 13 years since the group was created we have articles including
A case study of the used of Advanced Process Control at the Wastewater Treatment works at Lleida in Spain
A look back on an article on smart wastewater networks in order to see how the industry has measured up in the interim around the adoption of Digital Transformation in the Water Industry.
Harnessing WebAssembly for Real-time Stateless Streaming PipelinesChristina Lin
Traditionally, dealing with real-time data pipelines has involved significant overhead, even for straightforward tasks like data transformation or masking. However, in this talk, we’ll venture into the dynamic realm of WebAssembly (WASM) and discover how it can revolutionize the creation of stateless streaming pipelines within a Kafka (Redpanda) broker. These pipelines are adept at managing low-latency, high-data-volume scenarios.
Using recycled concrete aggregates (RCA) for pavements is crucial to achieving sustainability. Implementing RCA for new pavement can minimize carbon footprint, conserve natural resources, reduce harmful emissions, and lower life cycle costs. Compared to natural aggregate (NA), RCA pavement has fewer comprehensive studies and sustainability assessments.
2. What is Computer Vision?
• Three Related fieldsThree Related fields
– Image Processing: Changes 2D images intoImage Processing: Changes 2D images into
other 2D imagesother 2D images
– Computer Graphics: Takes 3D models,Computer Graphics: Takes 3D models,
renders 2D imagesrenders 2D images
– Computer vision: Extracts scene informationComputer vision: Extracts scene information
from 2D images and videofrom 2D images and video
– e.g. Geometry, “Where” something is in 3D,e.g. Geometry, “Where” something is in 3D,
– Objects “What” something is”Objects “What” something is”
• What information is in a 2D image?What information is in a 2D image?
• What information do we need for 3D analysis?What information do we need for 3D analysis?
• CV hard. Only special cases can beCV hard. Only special cases can be
solved solved.solved solved.
90
horizon
Image Processing
Computer Graphics
Computer Vision
Computer Vision
3. Machine Vision
•3D Camera vision in3D Camera vision in
general environments hardgeneral environments hard
•Machine vision:Machine vision:
– Use engineered environmentUse engineered environment
– Use 2D when possibleUse 2D when possible
– Special markers/LEDSpecial markers/LED
– Can buy working system!Can buy working system!
•Photogrammetry:Photogrammetry:
– OutdoorsOutdoors
– 3D surveying using cameras3D surveying using cameras
4. Vision
• Full: Human visionFull: Human vision
– We don’t know how it works in detailWe don’t know how it works in detail
• Limited vision: Machines, Robots, “AI”Limited vision: Machines, Robots, “AI”
What is the most basic useful information weWhat is the most basic useful information we
can get from a camera?can get from a camera?
1.1. Location of a dot (LED/Marker) [u,v] = f(I)Location of a dot (LED/Marker) [u,v] = f(I)
2.2. Segmentation of object pixelsSegmentation of object pixels
All of these are 2D image plane measurements!All of these are 2D image plane measurements!
What is the best camera location?What is the best camera location?
Usually overhead pointing straight downUsually overhead pointing straight down
Adjust cam position so pixelAdjust cam position so pixel [u,v] = s[u,v] = s[X,Y].[X,Y].
Pixel coordinates are scaled world coordPixel coordinates are scaled world coord
XX
YY
uu
vv
5. Tracking LED special markers
• Put camera overhead pointing straightPut camera overhead pointing straight
down on worktable.down on worktable.
– Adjust cam position so pixelAdjust cam position so pixel [u,v] = s[u,v] = s[X,Y].[X,Y].
Pixel coordinates are scaled world coordPixel coordinates are scaled world coord
– Lower brightness so LED brighterestLower brightness so LED brighterest
• Put LED on robot end-effectorPut LED on robot end-effector
• Detection algorithm:Detection algorithm:
– Threshold brightest pixels I(u,v)>200Threshold brightest pixels I(u,v)>200
– Find centroid [u,v] of max pixelsFind centroid [u,v] of max pixels
• Variations:Variations:
– Blinking LED can enhance detection inBlinking LED can enhance detection in
ambient light.ambient light.
– Different color LED’s can be detectedDifferent color LED’s can be detected
separately from R,G,B color video.separately from R,G,B color video.
LED
Camera
XX
YY
uu
vv
6. Commercial tracking systems
Polaris Vicra infra-red system
(Northern Digitial Inc.)
MicronTracker visible light system
(Claron Technology Inc.)
8. 04/16/18 Introduction to Machine Vision
IMAGE SEGMENTATION
•How many “objects” are there in the image below?
•Assuming the answer is “4”, what exactly defines an
object?
Zoom In
13. 04/16/18 Introduction to Machine Vision
GRAY LEVEL THRESHOLDING
•Many images consist of two regions that
occupy different gray level ranges.
•Such images are characterized by a bimodal
image histogram.
•An image histogram is a function h defined on
the set of gray levels in a given image.
•The value h(k) is given by the number of
pixels in the image having image intensity k.
16. 04/16/18 Introduction to Machine Vision
IMAGE SEGMENTATION – CONNECTED
COMPONENT LABELING
•Segmentation can be viewed as a process of pixel
classification; the image is segmented into objects or
regions by assigning individual pixels to classes.
•Connected Component Labeling assigns pixels to
specific classes by verifying if an adjoining pixel (i.e.,
neighboring pixel) already belongs to that class.
•There are two “standard” definitions of pixel
connectivity: 4 neighbor connectivity and 8 neighbor
connectivity.
22. 04/16/18 Introduction to Machine Vision
IS THERE A MORE COMPUTATIONALLY
EFFICIENT TECHNIQUE FOR SEGMENTING
THE OBJECTS IN THE IMAGE?
•Contour tracking/border following identify the pixels
that fall on the boundaries of the objects, i.e., pixels
that have a neighbor that belongs to the background
class or region.
•There are two “standard” code definitions used to
represent boundaries: code definitions based on 4-
connectivity (crack code) and code definitions based
on 8-connectivity (chain code).
25. 04/16/18 Introduction to Machine Vision
CONTOUR TRACKING ALGORITHM
FOR GENERATING CRACK CODE
•Identify a pixel P that belongs to the class “objects”
and a neighboring pixel (4 neighbor connectivity) Q
that belongs to the class “background”.
•Depending on the relative position of Q relative to P,
identify pixels U and V as follows:
CODE 0CODE 0 CODE 1CODE 1 CODE 2CODE 2 CODE 3CODE 3
VV QQ QQ PP PP UU UU VV
UU PP VV UU QQ VV PP QQ
26. 04/16/18 Introduction to Machine Vision
CONTOUR TRACKING ALGORITHM
•Assume that a pixel has a value of “1” if it belongs to
the class “object” and “0” if it belongs to the class
“background”.
•Pixels U and V are used to determine the next “move”
(i.e., the next element of crack code) as summarized in
the following truth table:
UU VV P’P’ Q’Q’ TURNTURN CODECODE**
XX 11 VV QQ RIGHTRIGHT CODE-1CODE-1
11 00 UU VV NONENONE CODECODE
00 00 PP UU LEFTLEFT CODE+1CODE+1
**
Implement as a modulo 4 counterImplement as a modulo 4 counter
27. 04/16/18 Introduction to Machine Vision
*Implement as a modulo 4 counter
CODE+1LEFTUP00
CODENONEVU01
CODE-1RIGHTQV1X
CODE*TURNQ’P’VU
*Implement as a modulo 4 counter
CODE+1LEFTUP00
CODENONEVU01
CODE-1RIGHTQV1X
CODE*TURNQ’P’VU
V
Q
CODE 1
U
P
V
U
Q
P
CODE 2
U
V
CODE 0
P
Q
P
U
CODE 3
Q
V
V
Q
CODE 1
U
P
V
U
Q
P
CODE 2
U
V
CODE 0
P
Q
P
U
CODE 3
Q
V
CONTOUR TRACKING ALGORITHM
PQ
UV
V
U
1
3
20
1
3
20
Q
V
P
UQ
V
P
UQ
V
P
U
28. 04/16/18 Introduction to Machine Vision
CONTOUR TRACKING ALGORITHM
FOR GENERATING CHAIN CODE
•Identify a pixel P that belongs to the class “objects” and a
neighboring pixel (4 neighbor connectivity) R0 that belongs
to the class “background”. Assume that a pixel has a value
of “1” if it belongs to the class “object” and “0” if it belongs
to the class “background”.
•Assign the 8-connectivity neighbors of P to R0, R1, …, R7
as follows:
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
29. 04/16/18 Introduction to Machine Vision
CONTOUR TRACKING ALGORITHM
FOR GENERATING CHAIN CODE
2
6 57
31
40
2
6 57
31
40
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
R3R2R1
R4PR0
R5R6R7
ALGORITHM:
i=0
WHILE (Ri==0) { i++ }
•Move P to Ri
•Set i=6 for next search
30. 04/16/18 Introduction to Machine Vision
OBJECT RECOGNITION – BLOB ANALYSIS
•Once the image has been segmented into classes
representing the objects in the image, the next step is to
generate a high level description of the various objects.
•A comprehensive set of form parameters describing
each object or region in an image is useful for object
recognition.
•Ideally the form parameters should be independent of
the object’s position and orientation as well as the
distance between the camera and the object (i.e., scale
factor).
31. 04/16/18 Introduction to Machine Vision
What are some examples of form parameters
that would be useful in identifying the objects
in the image below?
32. 04/16/18 Introduction to Machine Vision
OBJECT RECOGNITION – BLOB ANALYSIS
•Examples of form parameters that are invariant with
respect to position, orientation, and scale:
•Number of holes in the object
•Compactness or Complexity: (Perimeter)2
/Area
•Moment invariants
•All of these parameters can be evaluated during
contour following.
33. 04/16/18 Introduction to Machine Vision
GENERALIZED MOMENTS
∫∫=
R
qp
pq dxdyyxfyxm ),(
•Shape features or form parameters provide a high level
description of objects or regions in an image
•Many shape features can be conveniently represented
in terms of moments. The (p,q)th
moment of a region R
defined by the function f(x,y) is given by:
34. 04/16/18 Introduction to Machine Vision
GENERALIZED MOMENTS
∑∑= =
=
n
x
m
y
ji
ij yxfyxM
1 1
),(
•In the case of a digital image of size n by m pixels, this
equation simplifies to:
•For binary images the function f(x,y) takes a value of 1
for pixels belonging to class “object” and “0” for class
“background”.
35. 04/16/18 Introduction to Machine Vision
GENERALIZED MOMENTS
00 11 22 33 44 55 66 77 88 99
11
22
33
44
55
66
X
Y
ii jj MMijij
00 00
11 00
00 11
22 00
00 22
11 11
7 Area
20
33
159 Moment
of Inertia
64
93
∑∑= =
=
n
x
m
y
ji
ij yxfyxM
1 1
),(
36. 04/16/18 Introduction to Machine Vision
SOME USEFUL MOMENTS
00
10
M
M
X =
00
01
M
M
Y =
•The center of mass of a region can be defined in
terms of generalized moments as follows:
37. 04/16/18 Introduction to Machine Vision
SOME USEFUL MOMENTS
•The moments of inertia relative to the center of mass
can be determined by applying the general form of
the parallel axis theorem:
00
2
01
0202
M
M
MM −=
00
2
10
2020
M
M
MM −=
00
0110
1111
M
MM
MM −=
38. 04/16/18 Introduction to Machine Vision
SOME USEFUL MOMENTS
•The principal axis of an object is the axis passing
through the center of mass which yields the minimum
moment of inertia.
•This axis forms an angle θ with respect to the X axis.
•The principal axis is useful in robotics for determining
the orientation of randomly placed objects.
0220
112
2
MM
M
TAN
−
=θ
40. 04/16/18 Introduction to Machine Vision
SOME (MORE) USEFUL MOMENTS
•The minimum/maximum moment of inertia about an
axis passing through the center of mass are given by:
2
4)(
2
2
11
2
20022002 MMMMM
I MIN
+−
−
+
=
2
4)(
2
2
11
2
20022002 MMMMM
I MAX
+−
+
+
=
41. 04/16/18 Introduction to Machine Vision
SOME (MORE) USEFUL MOMENTS
•The following moments are independent of position,
orientation, and reflection. They can be used to
identify the object in the image.
02201 MM +=φ
2
11
2
02202 4)( MMM ++=φ
42. 04/16/18 Introduction to Machine Vision
SOME (MORE) USEFUL MOMENTS
•The following moments are normalized with respect
to area. They are independent of position, orientation,
reflection, and scale.
2
00
1
1
M
φ
ψ = 4
00
2
2
M
φ
ψ =
43. 04/16/18 Introduction to Machine Vision
•Generalized moments are computed by evaluating
a double (i.e., surface) integral over a region of the
image.
•The surface integral can be transformed into a line
integral around the boundary of the region by
applying Green’s Theorem.
•The line integral can be easily evaluated during
contour tracking.
•The process is analogous to using a planimeter to
graphically evaluate the area of a geometric figure.
EVALUATING MOMENTS DURING
CONTOUR TRACKING
44. 04/16/18 Introduction to Machine Vision
3D MACHINE VISION SYSTEM
Digital Camera
Field of View
Granite Surface Plate
Laser Projector
Plane of Laser Light
XY Table
P(x,y,z)
49. Commercial Machine Vision
Definition
““Machine vision is the capturing of an image (a snapshot in time), theMachine vision is the capturing of an image (a snapshot in time), the
conversion of the image to digital information, and the application ofconversion of the image to digital information, and the application of
processing algorithms to extract useful information about the image forprocessing algorithms to extract useful information about the image for
the purposes of pattern recognition, part inspection, or part positioningthe purposes of pattern recognition, part inspection, or part positioning
and orientation”….Ed Redand orientation”….Ed Red
50. Current State
CheapCheap andand EasyEasy to Useto Use
• TheThe Sony approved Scorpion RobotSony approved Scorpion Robot
Inspection Starter KitInspection Starter Kit containscontains
everything you need for bringing youreverything you need for bringing your
Scorpion Robot Inspection project to life.Scorpion Robot Inspection project to life.
• The kit includes a Scorpion EnterpriseThe kit includes a Scorpion Enterprise
software licensesoftware license
• new high quality Sony XCD-710 (CR)new high quality Sony XCD-710 (CR)
camera (XGA resolution)camera (XGA resolution)
• Sony Desktop RobotSony Desktop Robot
• 2 days training course2 days training course
• A standard and configurable user interfaceA standard and configurable user interface
paired with innovative, easy-to-use andpaired with innovative, easy-to-use and
robust imaging toolsrobust imaging tools
• $1995.00$1995.00
51. Costs
Data Source:Data Source: http://www.qualitydigest.com/oct97/html/machvis.htmlhttp://www.qualitydigest.com/oct97/html/machvis.html
$50,000.00
$12,500.00
$2,000.00
$-
$10,000
$20,000
$30,000
$40,000
$50,000
20 years ago 10 years ago Now
Machine Vision Cost
52. Costs
Savings from using machine visionSavings from using machine vision
• Cost of recruiting and trainingCost of recruiting and training
• Scrap/rework created while learning a new jobScrap/rework created while learning a new job
• Average workers' compensation paid for injuriesAverage workers' compensation paid for injuries
• Average educational grant per employeeAverage educational grant per employee
• Personnel/payroll department costs per employeePersonnel/payroll department costs per employee
53. Where, What, Whom
Machine vision now has a wide range of installations in high-Machine vision now has a wide range of installations in high-
production industries including:production industries including:
• SemiconductorSemiconductor
• ElectronicElectronic
• AutomotiveAutomotive
• ContainerContainer
• PharmaceuticalPharmaceutical
• medical devicemedical device
• PlasticPlastic
Machine vision can be found wherever parts are formed andMachine vision can be found wherever parts are formed and
packaged.packaged.
Chemicals
Food
Footwear
Textiles
Printing
Wood/forest products
Fabricated metal
54. Where, What, Whom
• AutomotiveAutomotive
– fuse box inspection,fuse box inspection,
– tire tread recognition,tire tread recognition,
– power train inspection andpower train inspection and
– sheet metal inspection.sheet metal inspection.
• ElectronicsElectronics
– bare-board manufacturerbare-board manufacturer
– (inspect artwork, inner/outer layer circuit(inspect artwork, inner/outer layer circuit
patterns, drill-hole patterns),patterns, drill-hole patterns),
– board assemblerboard assembler
– (inspect solder paste/epoxy for presence and(inspect solder paste/epoxy for presence and
volume, check co-planarity of component leads,volume, check co-planarity of component leads,
verify presence and position of components pre-verify presence and position of components pre-
solder, verify presence and position ofsolder, verify presence and position of
components post-solder, and soldercomponents post-solder, and solder
presence/absence and properties),presence/absence and properties),
– assemblyassembly
– (alignment to assure position of screen-printed(alignment to assure position of screen-printed
patterns, epoxy, component placement, andpatterns, epoxy, component placement, and
board pattern position.)board pattern position.)
55. Where, What, Whom
•FoodFood
– fruit and vegetable sorting and grading,fruit and vegetable sorting and grading,
– automatic portioning,automatic portioning,
– inspection for foreign objects, andinspection for foreign objects, and
– general package-line applicationsgeneral package-line applications
•BeverageBeverage
– quality inspection of containers,quality inspection of containers,
– fill level inspection, andfill level inspection, and
– closure inspection are among the leadingclosure inspection are among the leading
applicationsapplications
56. Where, What, Whom
•AerospaceAerospace
– Design of a new sensor system with improved performance forDesign of a new sensor system with improved performance for
accurately locating and measuring the parameters of holes inaccurately locating and measuring the parameters of holes in
aerospace componentsaerospace components
– The specification for the sensor system included the ability to locateThe specification for the sensor system included the ability to locate
and measure both conventional and countersunk holes, in a range ofand measure both conventional and countersunk holes, in a range of
surfaces including aluminum and the latest graphite-based materialssurfaces including aluminum and the latest graphite-based materials
•Work Zone Monitoring uses:Work Zone Monitoring uses:
– 1300 x 1030 All Digital Camera1300 x 1030 All Digital Camera
– Image Capture and License Plate ReaderImage Capture and License Plate Reader
– Fiber Optic TransmissionFiber Optic Transmission
– Software Plate ReaderSoftware Plate Reader
– PCIbus Wintel ArchitecturePCIbus Wintel Architecture
58. Supporting Technology
Camera ChoiceCamera Choice
• The first consideration when picking vision software is to determine if it works withThe first consideration when picking vision software is to determine if it works with
the camera that is best suited for your application.the camera that is best suited for your application.
Hardware ScalabilityHardware Scalability
• Because camera technologies are advancing rapidly, someday you may want toBecause camera technologies are advancing rapidly, someday you may want to
upgrade your cameras to improve image quality or measure additional features.upgrade your cameras to improve image quality or measure additional features.
SOFTWARE: 7 Things to Consider When Choosing Vision
Software
59. Supporting Technology
Software Ease of UseSoftware Ease of Use
• Once you acquire an image, the next step is to process it.Once you acquire an image, the next step is to process it.
SOFTWARE: 7 Things to Consider When Choosing Vision
Software
Algorithm Breadth and AccuracyAlgorithm Breadth and Accuracy
• whether the software tools can correctly and accurately measurewhether the software tools can correctly and accurately measure
important part or object features down to the subpixel. If the softwareimportant part or object features down to the subpixel. If the software
is not accurate and reliable, then it does not matter how fast youris not accurate and reliable, then it does not matter how fast your
computer is or how many pixels your camera has.computer is or how many pixels your camera has.
60. Supporting Technology
Algorithm PerformanceAlgorithm Performance
• No matter how many hundreds of algorithms you have to choose from or how quickly you canNo matter how many hundreds of algorithms you have to choose from or how quickly you can
build an application with them, if the inspection tools are inefficient and take too long to run,build an application with them, if the inspection tools are inefficient and take too long to run,
then much of your work goes to waste.then much of your work goes to waste.
Integration with Other DevicesIntegration with Other Devices
• In industrial automation, your vision application may need to control actuators to sort products;In industrial automation, your vision application may need to control actuators to sort products;
communicate inspection results to a robot controller, PLC, or programmable automationcommunicate inspection results to a robot controller, PLC, or programmable automation
controller; save images and data to network servers; or communicate inspection parameters andcontroller; save images and data to network servers; or communicate inspection parameters and
results to a local or remote user interface.results to a local or remote user interface.
PricePrice
• Vision software packages come in many variations. Many cater to OEM customers by splittingVision software packages come in many variations. Many cater to OEM customers by splitting
up their development libraries and selling algorithms a la carte. While each individual algorithmup their development libraries and selling algorithms a la carte. While each individual algorithm
bundle seems lower in cost, the total vision development package cost is often quite high. Addbundle seems lower in cost, the total vision development package cost is often quite high. Add
to that the cost of a license for each component, and application deployment becomesto that the cost of a license for each component, and application deployment becomes
complicated as well as costly.complicated as well as costly.
SOFTWARE: 7 Things to Consider When Choosing Vision
Software
61. Standardization
• GigE Vision is the newest effort at communications interoperability. Work isGigE Vision is the newest effort at communications interoperability. Work is
on-going to develop and release a standard for the connection of visionon-going to develop and release a standard for the connection of vision
components using a standard Gigabitcomponents using a standard Gigabit Ethernet cable and connectorEthernet cable and connector..
63. Single Camera 3DTM (SC3DTM)
A novel technology for guidance of industrial robots in three-
dimensional space
• Provides accurate 3D poseProvides accurate 3D pose
(6 d.o.f) information to(6 d.o.f) information to
industrial robotsindustrial robots
• Machines able to ‘see’ theMachines able to ‘see’ the
part while at the same timepart while at the same time
addressing the issues ofaddressing the issues of
reliability, usability andreliability, usability and
global supply.global supply.
64. Single Camera 3DTM (SC3DTM)
A novel technology for guidance of industrial robots in three-
dimensional space
•SoftwareSoftware
•Data FlowData Flow
65. Single Camera 3DTM (SC3DTM)
A novel technology for guidance of industrial robots in three-
dimensional space
MachineMachine RepeatabilityRepeatability
66. Single Camera 3DTM (SC3DTM)
A novel technology for guidance of industrial robots in three-
dimensional space
RequirementsRequirements
• Parts must be stationaryParts must be stationary
• No part overlapNo part overlap
• 10 unique features visible to the10 unique features visible to the
cameracamera
• Part to part variation in thePart to part variation in the
position of features must beposition of features must be
minimalminimal
• Field of view must contain allField of view must contain all
featuresfeatures
• Camera resolution must be lessCamera resolution must be less
than 10% of thethan 10% of the
accuracy/repeatability required byaccuracy/repeatability required by
the applicationthe application
67. Summary
Machine Vision is:Machine Vision is:
AffordableAffordable
Used in many applicationsUsed in many applications
ConvenientConvenient
Easy-to-useEasy-to-use
Saves timeSaves time
SafeSafe
68. Primary Vendors of Technology
3D Systems3D Systems
• Cohu, Inc., Electronics DivisionCohu, Inc., Electronics Division
• LMI Technologies IncLMI Technologies Inc
• SICK IVP ABSICK IVP AB
• StockerYale CanadaStockerYale Canada
• VITRONIC Machine Vision Ltd.VITRONIC Machine Vision Ltd.
CamerasCameras
• AdimecAdimec
• Basler Vision TechnologiesBasler Vision Technologies
• DaitronDaitron
• JAI A/SJAI A/S
• Sony Electronics Inc.Sony Electronics Inc.
Complete Vision SystemsComplete Vision Systems
• Cognex CorporationCognex Corporation
• ISRA Vision SystemsISRA Vision Systems
• Tordivel ASTordivel AS
• Vitronic Machine VisionVitronic Machine Vision
69. References
• Beattie, RJ, Cheng, SK and Logue, PS, “The Use of VisionBeattie, RJ, Cheng, SK and Logue, PS, “The Use of Vision
Sensors in Multipass Welding Applications”, pp 28-33, TheSensors in Multipass Welding Applications”, pp 28-33, The
Welding Journal 67(11), November 1988.Welding Journal 67(11), November 1988.
• www.machinevisiononline.orgwww.machinevisiononline.org
• http://www.qualitydigest.com/oct97/html/machvis.htmlhttp://www.qualitydigest.com/oct97/html/machvis.html
• http://zone.ni.com/devzone/conceptd.nsf/webmain/9F5D44http://zone.ni.com/devzone/conceptd.nsf/webmain/9F5D44
BDD177005886256FDC007B2C78?BDD177005886256FDC007B2C78?
opendocument&node=1286_USopendocument&node=1286_US
• http://www.machinevisiononline.org/public/articles/Babak_http://www.machinevisiononline.org/public/articles/Babak_
Habibi_July03.pdfHabibi_July03.pdf