SlideShare a Scribd company logo
1 of 8
Tracking and Guiding Multiple Laser Beams for
Beam and Target Alignment
1 Introduction
In orderto applythe theoriesof inertial confinementfusion(ICF) topractice,the challengesassociated
withbeam
and targetalignmentsystemmustbe overcome[1].Itisnecessarytotake measurestorealize rapidand
precise alignmentinatime as shortas possible.Inordertoachieve
highershootingaccuracy,the laserspotsshouldbe guided
throughcontinuousvisual feedbackinreal-time[2].Normally,the processof aligningmultiple laser
beamsto the
Laser Beam Targeting System
desiredregiononthe targetiscalleda beamandtarget
alignmentprocess,andasensorforaligningmultiple laser
beamsto the target iscalleda targetalignmentsensor,
whichmainlyconsistsof the conjugate reflectivitymirror
and the microscope lens,asshowninFig.1. In thiswork,
3 dedicatedlaseralignmentdevices are integratedtoguide
3 laserbeamstoachieve the beamandtarget alignment.
For eachlaserbeam,the laserfrom the transmitterisamplified,processedthroughafilterwheel,
focusedbya set
of convergentlenses,andthenfilteredviaanaperture of a
circularhole of 6 mm diameter.Finally,the laserisfocused
againby a convex lensandisreflectedtothe endsurface of
Laser Beam Targeting System
target bya high-reflectivity mirror.Therefore,the detecting,trackingandguidingtechnologiesof laser
spotsbecome
veryimportantsothat multiple laserbeamscanshootthe
desiredregionof the targetinthe beamand targetalignmentprocedure.
RegularPaper
ManuscriptreceivedDecember25,2013; acceptedDecember4, 2014
RecommendedbyAssociateEditorNazimMir-Nasiri
Thiswork wassupportedbyNational Natural Science Foundation
of China(Nos.61227804 and61105036).
c Institute of Automation,ChineseAcademyof Science and
Springer-VerlagBerlinHeidelberg2015
The detectionandsegmentationof multiple spotsinimage sequencesisafundamental stepbefore the
trackingor
whenthe trackingisfailed.The laserspotisassumedtobe
the onlypart of the image witha highlightintensity.The
commonapproach isto extractthe spotsbybackground
subtraction.However,inpractice,the intensityof laser
may randomlychange,the illuminationinthe scene may
not be verystable andeventhe intensityof acylindrical
target mayvibrate slightly.All of these mayinduce the
changesof background.StaufferandGrimsor[3] modeled
each pixel asamixture of Gaussiansandusedan on-line
approximationtoupdate the model.However,the method
suffersfromslowlearningatthe beginningandisnotsensitivetothe small motions.Animproved
Gaussianmixture
model waspresentedbyZivkovic[4],inwhichnotonlythe
parametersbutalsothe numberof componentsof the mixture were constantlyselectedforeachpixel.
However,this
methodhashighcomputational cost,especially,inthe face
of the highimage resolution.
The tracking algorithmcanprovide the positionfeedbackforthe spotinreal-time.In[5],the object
tracking
was dividedintopointtracking,kernel trackingandsilhouette tracking.Features,suchascolor,edges,
optical flow
and texture are oftenchosenfortracking.Theycan be representedbyaprobabilisticmodelandthen
detectedinconsecutiveframes.Ingeneral,the mostdesirable featuresof
spotare the oneswhichcan be usedtodistinguishone spot
fromthe others.Consideringthe grayimage,the biggest
difference betweendifferentspotsisthe contourthenthe
intensity.Moreover,due tothe factthat the spot isnon
Laser Beam Targeting System
The detectionandsegmentationof multiple spotsinimage sequencesisafundamental stepbefore the
trackingor whenthe trackingis failed.The laserspotisassumedtobe the onlypart of the image witha
highlightintensity.The commonapproachisto extractthe spotsby backgroundsubtraction.However,
inpractice,the intensityof lasermayrandomlychange,the illuminationinthe scene maynotbe very
stable andeventhe intensityof acylindrical targetmayvibrate slightly.All of these mayinduce the
changesof background.StaufferandGrimsor[3] modeledeachpixel asamixture of Gaussiansandused
an on-line approximationtoupdate the model.However,the methodsuffersfromslow learningatthe
beginningandisnotsensitivetothe small motions.AnimprovedGaussianmixture model was
presentedbyZivkovic[4],inwhichnotonlythe parametersbutalsothe numberof componentsof the
mixture were constantlyselectedforeachpixel.However,thismethodhashighcomputational cost,
especially,in the face of the highimage resolution.
The tracking algorithmcanprovide the positionfeedbackforthe spotinreal-time.In[5],the object
trackingwas dividedintopointtracking,kerneltrackingandsilhouette tracking.Features,suchascolor,
edges,optical flowandtexture are oftenchosenfortracking.Theycanbe representedbyaprobabilistic
model andthendetectedinconsecutive frames.Ingeneral,the mostdesirable featuresof spotare the
oneswhichcan be usedto distinguishone spotfrom the others.Consideringthe grayimage,the biggest
difference betweendifferentspotsisthe contourthenthe intensity.Moreover,due tothe factthat the
spotis non-rigid,the trackingalgorithmbasedonitscontourismore practical.Many contourmodels
have beenreportedfortrackinginthe previousliterature,suchasoptical flow,level set,snakes,
balloonsandactive contoursmodel[6–8].Some contourtrackingmethodsbasedonboundarycodes
were investigatedin[9,10].However,theyare limitedtothe boundary-basedinformationandare
sensitivetonoise.Inordertoovercome the drawbacksof the sensitivenesstonoise andpoorimage
contrast,a particle filteringalgorithmforgeometricactive contourstrackingwasproposedin[11].
However,these techniquesrequire anumberof iterationsandare computationallytooexpensivefor
real-time applicationonmultiple spotstracking.Itisnecessarytodevelopone rapidandrobustcontour
trackingscheme forspots.
Laser Beam Targeting System
Anotherimportantproblemisthatthe spotsmaymix togetherandinterfere witheachotherwhen
multiple laserbeamssimultaneouslyshootthe target.The problemmaybe solvedbyguidingasingle
beamat a time,however,whichistime-consuming.Therefore,occlusionhandlingisadifficultissue in
the face of multiple spotstracking.Inthe previousliterature,the appearancemodel wasincorporated,
or the target wastreatedas a blobwhichmaymerge andsplit,or an exclusionprinciple wasemployed
by usingthe jointprobabilisticdataassociationfilterandthe particle filterwasemployedtoavoidthe
highcomputational load[12–15].The priorinformationof shape isoftenintegratedintocontour
representation.Yilmazetal.[16] proposedanon-rigidtrackingmethod,whichwasachievedbyevolving
the contour fromframe to frame withsome energyfunctions.The contourrepresentedbylevel setswas
usedto recoverthe missingobjectregionsduring occlusion.However,these methodsrequire precise
model,increase the computational complexityandmayfail inthe face of the rapidmotions.
The recognitionof multiplespotsisalsoakeyproblemduringmultiple spotstracking.Inorderto
distinguish differentspots,shape representationandmatchingtechniquesshouldbe considered.A
numberof successful shape matchingalgorithmswere proposed.One of the mostpopularmethodsisto
use Hausdorff distance,althoughitisverysensitivetooutliers.Somemethodscompare shape bythe
feature vectorwhichcontainsthe descriptorssuchasarea,geometricmoments,shape matrix,
appearance viagray histograms,optical flow vectors,etc.[17],while othersdirectlydowiththe aidof
pixel brightness[18].Belonggieetal.[19] proposedthe shape contextforshape matchingandobject
recognition,whichdescribedthe contourpointsbyhistograminthe log-polarspace.The similarity
betweentwoshapeswascomputedbyasumof matchingerrorsbetweencorrespondingpoints.
However,alarge amountof calculationswillbe neededandtheyare hardto satisfythe real-time
requirement.
Laser Beam Targeting System
The motivationof thispaperisto developthe detection,trackingandguidingschemesformultiple laser
spotsbasedon a beamand targetalignmentexperimentalplatform.Anaccurate andreal-time system
for multiplelaserbeamsshootingispresented,whichconsistsof spotssegmentation, spotscontour
trackingevenunderocclusionandspotsguidingbasedonvisual feedbackcontrol.
The rest of thispaper isorganizedasfollows.Section2describesmultiplespotsdetectionandtracking
strategy,inwhichthe spotsegmentation,the contour trackingandthe shape matchingalgorithmsare
introduced.Inordertoaccomplishthe beamand targetalignmenttask,Section3presentsmultiple
spotsguidingscheme.Section4providesthe experimental configurationandthe analysisof experiment
results.Finally,the paperisconcludedinSection5.
2 Multiple spotsdetectionandtrackingstrategy
The achievementof the beamandtargetalignmentbasedonvisual feedbackneedstoobtainthe
positionsof multiple spotsinreal-time.The accurate positionsneedtobe determinedbythe detection
and trackingstages.AsshowninFig.2, the proposedstrategyisinitializedwithastatusflagL = 1. Each
spotis recognizedbyitsshape andisnumberedafterthe detection.Meanwhile,itslocation,width,
height,image momentsandsoonare alsocalculated.If all spotsare found,thenflagL is setto 0. When
a newimage iscaptured,the trackingalgorithmisemployedtoobtainthe new featuresof spots.When
occlusionoccurs,the trackingscheme combinedwith apredictionmechanismwill determinethe new
positionsof spots.If the shape matchingbetweenthe currentcontourandthe previousone isfailed,
then,flagL changesto 0. Otherwise,the positionsof the currentspotswill be providedtothe guiding
stage.Then,the spotsin the nextframe will be trackeduntil stopping.
3 Spotsdetectionstage
3.1 Spotsdetectionstage
Firstof all,the movingspotsare segmentedfromthe beamandtargetimages.However,noise maybe
introducedandthe differentialimage maybe incomplete bystationarybackgroundsubtraction.Many
solutionsinthe previousliterature have beenproposedforreal-time foregrounddetectionfrommoving
background.Here,the adaptive Gaussianmixturemodel(GMM) isemployedtoobtainthe spots
background[20].A Bayesdecisionrule forclassifyingbackgroundandforegroundisformulatedandthe
learningstrategyisintroducedtoadaptto slightchangesinbackground.The probabilityof eachpixel
value at time tcan be writtenby
p(xt)=∑i=1Kwiη(xt,μi,Qi)
(1)
where Kis the numberof Gaussiandistributions,ωi is the weightof the i-thGaussiancomponent,μi is
the meanvalue,Q i is the covariance matrix andη(x t , μ i , Q i ) isthe i-thGaussianprobabilitydensity
function,whichisrepresentedby
η(xt,μi,Qi)=1(2π)D2|Qi|12e−12(xt−μi)TQ−1i(xt−μi).
(2)
In orderto avoidthe complex matrix computation,letQi=σ2iI.Consideringthe highresolutionof the
spotimage,nomore than3 Gaussianmodelsare initialized.
Each pixel isfirstlyclassifiedaseitherbackgroundoraforegroundpixel bythe models.The K
distributionsare orderedbasedonthe fitnessvalueωi /σ i . The firstB distributionsare selectedasa
model of the background,whichare estimatedby
B=argminb(∑i=1bwi>T)
(3)
where T isthe thresholdof backgroundweightvalue.The Gaussianmodel thatmatchesthe current
pixel value will be updatedbythe followingformulae.
w^t+1i=w^ti+α(1−w^ti)μ^t+1i=μ^ti+α(xt+1−μ^ti)Q^t+1i=Q^ti+α((xt+1−μ^t+1i)(xt+1−μt+1i)T−Q^ti).
(4)
If no Gaussianmodel matchesthe currentpixel value,thenthe leastprobablemodelisreplacedbythe
formulae wt+1i=α,μt+1i=xtandQt+1i=σ0. If the maximumnumberof componentsisreached,the
componentwiththe smallestweightwill be discarded.
However,the foregroundregionsegmentedbythe Gaussianmixture model isnotsufficienttobe clear.
Firstly,abinaryimage isobtainedthroughadaptive thresholdsegmentation,inwhichthe value of each
pixel iscomparedwiththe weightedaveragevalue aroundthe pixel.
((5))
where Ib¯(u,v) isthe convolutionof pixelbyone Gaussiankernel operatorandI T isthe constantvalue.
Then,the region-basednoise cleaningisapplied,suchasthe morphological openoperationincluding
the erosionbythe structuringelementA thenthe dilationbythe structuringelementB,denotedby
(X⊕A)⊖B.
(6)
Thisopeningoperationcangenerallyremoveverysmall regions,eliminatethinprotrusionsandsmooth
the contour of the spot. Then,the shape filterisusedtoclassifythe spots.Sofar,all spotsare numbered
and eachone has its ownID number.
3.2 Spotstrackingstage
In thissubsection,the contourtrackingalgorithmbasedonthe chaincode isintroduced.Many
applicationsusingchaincode representationhave beenreported inpreviousliteratures.The first
approach forrepresentingthe arbitrarygeometriccurve usingchaincode wasproposedby
Freeman[21].Inthisapproach,an arbitrarycontour can be representedbyasequence of small vectors
of unitlengthanda setof possible directions.There are twostandardcode definitionsusedtorepresent
contour,includingthe crackcode basedon4-connectivityandthe chaincode basedon8-connectivity.
In thiswork,the real-time androbustnessare veryimportantformultiplespotstracking.Here,the 8-
connectivitychaincode isemployedforrepresentingthe contourof spot,whichisbasedonthe
connectivityof neighboringpixels[22].Fig.3illustratesthe changesof 8possible absolute directions,
whichare indicatedbynumbers.“0”indicatesthe directionchange tothe east,“1” indicatesthe
directionchange tothe northeast,“2” indicatesthe directionchange tothe north,“3” indicatesthe
directionchange tothe northwest,“4” indicatesthe directionchange tothe west, “5” indicatesthe
directionchange tothe southwest,“6”indicatesthe directionchange tothe southand“7” indicatesthe
directionchange tothe southeast.A change betweentwoconsecutive chaincodesmeansachange in
the directionof the contour.Thus, each spot’scontourcan be codedbythe chaincode in the image
space.
Generally,the basicprinciple of the trackingbasedonchaincode of 8 directionsistoseparatelyencode
each connectcomponent.Itcan be dividedinto3stepsas follows.
Firstly, the initial centerof the trackedspotshouldbe specifiedsothatthe firstborderpixel canbe
found.The initial positioncanbe obtainedfromthe detectionprocedure.Startingfromthe firstcenter,
the firstborderpixel canbe detectedalongthe U-axisdirection.Inordertosearch a new contourin a
small regionof interest(ROI) whenthe trackingisfailed,one suitable searchwindow isset.A copyof
the current spotshouldbe createdinorderto determine whetherthe currentspotissimilartothe next
one.If no similarspotisdetected,thiscopyissetto the currentspot.
Secondly,the nextborderpixel isconsideredbyupdatingthe pixel coordinatesalongthe 8directions.
The coordinate transformationrulesare describedas
Laser Beam Targeting System

More Related Content

What's hot

IGARSS_PPT_20110726.ppt
IGARSS_PPT_20110726.pptIGARSS_PPT_20110726.ppt
IGARSS_PPT_20110726.ppt
grssieee
 
Ijarcet vol-2-issue-7-2273-2276
Ijarcet vol-2-issue-7-2273-2276Ijarcet vol-2-issue-7-2273-2276
Ijarcet vol-2-issue-7-2273-2276
Editor IJARCET
 
RuiLi_CVVT2016
RuiLi_CVVT2016RuiLi_CVVT2016
RuiLi_CVVT2016
Rui Li
 
Comparative Study of Compressive Sensing Techniques For Image Enhancement
Comparative Study of Compressive Sensing Techniques For Image EnhancementComparative Study of Compressive Sensing Techniques For Image Enhancement
Comparative Study of Compressive Sensing Techniques For Image Enhancement
CSCJournals
 

What's hot (18)

A fast single image haze removal algorithm using color attenuation prior
A fast single image haze removal algorithm using color attenuation priorA fast single image haze removal algorithm using color attenuation prior
A fast single image haze removal algorithm using color attenuation prior
 
IGARSS_PPT_20110726.ppt
IGARSS_PPT_20110726.pptIGARSS_PPT_20110726.ppt
IGARSS_PPT_20110726.ppt
 
Haze removal for a single remote sensing image based on deformed haze imaging...
Haze removal for a single remote sensing image based on deformed haze imaging...Haze removal for a single remote sensing image based on deformed haze imaging...
Haze removal for a single remote sensing image based on deformed haze imaging...
 
Synthetic aperture radar images
Synthetic aperture radar imagesSynthetic aperture radar images
Synthetic aperture radar images
 
M.E Computer Science Remote Sensing Projects
M.E Computer Science Remote Sensing ProjectsM.E Computer Science Remote Sensing Projects
M.E Computer Science Remote Sensing Projects
 
M.Phil Computer Science Remote Sensing Projects
M.Phil Computer Science Remote Sensing ProjectsM.Phil Computer Science Remote Sensing Projects
M.Phil Computer Science Remote Sensing Projects
 
M phil-computer-science-remote-sensing-projects
M phil-computer-science-remote-sensing-projectsM phil-computer-science-remote-sensing-projects
M phil-computer-science-remote-sensing-projects
 
M ESH S IMPLIFICATION V IA A V OLUME C OST M EASURE
M ESH S IMPLIFICATION V IA A V OLUME C OST M EASUREM ESH S IMPLIFICATION V IA A V OLUME C OST M EASURE
M ESH S IMPLIFICATION V IA A V OLUME C OST M EASURE
 
Multiple Person Tracking with Shadow Removal Using Adaptive Gaussian Mixture ...
Multiple Person Tracking with Shadow Removal Using Adaptive Gaussian Mixture ...Multiple Person Tracking with Shadow Removal Using Adaptive Gaussian Mixture ...
Multiple Person Tracking with Shadow Removal Using Adaptive Gaussian Mixture ...
 
Ijarcet vol-2-issue-7-2273-2276
Ijarcet vol-2-issue-7-2273-2276Ijarcet vol-2-issue-7-2273-2276
Ijarcet vol-2-issue-7-2273-2276
 
Lm342080283
Lm342080283Lm342080283
Lm342080283
 
RuiLi_CVVT2016
RuiLi_CVVT2016RuiLi_CVVT2016
RuiLi_CVVT2016
 
Unsupervised semi-supervised object detection
Unsupervised semi-supervised object detectionUnsupervised semi-supervised object detection
Unsupervised semi-supervised object detection
 
Mixed Reality: Pose Aware Object Replacement for Alternate Realities
Mixed Reality: Pose Aware Object Replacement for Alternate RealitiesMixed Reality: Pose Aware Object Replacement for Alternate Realities
Mixed Reality: Pose Aware Object Replacement for Alternate Realities
 
Determining Optical Flow
Determining Optical FlowDetermining Optical Flow
Determining Optical Flow
 
Comparative Study of Compressive Sensing Techniques For Image Enhancement
Comparative Study of Compressive Sensing Techniques For Image EnhancementComparative Study of Compressive Sensing Techniques For Image Enhancement
Comparative Study of Compressive Sensing Techniques For Image Enhancement
 
Optimization of Macro Block Size for Adaptive Rood Pattern Search Block Match...
Optimization of Macro Block Size for Adaptive Rood Pattern Search Block Match...Optimization of Macro Block Size for Adaptive Rood Pattern Search Block Match...
Optimization of Macro Block Size for Adaptive Rood Pattern Search Block Match...
 
Segmentation based image copy-move forgery detection scheme
Segmentation based image copy-move forgery detection schemeSegmentation based image copy-move forgery detection scheme
Segmentation based image copy-move forgery detection scheme
 

Similar to Analysis

Optimized patterns for digital image correlation
Optimized patterns for digital image correlationOptimized patterns for digital image correlation
Optimized patterns for digital image correlation
Rafael Rodriguez
 
Ijarcet vol-2-issue-7-2273-2276
Ijarcet vol-2-issue-7-2273-2276Ijarcet vol-2-issue-7-2273-2276
Ijarcet vol-2-issue-7-2273-2276
Editor IJARCET
 
EAMTA_VLSI Architecture Design for Particle Filtering in
EAMTA_VLSI Architecture Design for Particle Filtering inEAMTA_VLSI Architecture Design for Particle Filtering in
EAMTA_VLSI Architecture Design for Particle Filtering in
Alejandro Pasciaroni
 

Similar to Analysis (20)

6 superpixels using morphology for rock image
6 superpixels using morphology for rock image6 superpixels using morphology for rock image
6 superpixels using morphology for rock image
 
Optimized patterns for digital image correlation
Optimized patterns for digital image correlationOptimized patterns for digital image correlation
Optimized patterns for digital image correlation
 
A comparison of SIFT, PCA-SIFT and SURF
A comparison of SIFT, PCA-SIFT and SURFA comparison of SIFT, PCA-SIFT and SURF
A comparison of SIFT, PCA-SIFT and SURF
 
Efficient 3D stereo vision stabilization for multi-camera viewpoints
Efficient 3D stereo vision stabilization for multi-camera viewpointsEfficient 3D stereo vision stabilization for multi-camera viewpoints
Efficient 3D stereo vision stabilization for multi-camera viewpoints
 
Ieee transactions on image processing
Ieee transactions on image processingIeee transactions on image processing
Ieee transactions on image processing
 
Ijarcet vol-2-issue-7-2273-2276
Ijarcet vol-2-issue-7-2273-2276Ijarcet vol-2-issue-7-2273-2276
Ijarcet vol-2-issue-7-2273-2276
 
VISUAL TRACKING USING PARTICLE SWARM OPTIMIZATION
VISUAL TRACKING USING PARTICLE SWARM OPTIMIZATIONVISUAL TRACKING USING PARTICLE SWARM OPTIMIZATION
VISUAL TRACKING USING PARTICLE SWARM OPTIMIZATION
 
Visual tracking using particle swarm optimization
Visual tracking using particle swarm optimizationVisual tracking using particle swarm optimization
Visual tracking using particle swarm optimization
 
Report
ReportReport
Report
 
Adaptive Multiscale Stereo Images Matching Based on Wavelet Transform Modulus...
Adaptive Multiscale Stereo Images Matching Based on Wavelet Transform Modulus...Adaptive Multiscale Stereo Images Matching Based on Wavelet Transform Modulus...
Adaptive Multiscale Stereo Images Matching Based on Wavelet Transform Modulus...
 
Target Detection by Fuzzy Gustafson-Kessel Algorithm
Target Detection by Fuzzy Gustafson-Kessel AlgorithmTarget Detection by Fuzzy Gustafson-Kessel Algorithm
Target Detection by Fuzzy Gustafson-Kessel Algorithm
 
M phil-computer-science-remote-sensing-projects
M phil-computer-science-remote-sensing-projectsM phil-computer-science-remote-sensing-projects
M phil-computer-science-remote-sensing-projects
 
EAMTA_VLSI Architecture Design for Particle Filtering in
EAMTA_VLSI Architecture Design for Particle Filtering inEAMTA_VLSI Architecture Design for Particle Filtering in
EAMTA_VLSI Architecture Design for Particle Filtering in
 
VISUAL TRACKING USING PARTICLE SWARM OPTIMIZATION
VISUAL TRACKING USING PARTICLE SWARM OPTIMIZATIONVISUAL TRACKING USING PARTICLE SWARM OPTIMIZATION
VISUAL TRACKING USING PARTICLE SWARM OPTIMIZATION
 
A HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGES
A HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGESA HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGES
A HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGES
 
A HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGES
A HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGESA HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGES
A HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGES
 
A HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGES
A HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGESA HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGES
A HYBRID MORPHOLOGICAL ACTIVE CONTOUR FOR NATURAL IMAGES
 
557 480-486
557 480-486557 480-486
557 480-486
 
Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...
Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...
Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detec...
 
Probabilistic based Optimal Node Localization in Wireless Sensor Networks
Probabilistic based Optimal Node Localization in Wireless Sensor NetworksProbabilistic based Optimal Node Localization in Wireless Sensor Networks
Probabilistic based Optimal Node Localization in Wireless Sensor Networks
 

Recently uploaded

BUY GMAIL ACCOUNTS PVA USA IP INDIAN IP GMAIL
BUY GMAIL ACCOUNTS PVA USA IP INDIAN IP GMAILBUY GMAIL ACCOUNTS PVA USA IP INDIAN IP GMAIL
BUY GMAIL ACCOUNTS PVA USA IP INDIAN IP GMAIL
DIGISHIFT INDIA +918368319550
 
Brand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdfBrand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdf
tbatkhuu1
 

Recently uploaded (20)

Social Media Marketing PPT-Includes Paid media
Social Media Marketing PPT-Includes Paid mediaSocial Media Marketing PPT-Includes Paid media
Social Media Marketing PPT-Includes Paid media
 
BUY GMAIL ACCOUNTS PVA USA IP INDIAN IP GMAIL
BUY GMAIL ACCOUNTS PVA USA IP INDIAN IP GMAILBUY GMAIL ACCOUNTS PVA USA IP INDIAN IP GMAIL
BUY GMAIL ACCOUNTS PVA USA IP INDIAN IP GMAIL
 
BDSM⚡Call Girls in Sector 144 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 144 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 144 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 144 Noida Escorts >༒8448380779 Escort Service
 
Social media, ppt. Features, characteristics
Social media, ppt. Features, characteristicsSocial media, ppt. Features, characteristics
Social media, ppt. Features, characteristics
 
Turn Digital Reputation Threats into Offense Tactics - Daniel Lemin
Turn Digital Reputation Threats into Offense Tactics - Daniel LeminTurn Digital Reputation Threats into Offense Tactics - Daniel Lemin
Turn Digital Reputation Threats into Offense Tactics - Daniel Lemin
 
BLOOM_April2024. Balmer Lawrie Online Monthly Bulletin
BLOOM_April2024. Balmer Lawrie Online Monthly BulletinBLOOM_April2024. Balmer Lawrie Online Monthly Bulletin
BLOOM_April2024. Balmer Lawrie Online Monthly Bulletin
 
Enjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort ServiceEnjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort Service
Enjoy Night⚡Call Girls Dlf City Phase 4 Gurgaon >༒8448380779 Escort Service
 
How to Create a Social Media Plan Like a Pro - Jordan Scheltgen
How to Create a Social Media Plan Like a Pro - Jordan ScheltgenHow to Create a Social Media Plan Like a Pro - Jordan Scheltgen
How to Create a Social Media Plan Like a Pro - Jordan Scheltgen
 
Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15
Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15
Five Essential Tools for International SEO - Natalia Witczyk - SearchNorwich 15
 
Google 3rd-Party Cookie Deprecation [Update] + 5 Best Strategies
Google 3rd-Party Cookie Deprecation [Update] + 5 Best StrategiesGoogle 3rd-Party Cookie Deprecation [Update] + 5 Best Strategies
Google 3rd-Party Cookie Deprecation [Update] + 5 Best Strategies
 
Aryabhata I, II of mathematics of both.pptx
Aryabhata I, II of mathematics of both.pptxAryabhata I, II of mathematics of both.pptx
Aryabhata I, II of mathematics of both.pptx
 
What is Google Search Console and What is it provide?
What is Google Search Console and What is it provide?What is Google Search Console and What is it provide?
What is Google Search Console and What is it provide?
 
personal branding kit for music business
personal branding kit for music businesspersonal branding kit for music business
personal branding kit for music business
 
Call Us ➥9654467111▻Call Girls In Delhi NCR
Call Us ➥9654467111▻Call Girls In Delhi NCRCall Us ➥9654467111▻Call Girls In Delhi NCR
Call Us ➥9654467111▻Call Girls In Delhi NCR
 
Factors-Influencing-Branding-Strategies.pptx
Factors-Influencing-Branding-Strategies.pptxFactors-Influencing-Branding-Strategies.pptx
Factors-Influencing-Branding-Strategies.pptx
 
BDSM⚡Call Girls in Sector 150 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 150 Noida Escorts >༒8448380779 Escort ServiceBDSM⚡Call Girls in Sector 150 Noida Escorts >༒8448380779 Escort Service
BDSM⚡Call Girls in Sector 150 Noida Escorts >༒8448380779 Escort Service
 
Defining Marketing for the 21st Century,kotler
Defining Marketing for the 21st Century,kotlerDefining Marketing for the 21st Century,kotler
Defining Marketing for the 21st Century,kotler
 
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
SEO Master Class - Steve Wiideman, Wiideman Consulting GroupSEO Master Class - Steve Wiideman, Wiideman Consulting Group
SEO Master Class - Steve Wiideman, Wiideman Consulting Group
 
Brand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdfBrand experience Peoria City Soccer Presentation.pdf
Brand experience Peoria City Soccer Presentation.pdf
 
Major SEO Trends in 2024 - Banyanbrain Digital
Major SEO Trends in 2024 - Banyanbrain DigitalMajor SEO Trends in 2024 - Banyanbrain Digital
Major SEO Trends in 2024 - Banyanbrain Digital
 

Analysis

  • 1. Tracking and Guiding Multiple Laser Beams for Beam and Target Alignment 1 Introduction In orderto applythe theoriesof inertial confinementfusion(ICF) topractice,the challengesassociated withbeam and targetalignmentsystemmustbe overcome[1].Itisnecessarytotake measurestorealize rapidand precise alignmentinatime as shortas possible.Inordertoachieve highershootingaccuracy,the laserspotsshouldbe guided throughcontinuousvisual feedbackinreal-time[2].Normally,the processof aligningmultiple laser beamsto the Laser Beam Targeting System desiredregiononthe targetiscalleda beamandtarget alignmentprocess,andasensorforaligningmultiple laser beamsto the target iscalleda targetalignmentsensor, whichmainlyconsistsof the conjugate reflectivitymirror and the microscope lens,asshowninFig.1. In thiswork, 3 dedicatedlaseralignmentdevices are integratedtoguide 3 laserbeamstoachieve the beamandtarget alignment. For eachlaserbeam,the laserfrom the transmitterisamplified,processedthroughafilterwheel, focusedbya set of convergentlenses,andthenfilteredviaanaperture of a circularhole of 6 mm diameter.Finally,the laserisfocused againby a convex lensandisreflectedtothe endsurface of
  • 2. Laser Beam Targeting System target bya high-reflectivity mirror.Therefore,the detecting,trackingandguidingtechnologiesof laser spotsbecome veryimportantsothat multiple laserbeamscanshootthe desiredregionof the targetinthe beamand targetalignmentprocedure. RegularPaper ManuscriptreceivedDecember25,2013; acceptedDecember4, 2014 RecommendedbyAssociateEditorNazimMir-Nasiri Thiswork wassupportedbyNational Natural Science Foundation of China(Nos.61227804 and61105036). c Institute of Automation,ChineseAcademyof Science and Springer-VerlagBerlinHeidelberg2015 The detectionandsegmentationof multiple spotsinimage sequencesisafundamental stepbefore the trackingor whenthe trackingisfailed.The laserspotisassumedtobe the onlypart of the image witha highlightintensity.The commonapproach isto extractthe spotsbybackground subtraction.However,inpractice,the intensityof laser may randomlychange,the illuminationinthe scene may not be verystable andeventhe intensityof acylindrical target mayvibrate slightly.All of these mayinduce the changesof background.StaufferandGrimsor[3] modeled each pixel asamixture of Gaussiansandusedan on-line approximationtoupdate the model.However,the method
  • 3. suffersfromslowlearningatthe beginningandisnotsensitivetothe small motions.Animproved Gaussianmixture model waspresentedbyZivkovic[4],inwhichnotonlythe parametersbutalsothe numberof componentsof the mixture were constantlyselectedforeachpixel. However,this methodhashighcomputational cost,especially,inthe face of the highimage resolution. The tracking algorithmcanprovide the positionfeedbackforthe spotinreal-time.In[5],the object tracking was dividedintopointtracking,kernel trackingandsilhouette tracking.Features,suchascolor,edges, optical flow and texture are oftenchosenfortracking.Theycan be representedbyaprobabilisticmodelandthen detectedinconsecutiveframes.Ingeneral,the mostdesirable featuresof spotare the oneswhichcan be usedtodistinguishone spot fromthe others.Consideringthe grayimage,the biggest difference betweendifferentspotsisthe contourthenthe intensity.Moreover,due tothe factthat the spot isnon Laser Beam Targeting System The detectionandsegmentationof multiple spotsinimage sequencesisafundamental stepbefore the trackingor whenthe trackingis failed.The laserspotisassumedtobe the onlypart of the image witha highlightintensity.The commonapproachisto extractthe spotsby backgroundsubtraction.However, inpractice,the intensityof lasermayrandomlychange,the illuminationinthe scene maynotbe very stable andeventhe intensityof acylindrical targetmayvibrate slightly.All of these mayinduce the changesof background.StaufferandGrimsor[3] modeledeachpixel asamixture of Gaussiansandused an on-line approximationtoupdate the model.However,the methodsuffersfromslow learningatthe beginningandisnotsensitivetothe small motions.AnimprovedGaussianmixture model was presentedbyZivkovic[4],inwhichnotonlythe parametersbutalsothe numberof componentsof the mixture were constantlyselectedforeachpixel.However,thismethodhashighcomputational cost, especially,in the face of the highimage resolution.
  • 4. The tracking algorithmcanprovide the positionfeedbackforthe spotinreal-time.In[5],the object trackingwas dividedintopointtracking,kerneltrackingandsilhouette tracking.Features,suchascolor, edges,optical flowandtexture are oftenchosenfortracking.Theycanbe representedbyaprobabilistic model andthendetectedinconsecutive frames.Ingeneral,the mostdesirable featuresof spotare the oneswhichcan be usedto distinguishone spotfrom the others.Consideringthe grayimage,the biggest difference betweendifferentspotsisthe contourthenthe intensity.Moreover,due tothe factthat the spotis non-rigid,the trackingalgorithmbasedonitscontourismore practical.Many contourmodels have beenreportedfortrackinginthe previousliterature,suchasoptical flow,level set,snakes, balloonsandactive contoursmodel[6–8].Some contourtrackingmethodsbasedonboundarycodes were investigatedin[9,10].However,theyare limitedtothe boundary-basedinformationandare sensitivetonoise.Inordertoovercome the drawbacksof the sensitivenesstonoise andpoorimage contrast,a particle filteringalgorithmforgeometricactive contourstrackingwasproposedin[11]. However,these techniquesrequire anumberof iterationsandare computationallytooexpensivefor real-time applicationonmultiple spotstracking.Itisnecessarytodevelopone rapidandrobustcontour trackingscheme forspots. Laser Beam Targeting System Anotherimportantproblemisthatthe spotsmaymix togetherandinterfere witheachotherwhen multiple laserbeamssimultaneouslyshootthe target.The problemmaybe solvedbyguidingasingle beamat a time,however,whichistime-consuming.Therefore,occlusionhandlingisadifficultissue in the face of multiple spotstracking.Inthe previousliterature,the appearancemodel wasincorporated, or the target wastreatedas a blobwhichmaymerge andsplit,or an exclusionprinciple wasemployed by usingthe jointprobabilisticdataassociationfilterandthe particle filterwasemployedtoavoidthe highcomputational load[12–15].The priorinformationof shape isoftenintegratedintocontour representation.Yilmazetal.[16] proposedanon-rigidtrackingmethod,whichwasachievedbyevolving the contour fromframe to frame withsome energyfunctions.The contourrepresentedbylevel setswas usedto recoverthe missingobjectregionsduring occlusion.However,these methodsrequire precise model,increase the computational complexityandmayfail inthe face of the rapidmotions. The recognitionof multiplespotsisalsoakeyproblemduringmultiple spotstracking.Inorderto distinguish differentspots,shape representationandmatchingtechniquesshouldbe considered.A numberof successful shape matchingalgorithmswere proposed.One of the mostpopularmethodsisto use Hausdorff distance,althoughitisverysensitivetooutliers.Somemethodscompare shape bythe feature vectorwhichcontainsthe descriptorssuchasarea,geometricmoments,shape matrix, appearance viagray histograms,optical flow vectors,etc.[17],while othersdirectlydowiththe aidof pixel brightness[18].Belonggieetal.[19] proposedthe shape contextforshape matchingandobject recognition,whichdescribedthe contourpointsbyhistograminthe log-polarspace.The similarity betweentwoshapeswascomputedbyasumof matchingerrorsbetweencorrespondingpoints.
  • 5. However,alarge amountof calculationswillbe neededandtheyare hardto satisfythe real-time requirement. Laser Beam Targeting System The motivationof thispaperisto developthe detection,trackingandguidingschemesformultiple laser spotsbasedon a beamand targetalignmentexperimentalplatform.Anaccurate andreal-time system for multiplelaserbeamsshootingispresented,whichconsistsof spotssegmentation, spotscontour trackingevenunderocclusionandspotsguidingbasedonvisual feedbackcontrol. The rest of thispaper isorganizedasfollows.Section2describesmultiplespotsdetectionandtracking strategy,inwhichthe spotsegmentation,the contour trackingandthe shape matchingalgorithmsare introduced.Inordertoaccomplishthe beamand targetalignmenttask,Section3presentsmultiple spotsguidingscheme.Section4providesthe experimental configurationandthe analysisof experiment results.Finally,the paperisconcludedinSection5. 2 Multiple spotsdetectionandtrackingstrategy The achievementof the beamandtargetalignmentbasedonvisual feedbackneedstoobtainthe positionsof multiple spotsinreal-time.The accurate positionsneedtobe determinedbythe detection and trackingstages.AsshowninFig.2, the proposedstrategyisinitializedwithastatusflagL = 1. Each spotis recognizedbyitsshape andisnumberedafterthe detection.Meanwhile,itslocation,width, height,image momentsandsoonare alsocalculated.If all spotsare found,thenflagL is setto 0. When a newimage iscaptured,the trackingalgorithmisemployedtoobtainthe new featuresof spots.When occlusionoccurs,the trackingscheme combinedwith apredictionmechanismwill determinethe new positionsof spots.If the shape matchingbetweenthe currentcontourandthe previousone isfailed, then,flagL changesto 0. Otherwise,the positionsof the currentspotswill be providedtothe guiding stage.Then,the spotsin the nextframe will be trackeduntil stopping. 3 Spotsdetectionstage 3.1 Spotsdetectionstage Firstof all,the movingspotsare segmentedfromthe beamandtargetimages.However,noise maybe introducedandthe differentialimage maybe incomplete bystationarybackgroundsubtraction.Many solutionsinthe previousliterature have beenproposedforreal-time foregrounddetectionfrommoving background.Here,the adaptive Gaussianmixturemodel(GMM) isemployedtoobtainthe spots background[20].A Bayesdecisionrule forclassifyingbackgroundandforegroundisformulatedandthe
  • 6. learningstrategyisintroducedtoadaptto slightchangesinbackground.The probabilityof eachpixel value at time tcan be writtenby p(xt)=∑i=1Kwiη(xt,μi,Qi) (1) where Kis the numberof Gaussiandistributions,ωi is the weightof the i-thGaussiancomponent,μi is the meanvalue,Q i is the covariance matrix andη(x t , μ i , Q i ) isthe i-thGaussianprobabilitydensity function,whichisrepresentedby η(xt,μi,Qi)=1(2π)D2|Qi|12e−12(xt−μi)TQ−1i(xt−μi). (2) In orderto avoidthe complex matrix computation,letQi=σ2iI.Consideringthe highresolutionof the spotimage,nomore than3 Gaussianmodelsare initialized. Each pixel isfirstlyclassifiedaseitherbackgroundoraforegroundpixel bythe models.The K distributionsare orderedbasedonthe fitnessvalueωi /σ i . The firstB distributionsare selectedasa model of the background,whichare estimatedby B=argminb(∑i=1bwi>T) (3) where T isthe thresholdof backgroundweightvalue.The Gaussianmodel thatmatchesthe current pixel value will be updatedbythe followingformulae. w^t+1i=w^ti+α(1−w^ti)μ^t+1i=μ^ti+α(xt+1−μ^ti)Q^t+1i=Q^ti+α((xt+1−μ^t+1i)(xt+1−μt+1i)T−Q^ti). (4) If no Gaussianmodel matchesthe currentpixel value,thenthe leastprobablemodelisreplacedbythe formulae wt+1i=α,μt+1i=xtandQt+1i=σ0. If the maximumnumberof componentsisreached,the componentwiththe smallestweightwill be discarded.
  • 7. However,the foregroundregionsegmentedbythe Gaussianmixture model isnotsufficienttobe clear. Firstly,abinaryimage isobtainedthroughadaptive thresholdsegmentation,inwhichthe value of each pixel iscomparedwiththe weightedaveragevalue aroundthe pixel. ((5)) where Ib¯(u,v) isthe convolutionof pixelbyone Gaussiankernel operatorandI T isthe constantvalue. Then,the region-basednoise cleaningisapplied,suchasthe morphological openoperationincluding the erosionbythe structuringelementA thenthe dilationbythe structuringelementB,denotedby (X⊕A)⊖B. (6) Thisopeningoperationcangenerallyremoveverysmall regions,eliminatethinprotrusionsandsmooth the contour of the spot. Then,the shape filterisusedtoclassifythe spots.Sofar,all spotsare numbered and eachone has its ownID number. 3.2 Spotstrackingstage In thissubsection,the contourtrackingalgorithmbasedonthe chaincode isintroduced.Many applicationsusingchaincode representationhave beenreported inpreviousliteratures.The first approach forrepresentingthe arbitrarygeometriccurve usingchaincode wasproposedby Freeman[21].Inthisapproach,an arbitrarycontour can be representedbyasequence of small vectors of unitlengthanda setof possible directions.There are twostandardcode definitionsusedtorepresent contour,includingthe crackcode basedon4-connectivityandthe chaincode basedon8-connectivity. In thiswork,the real-time androbustnessare veryimportantformultiplespotstracking.Here,the 8- connectivitychaincode isemployedforrepresentingthe contourof spot,whichisbasedonthe connectivityof neighboringpixels[22].Fig.3illustratesthe changesof 8possible absolute directions, whichare indicatedbynumbers.“0”indicatesthe directionchange tothe east,“1” indicatesthe directionchange tothe northeast,“2” indicatesthe directionchange tothe north,“3” indicatesthe directionchange tothe northwest,“4” indicatesthe directionchange tothe west, “5” indicatesthe directionchange tothe southwest,“6”indicatesthe directionchange tothe southand“7” indicatesthe directionchange tothe southeast.A change betweentwoconsecutive chaincodesmeansachange in the directionof the contour.Thus, each spot’scontourcan be codedbythe chaincode in the image space.
  • 8. Generally,the basicprinciple of the trackingbasedonchaincode of 8 directionsistoseparatelyencode each connectcomponent.Itcan be dividedinto3stepsas follows. Firstly, the initial centerof the trackedspotshouldbe specifiedsothatthe firstborderpixel canbe found.The initial positioncanbe obtainedfromthe detectionprocedure.Startingfromthe firstcenter, the firstborderpixel canbe detectedalongthe U-axisdirection.Inordertosearch a new contourin a small regionof interest(ROI) whenthe trackingisfailed,one suitable searchwindow isset.A copyof the current spotshouldbe createdinorderto determine whetherthe currentspotissimilartothe next one.If no similarspotisdetected,thiscopyissetto the currentspot. Secondly,the nextborderpixel isconsideredbyupdatingthe pixel coordinatesalongthe 8directions. The coordinate transformationrulesare describedas Laser Beam Targeting System