SlideShare a Scribd company logo
ACKNOWLEDGEMENT
I am grateful to GOD Almighty for giving me the courage and strength
to complete my seminar successfully. I am thankful to our beloved principal
Prof. Shahir V K and our respected Head of the Department of Computer
Science and Engineering Mr. Gireesh T K, for their parental guidance and
support.
I would like to thank our seminar co-ordinators Ms. Janitha Krishnan
and Ms. Greeshma K for giving me innovative suggestions and assisting in
times of need. I gratefully acknowledge the excellent and incessant help given
by our faculty and my guide Mohammed Jaseem N, Assistant Professor,
Department of Computer Science & Engineering, to incite the work. I am
thankful for valuable guidance and enduring encouragement throughout this
study.
I also remember with thanks the timely help and constant
encouragements induced by other faculties of AWH Engineering College, my
friends and parents. I express my sense of gratitude to Department of Computer
Science & Engineering, AWH Engineering College, for providing me with
facilities to complete my work.
DDEEEEPPAA JJOOHHNNYY
ABSTRACT
The first scheme “Model Of Saliency-Based Visual Attention” presents a
visual attention system, inspired by the behavior and the neuronal architecture
of the early primate visual system, is presented. Multiscale image features are
combined into a single topographical saliency map. A dynamical neural
network then selects attended locations in order of decreasing saliency. The
system breaks down the complex problem of scene understanding by rapidly
selecting, in a computationally efficient manner, conspicuous locations to be
analyzed in detail. The second scheme “Bilayer Segmentation Of Webcam
Videos” presents an automatic segmentation algorithm for video frames
captured by a (monocular) webcam that closely approximates depth
segmentation from a stereo camera. The frames are segmented into foreground
and background layers that comprise a subject (participant) and other objects
and individuals. The algorithm produces correct segmentations even in the
presence of large background motion with a nearly stationary foreground. The
last scheme “Exploring Visual And Motion Saliency For Automatic Video
Object Extraction” presents a saliency-based video object extraction (VOE)
framework. The framework aims to automatically extract foreground objects of
interest without any user interaction or the use of any training data (i.e., not
limited to any particular type of object).
CONTENTS
1. INTRODUCTION 1
2. LITERATURE SURVEY 10
2.1 MODEL OF SALIENCY – BASED VISUAL ATTENTION
SYSTEM 12
2.1.1 Extraction of Early Visual Features 14
2.1.2 The Saliency Map 15
2.2 BILAYER SEGMENTATION OF WEBCAM VIDEOS 18
2.2.1 Notation 20
2.2.2 Motons 20
2.2.3 Shape Filters 22
2.2.4 The Tree-Cube Taxonomy 23
2.2.5 Random Forests Vs Booster Of Trees Vs Ensemble Of
Boosters 25
2.2.6 Layer Segmentation 27
3. EXPLORING VISUAL AND MOTION SALIENCY FOR
AUTOMATIC VIDEO OBJECT EXTRACTION 28
3.1 AUTOMATIC OBJECT MODELING AND EXTRACTION 29
3.1.1 Determination of Visual Saliency 29
3.1.2 Extraction of Motion-Induced Cues 30
3.2 CONDITION RANDOM FIELD FOR VOE 33
3.2.1 Feature Fusion via CRF 34
3.2.2 Preserving Spatio-Temporal Consistency 35
4. COMPARISON 38
5. CONCLUSION 41
REFERENCES 42
GLOSSARY 43
LIST OF FIGURES
2.1 Motons 21
2.2 Shape Filters 22
2.3 The tree-cube taxonomy 25
LIST OF ABBREVIATIONS
1. FOA : Focus Of Attention
2. SM : Saliency Map
3. WTA : Winner-take-all neural network
4. DoG : Derivatives of Gaussian
5. EM : Expectation Maximization
6. LLR : log likelihood ratio
7. ARC : Adaptive reweighting and combining
8. RF : Random Forests
9. BT : Booster of Trees
10.EB : Ensemble of Boosters
11.GB : Gentle Boost
12.CRF : Conditional random field
13.EBT : Ensemble of Booster Trees
14.VOE : Video Object Extraction
15.HOG : Histogram of object gradients
16.GMM : Gaussian mixture models

More Related Content

Viewers also liked

Worm Gear ppt
Worm Gear pptWorm Gear ppt
Worm Gear ppt
shivank Kumar
 
Jtc5 worm gear screw lifter,small mechanical worm gear screw jacks, stainless...
Jtc5 worm gear screw lifter,small mechanical worm gear screw jacks, stainless...Jtc5 worm gear screw lifter,small mechanical worm gear screw jacks, stainless...
Jtc5 worm gear screw lifter,small mechanical worm gear screw jacks, stainless...
Jacton Electromechanical Co.,Ltd
 
Tillage pattern vs fuel consumption
Tillage pattern vs fuel consumptionTillage pattern vs fuel consumption
Tillage pattern vs fuel consumption
University of Dhaka, Bangladesh
 
Hindustan machine tools limited
Hindustan machine tools limitedHindustan machine tools limited
Hindustan machine tools limited
dkshekhawat
 
Worm gear
Worm gearWorm gear
Worm gear
balram yadav
 
WORM GEAR PPT
WORM GEAR PPTWORM GEAR PPT
WORM GEAR PPT
JS Wungchipem Jajo
 
Horticulture
HorticultureHorticulture
Horticulture
vishal chaturani
 
Design and analysis of composite drive shaft
Design and analysis of composite drive shaftDesign and analysis of composite drive shaft
Design and analysis of composite drive shaft
eSAT Publishing House
 

Viewers also liked (8)

Worm Gear ppt
Worm Gear pptWorm Gear ppt
Worm Gear ppt
 
Jtc5 worm gear screw lifter,small mechanical worm gear screw jacks, stainless...
Jtc5 worm gear screw lifter,small mechanical worm gear screw jacks, stainless...Jtc5 worm gear screw lifter,small mechanical worm gear screw jacks, stainless...
Jtc5 worm gear screw lifter,small mechanical worm gear screw jacks, stainless...
 
Tillage pattern vs fuel consumption
Tillage pattern vs fuel consumptionTillage pattern vs fuel consumption
Tillage pattern vs fuel consumption
 
Hindustan machine tools limited
Hindustan machine tools limitedHindustan machine tools limited
Hindustan machine tools limited
 
Worm gear
Worm gearWorm gear
Worm gear
 
WORM GEAR PPT
WORM GEAR PPTWORM GEAR PPT
WORM GEAR PPT
 
Horticulture
HorticultureHorticulture
Horticulture
 
Design and analysis of composite drive shaft
Design and analysis of composite drive shaftDesign and analysis of composite drive shaft
Design and analysis of composite drive shaft
 

Similar to 2.ack, abstract,contents page deepa

Human Action Recognition in Videos
Human Action Recognition in VideosHuman Action Recognition in Videos
Human Action Recognition in Videos
IRJET Journal
 
5 ijaems sept-2015-9-video feature extraction based on modified lle using ada...
5 ijaems sept-2015-9-video feature extraction based on modified lle using ada...5 ijaems sept-2015-9-video feature extraction based on modified lle using ada...
5 ijaems sept-2015-9-video feature extraction based on modified lle using ada...
INFOGAIN PUBLICATION
 
Convolutional Neural Network Based Real Time Object Detection Using YOLO V4
Convolutional Neural Network Based Real Time Object Detection Using YOLO V4Convolutional Neural Network Based Real Time Object Detection Using YOLO V4
Convolutional Neural Network Based Real Time Object Detection Using YOLO V4
IRJET Journal
 
IRJET- Human Fall Detection using Co-Saliency-Enhanced Deep Recurrent Convolu...
IRJET- Human Fall Detection using Co-Saliency-Enhanced Deep Recurrent Convolu...IRJET- Human Fall Detection using Co-Saliency-Enhanced Deep Recurrent Convolu...
IRJET- Human Fall Detection using Co-Saliency-Enhanced Deep Recurrent Convolu...
IRJET Journal
 
Human Motion Detection in Video Surveillance using Computer Vision Technique
Human Motion Detection in Video Surveillance using Computer Vision TechniqueHuman Motion Detection in Video Surveillance using Computer Vision Technique
Human Motion Detection in Video Surveillance using Computer Vision Technique
IRJET Journal
 
Car Steering Angle Prediction Using Deep Learning
Car Steering Angle Prediction Using Deep LearningCar Steering Angle Prediction Using Deep Learning
Car Steering Angle Prediction Using Deep Learning
IRJET Journal
 
Visual Cryptography Industrial Training Report
Visual Cryptography Industrial Training ReportVisual Cryptography Industrial Training Report
Visual Cryptography Industrial Training Report
Mohit Kumar
 
24 7912 9261-1-ed a meaningful (edit a)
24 7912 9261-1-ed a meaningful (edit a)24 7912 9261-1-ed a meaningful (edit a)
24 7912 9261-1-ed a meaningful (edit a)
IAESIJEECS
 
24 7912 9261-1-ed a meaningful (edit a)
24 7912 9261-1-ed a meaningful (edit a)24 7912 9261-1-ed a meaningful (edit a)
24 7912 9261-1-ed a meaningful (edit a)
IAESIJEECS
 
AN ENHANCEMENT FOR THE CONSISTENT DEPTH ESTIMATION OF MONOCULAR VIDEOS USING ...
AN ENHANCEMENT FOR THE CONSISTENT DEPTH ESTIMATION OF MONOCULAR VIDEOS USING ...AN ENHANCEMENT FOR THE CONSISTENT DEPTH ESTIMATION OF MONOCULAR VIDEOS USING ...
AN ENHANCEMENT FOR THE CONSISTENT DEPTH ESTIMATION OF MONOCULAR VIDEOS USING ...
mlaij
 
Visual odometry _report
Visual odometry _reportVisual odometry _report
Visual odometry _report
anutam majumder
 
Suspicious Activity Detection
Suspicious Activity DetectionSuspicious Activity Detection
Suspicious Activity Detection
Mushahid Ali
 
Automatic identification of animal using visual and motion saliency
Automatic identification of animal using visual and motion saliencyAutomatic identification of animal using visual and motion saliency
Automatic identification of animal using visual and motion saliency
eSAT Publishing House
 
Secure IoT Systems Monitor Framework using Probabilistic Image Encryption
Secure IoT Systems Monitor Framework using Probabilistic Image EncryptionSecure IoT Systems Monitor Framework using Probabilistic Image Encryption
Secure IoT Systems Monitor Framework using Probabilistic Image Encryption
IJAEMSJORNAL
 
Development of Human Tracking in Video Surveillance System for Activity Anal...
Development of Human Tracking in Video Surveillance System  for Activity Anal...Development of Human Tracking in Video Surveillance System  for Activity Anal...
Development of Human Tracking in Video Surveillance System for Activity Anal...
IOSR Journals
 
Synthesizing pseudo 2.5 d content from monocular videos for mixed reality
Synthesizing pseudo 2.5 d content from monocular videos for mixed realitySynthesizing pseudo 2.5 d content from monocular videos for mixed reality
Synthesizing pseudo 2.5 d content from monocular videos for mixed reality
NAVER Engineering
 
Exploring visual and motion saliency for automatic video object extraction
Exploring visual and motion saliency for automatic video object extractionExploring visual and motion saliency for automatic video object extraction
Exploring visual and motion saliency for automatic video object extraction
Muthu Samy
 
Exploring visual and motion saliency for automatic video object extraction
Exploring visual and motion saliency for automatic video object extractionExploring visual and motion saliency for automatic video object extraction
Exploring visual and motion saliency for automatic video object extraction
Muthu Samy
 

Similar to 2.ack, abstract,contents page deepa (20)

Human Action Recognition in Videos
Human Action Recognition in VideosHuman Action Recognition in Videos
Human Action Recognition in Videos
 
5 ijaems sept-2015-9-video feature extraction based on modified lle using ada...
5 ijaems sept-2015-9-video feature extraction based on modified lle using ada...5 ijaems sept-2015-9-video feature extraction based on modified lle using ada...
5 ijaems sept-2015-9-video feature extraction based on modified lle using ada...
 
Convolutional Neural Network Based Real Time Object Detection Using YOLO V4
Convolutional Neural Network Based Real Time Object Detection Using YOLO V4Convolutional Neural Network Based Real Time Object Detection Using YOLO V4
Convolutional Neural Network Based Real Time Object Detection Using YOLO V4
 
AcademicProject
AcademicProjectAcademicProject
AcademicProject
 
IRJET- Human Fall Detection using Co-Saliency-Enhanced Deep Recurrent Convolu...
IRJET- Human Fall Detection using Co-Saliency-Enhanced Deep Recurrent Convolu...IRJET- Human Fall Detection using Co-Saliency-Enhanced Deep Recurrent Convolu...
IRJET- Human Fall Detection using Co-Saliency-Enhanced Deep Recurrent Convolu...
 
pgdip-project-report-final-148245F
pgdip-project-report-final-148245Fpgdip-project-report-final-148245F
pgdip-project-report-final-148245F
 
Human Motion Detection in Video Surveillance using Computer Vision Technique
Human Motion Detection in Video Surveillance using Computer Vision TechniqueHuman Motion Detection in Video Surveillance using Computer Vision Technique
Human Motion Detection in Video Surveillance using Computer Vision Technique
 
Car Steering Angle Prediction Using Deep Learning
Car Steering Angle Prediction Using Deep LearningCar Steering Angle Prediction Using Deep Learning
Car Steering Angle Prediction Using Deep Learning
 
Visual Cryptography Industrial Training Report
Visual Cryptography Industrial Training ReportVisual Cryptography Industrial Training Report
Visual Cryptography Industrial Training Report
 
24 7912 9261-1-ed a meaningful (edit a)
24 7912 9261-1-ed a meaningful (edit a)24 7912 9261-1-ed a meaningful (edit a)
24 7912 9261-1-ed a meaningful (edit a)
 
24 7912 9261-1-ed a meaningful (edit a)
24 7912 9261-1-ed a meaningful (edit a)24 7912 9261-1-ed a meaningful (edit a)
24 7912 9261-1-ed a meaningful (edit a)
 
AN ENHANCEMENT FOR THE CONSISTENT DEPTH ESTIMATION OF MONOCULAR VIDEOS USING ...
AN ENHANCEMENT FOR THE CONSISTENT DEPTH ESTIMATION OF MONOCULAR VIDEOS USING ...AN ENHANCEMENT FOR THE CONSISTENT DEPTH ESTIMATION OF MONOCULAR VIDEOS USING ...
AN ENHANCEMENT FOR THE CONSISTENT DEPTH ESTIMATION OF MONOCULAR VIDEOS USING ...
 
Visual odometry _report
Visual odometry _reportVisual odometry _report
Visual odometry _report
 
Suspicious Activity Detection
Suspicious Activity DetectionSuspicious Activity Detection
Suspicious Activity Detection
 
Automatic identification of animal using visual and motion saliency
Automatic identification of animal using visual and motion saliencyAutomatic identification of animal using visual and motion saliency
Automatic identification of animal using visual and motion saliency
 
Secure IoT Systems Monitor Framework using Probabilistic Image Encryption
Secure IoT Systems Monitor Framework using Probabilistic Image EncryptionSecure IoT Systems Monitor Framework using Probabilistic Image Encryption
Secure IoT Systems Monitor Framework using Probabilistic Image Encryption
 
Development of Human Tracking in Video Surveillance System for Activity Anal...
Development of Human Tracking in Video Surveillance System  for Activity Anal...Development of Human Tracking in Video Surveillance System  for Activity Anal...
Development of Human Tracking in Video Surveillance System for Activity Anal...
 
Synthesizing pseudo 2.5 d content from monocular videos for mixed reality
Synthesizing pseudo 2.5 d content from monocular videos for mixed realitySynthesizing pseudo 2.5 d content from monocular videos for mixed reality
Synthesizing pseudo 2.5 d content from monocular videos for mixed reality
 
Exploring visual and motion saliency for automatic video object extraction
Exploring visual and motion saliency for automatic video object extractionExploring visual and motion saliency for automatic video object extraction
Exploring visual and motion saliency for automatic video object extraction
 
Exploring visual and motion saliency for automatic video object extraction
Exploring visual and motion saliency for automatic video object extractionExploring visual and motion saliency for automatic video object extraction
Exploring visual and motion saliency for automatic video object extraction
 

More from Safalsha Babu

2.doc
2.doc2.doc
dokumen.tips_gurobusdocx.pdf
dokumen.tips_gurobusdocx.pdfdokumen.tips_gurobusdocx.pdf
dokumen.tips_gurobusdocx.pdf
Safalsha Babu
 
3.doc
3.doc3.doc
S.A.NiknamandV.SongmeneINLACO2013.pdf
S.A.NiknamandV.SongmeneINLACO2013.pdfS.A.NiknamandV.SongmeneINLACO2013.pdf
S.A.NiknamandV.SongmeneINLACO2013.pdf
Safalsha Babu
 
axial-field-electrical-machines.pptx
axial-field-electrical-machines.pptxaxial-field-electrical-machines.pptx
axial-field-electrical-machines.pptx
Safalsha Babu
 
4.doc
4.doc4.doc
sanu 39.doc
sanu 39.docsanu 39.doc
sanu 39.doc
Safalsha Babu
 
GJBM_Vol8_No2_2014.pdf
GJBM_Vol8_No2_2014.pdfGJBM_Vol8_No2_2014.pdf
GJBM_Vol8_No2_2014.pdf
Safalsha Babu
 
1.doc
1.doc1.doc
TIGMIGHybridWeldedSteelJointAReview (2) (1).pdf
TIGMIGHybridWeldedSteelJointAReview (2) (1).pdfTIGMIGHybridWeldedSteelJointAReview (2) (1).pdf
TIGMIGHybridWeldedSteelJointAReview (2) (1).pdf
Safalsha Babu
 
ADITH NEW.pdf
ADITH NEW.pdfADITH NEW.pdf
ADITH NEW.pdf
Safalsha Babu
 
sd project report Final.pdf
sd project report Final.pdfsd project report Final.pdf
sd project report Final.pdf
Safalsha Babu
 
Mihirsenreport.doc
Mihirsenreport.docMihirsenreport.doc
Mihirsenreport.doc
Safalsha Babu
 
1. inside cover deepa
1. inside cover  deepa1. inside cover  deepa
1. inside cover deepaSafalsha Babu
 

More from Safalsha Babu (16)

2.doc
2.doc2.doc
2.doc
 
dokumen.tips_gurobusdocx.pdf
dokumen.tips_gurobusdocx.pdfdokumen.tips_gurobusdocx.pdf
dokumen.tips_gurobusdocx.pdf
 
3.doc
3.doc3.doc
3.doc
 
S.A.NiknamandV.SongmeneINLACO2013.pdf
S.A.NiknamandV.SongmeneINLACO2013.pdfS.A.NiknamandV.SongmeneINLACO2013.pdf
S.A.NiknamandV.SongmeneINLACO2013.pdf
 
axial-field-electrical-machines.pptx
axial-field-electrical-machines.pptxaxial-field-electrical-machines.pptx
axial-field-electrical-machines.pptx
 
4.doc
4.doc4.doc
4.doc
 
sanu 39.doc
sanu 39.docsanu 39.doc
sanu 39.doc
 
GJBM_Vol8_No2_2014.pdf
GJBM_Vol8_No2_2014.pdfGJBM_Vol8_No2_2014.pdf
GJBM_Vol8_No2_2014.pdf
 
1.doc
1.doc1.doc
1.doc
 
TIGMIGHybridWeldedSteelJointAReview (2) (1).pdf
TIGMIGHybridWeldedSteelJointAReview (2) (1).pdfTIGMIGHybridWeldedSteelJointAReview (2) (1).pdf
TIGMIGHybridWeldedSteelJointAReview (2) (1).pdf
 
ADITH NEW.pdf
ADITH NEW.pdfADITH NEW.pdf
ADITH NEW.pdf
 
sd project report Final.pdf
sd project report Final.pdfsd project report Final.pdf
sd project report Final.pdf
 
Mihirsenreport.doc
Mihirsenreport.docMihirsenreport.doc
Mihirsenreport.doc
 
Main cover deepa
Main cover  deepaMain cover  deepa
Main cover deepa
 
Certificate deepa
Certificate deepaCertificate deepa
Certificate deepa
 
1. inside cover deepa
1. inside cover  deepa1. inside cover  deepa
1. inside cover deepa
 

2.ack, abstract,contents page deepa

  • 1. ACKNOWLEDGEMENT I am grateful to GOD Almighty for giving me the courage and strength to complete my seminar successfully. I am thankful to our beloved principal Prof. Shahir V K and our respected Head of the Department of Computer Science and Engineering Mr. Gireesh T K, for their parental guidance and support. I would like to thank our seminar co-ordinators Ms. Janitha Krishnan and Ms. Greeshma K for giving me innovative suggestions and assisting in times of need. I gratefully acknowledge the excellent and incessant help given by our faculty and my guide Mohammed Jaseem N, Assistant Professor, Department of Computer Science & Engineering, to incite the work. I am thankful for valuable guidance and enduring encouragement throughout this study. I also remember with thanks the timely help and constant encouragements induced by other faculties of AWH Engineering College, my friends and parents. I express my sense of gratitude to Department of Computer Science & Engineering, AWH Engineering College, for providing me with facilities to complete my work. DDEEEEPPAA JJOOHHNNYY
  • 2. ABSTRACT The first scheme “Model Of Saliency-Based Visual Attention” presents a visual attention system, inspired by the behavior and the neuronal architecture of the early primate visual system, is presented. Multiscale image features are combined into a single topographical saliency map. A dynamical neural network then selects attended locations in order of decreasing saliency. The system breaks down the complex problem of scene understanding by rapidly selecting, in a computationally efficient manner, conspicuous locations to be analyzed in detail. The second scheme “Bilayer Segmentation Of Webcam Videos” presents an automatic segmentation algorithm for video frames captured by a (monocular) webcam that closely approximates depth segmentation from a stereo camera. The frames are segmented into foreground and background layers that comprise a subject (participant) and other objects and individuals. The algorithm produces correct segmentations even in the presence of large background motion with a nearly stationary foreground. The last scheme “Exploring Visual And Motion Saliency For Automatic Video Object Extraction” presents a saliency-based video object extraction (VOE) framework. The framework aims to automatically extract foreground objects of interest without any user interaction or the use of any training data (i.e., not limited to any particular type of object).
  • 3. CONTENTS 1. INTRODUCTION 1 2. LITERATURE SURVEY 10 2.1 MODEL OF SALIENCY – BASED VISUAL ATTENTION SYSTEM 12 2.1.1 Extraction of Early Visual Features 14 2.1.2 The Saliency Map 15 2.2 BILAYER SEGMENTATION OF WEBCAM VIDEOS 18 2.2.1 Notation 20 2.2.2 Motons 20 2.2.3 Shape Filters 22 2.2.4 The Tree-Cube Taxonomy 23 2.2.5 Random Forests Vs Booster Of Trees Vs Ensemble Of Boosters 25 2.2.6 Layer Segmentation 27 3. EXPLORING VISUAL AND MOTION SALIENCY FOR AUTOMATIC VIDEO OBJECT EXTRACTION 28 3.1 AUTOMATIC OBJECT MODELING AND EXTRACTION 29 3.1.1 Determination of Visual Saliency 29 3.1.2 Extraction of Motion-Induced Cues 30 3.2 CONDITION RANDOM FIELD FOR VOE 33 3.2.1 Feature Fusion via CRF 34 3.2.2 Preserving Spatio-Temporal Consistency 35 4. COMPARISON 38 5. CONCLUSION 41 REFERENCES 42 GLOSSARY 43
  • 4. LIST OF FIGURES 2.1 Motons 21 2.2 Shape Filters 22 2.3 The tree-cube taxonomy 25
  • 5. LIST OF ABBREVIATIONS 1. FOA : Focus Of Attention 2. SM : Saliency Map 3. WTA : Winner-take-all neural network 4. DoG : Derivatives of Gaussian 5. EM : Expectation Maximization 6. LLR : log likelihood ratio 7. ARC : Adaptive reweighting and combining 8. RF : Random Forests 9. BT : Booster of Trees 10.EB : Ensemble of Boosters 11.GB : Gentle Boost 12.CRF : Conditional random field 13.EBT : Ensemble of Booster Trees 14.VOE : Video Object Extraction 15.HOG : Histogram of object gradients 16.GMM : Gaussian mixture models