SlideShare a Scribd company logo
1 of 12
“Automatic Extraction of Machine Tags
in Flickr Service”
Mikołaj Leszczuk, Michał Grega, Jarosław Gliwski
2017-05-09
Need for More
Flickr Machine Tags
2
System Architecture
Images
Tags
3
Previously Reported Automated
Extraction of Machine Tags
» Face detection/people
head-counting
» Face recognition
» Text detection/recognition
» Logo detection/recognition
» Watermarks
detection/recognition
» Dominant colour of clothes
» Near-Duplicates (image
similarity)
» Bokeh effect detector
» Profile/en face classification
» Smile detection
» Unshaved faces
» Red eyes detection
» Nudity identification
» Dominant colour counter
» Landmark object
recognition
» Sky(line) detection
» Emotion detection
» Age classifier
4
New Automated Extraction
of Machine Tags
5
Detection of “Talking Head”
Pictures (1/2)
» Based on Mouth
Region of Interest
processing
» Processed picture-
by-picture
6
Face detection
Mouth
movement
detection
Cascade
classifier
Not Talking HeadTalking Head
Detection of “Talking Head”
Pictures (2/2)
» Face detection using Haar Cascades
» Sensitivity 88%, Specificity 100%
» Developed
7
Detection of Day & Night
Pictures
» Recognising:
– Day
scenes
– Night
scenes
» Based on
neural network
» Tested on
>2000 photos
» Accuracy >90%
» Developed
8
MOAVI
Video Quality Indicators
» Video quality
assessment system for
video sequences
» Quality of Experience
(QoE)
» 13 quality parameters
» Temporal Activity (TA)
» Spatial Activity (SA)
» Developed
9
Recognition of Gestures
» Creation &
implementation of
algorithms to recognize
gestures in pictures
» Pending
10
By Comixboy at English Wikipedia, CC BY 2.5,
https://commons.wikimedia.org/w/index.php?curid=9672553
Indoor/Outdoor
» Recognising:
– Indoor scenes
– Outdoor scenes
» Pending
11
Proceeding
» Create software allowing use of image
indexing technology, to supplement VIME
database of Flickr channel images
» Expected result of work (June 2017): creation
of machine tags in selected Flickr service
12

More Related Content

More from Mikolaj Leszczuk

Prace naukowe prowadzone w Katedrze Telekomunikacji @AGH_Krakow
Prace naukowe prowadzone w Katedrze Telekomunikacji @AGH_KrakowPrace naukowe prowadzone w Katedrze Telekomunikacji @AGH_Krakow
Prace naukowe prowadzone w Katedrze Telekomunikacji @AGH_KrakowMikolaj Leszczuk
 
Infrastructure for High-Attendance, Simple Psychophysical Experiments
Infrastructure for High-Attendance, Simple Psychophysical ExperimentsInfrastructure for High-Attendance, Simple Psychophysical Experiments
Infrastructure for High-Attendance, Simple Psychophysical ExperimentsMikolaj Leszczuk
 
J. Imaging: Special Issue on Image Quality
J. Imaging: Special Issue on Image QualityJ. Imaging: Special Issue on Image Quality
J. Imaging: Special Issue on Image QualityMikolaj Leszczuk
 
Video summarization framework for newscasts and reports – work in progress
Video summarization framework for newscasts and reports – work in progressVideo summarization framework for newscasts and reports – work in progress
Video summarization framework for newscasts and reports – work in progressMikolaj Leszczuk
 
Visual Analytics of Smart City Data for Sustainable Quality of Life of Citizens
Visual Analytics of Smart City Data for Sustainable Quality of Life of CitizensVisual Analytics of Smart City Data for Sustainable Quality of Life of Citizens
Visual Analytics of Smart City Data for Sustainable Quality of Life of CitizensMikolaj Leszczuk
 
Results on video summarization
Results on video summarizationResults on video summarization
Results on video summarizationMikolaj Leszczuk
 
Człowiek, ósma warstwa modelu ISO/OSI, jako element ekosystemu teleinformaty...
Człowiek, ósma warstwa modelu ISO/OSI, jako element ekosystemu teleinformaty...Człowiek, ósma warstwa modelu ISO/OSI, jako element ekosystemu teleinformaty...
Człowiek, ósma warstwa modelu ISO/OSI, jako element ekosystemu teleinformaty...Mikolaj Leszczuk
 
Badanie i implementacja aspektu QoE (ang. Quality of Experience) w aplikacjac...
Badanie i implementacja aspektu QoE (ang. Quality of Experience) w aplikacjac...Badanie i implementacja aspektu QoE (ang. Quality of Experience) w aplikacjac...
Badanie i implementacja aspektu QoE (ang. Quality of Experience) w aplikacjac...Mikolaj Leszczuk
 
Platforma do automatycznej, obiektywnej oceny jakości usług transmisji wideo
Platforma do automatycznej, obiektywnej oceny jakości usług transmisji wideoPlatforma do automatycznej, obiektywnej oceny jakości usług transmisji wideo
Platforma do automatycznej, obiektywnej oceny jakości usług transmisji wideoMikolaj Leszczuk
 
Modelling of Quality of Experience in No-Reference (NR) Model
Modelling of Quality of Experience in No-Reference (NR) ModelModelling of Quality of Experience in No-Reference (NR) Model
Modelling of Quality of Experience in No-Reference (NR) ModelMikolaj Leszczuk
 
Definition of Requirements for Accessing Multilingual Information and Opinions
Definition of Requirements for Accessing Multilingual Information and OpinionsDefinition of Requirements for Accessing Multilingual Information and Opinions
Definition of Requirements for Accessing Multilingual Information and OpinionsMikolaj Leszczuk
 
Aplikacja mobilna do rozpoznawania numerów linii komunikacji miejskiej
Aplikacja mobilna do rozpoznawania numerów linii komunikacji miejskiejAplikacja mobilna do rozpoznawania numerów linii komunikacji miejskiej
Aplikacja mobilna do rozpoznawania numerów linii komunikacji miejskiejMikolaj Leszczuk
 
Badanie możliwości crowdsourcingowej oceny jakości zdjęć
Badanie możliwości crowdsourcingowej oceny jakości zdjęćBadanie możliwości crowdsourcingowej oceny jakości zdjęć
Badanie możliwości crowdsourcingowej oceny jakości zdjęćMikolaj Leszczuk
 
Intelligent Monitoring for Security of Citizens
Intelligent Monitoring for Security of CitizensIntelligent Monitoring for Security of Citizens
Intelligent Monitoring for Security of CitizensMikolaj Leszczuk
 
Study of no reference video quality metrics for hevc compression
Study of no reference video quality metrics for hevc compressionStudy of no reference video quality metrics for hevc compression
Study of no reference video quality metrics for hevc compressionMikolaj Leszczuk
 

More from Mikolaj Leszczuk (16)

QoE Research
QoE ResearchQoE Research
QoE Research
 
Prace naukowe prowadzone w Katedrze Telekomunikacji @AGH_Krakow
Prace naukowe prowadzone w Katedrze Telekomunikacji @AGH_KrakowPrace naukowe prowadzone w Katedrze Telekomunikacji @AGH_Krakow
Prace naukowe prowadzone w Katedrze Telekomunikacji @AGH_Krakow
 
Infrastructure for High-Attendance, Simple Psychophysical Experiments
Infrastructure for High-Attendance, Simple Psychophysical ExperimentsInfrastructure for High-Attendance, Simple Psychophysical Experiments
Infrastructure for High-Attendance, Simple Psychophysical Experiments
 
J. Imaging: Special Issue on Image Quality
J. Imaging: Special Issue on Image QualityJ. Imaging: Special Issue on Image Quality
J. Imaging: Special Issue on Image Quality
 
Video summarization framework for newscasts and reports – work in progress
Video summarization framework for newscasts and reports – work in progressVideo summarization framework for newscasts and reports – work in progress
Video summarization framework for newscasts and reports – work in progress
 
Visual Analytics of Smart City Data for Sustainable Quality of Life of Citizens
Visual Analytics of Smart City Data for Sustainable Quality of Life of CitizensVisual Analytics of Smart City Data for Sustainable Quality of Life of Citizens
Visual Analytics of Smart City Data for Sustainable Quality of Life of Citizens
 
Results on video summarization
Results on video summarizationResults on video summarization
Results on video summarization
 
Człowiek, ósma warstwa modelu ISO/OSI, jako element ekosystemu teleinformaty...
Człowiek, ósma warstwa modelu ISO/OSI, jako element ekosystemu teleinformaty...Człowiek, ósma warstwa modelu ISO/OSI, jako element ekosystemu teleinformaty...
Człowiek, ósma warstwa modelu ISO/OSI, jako element ekosystemu teleinformaty...
 
Badanie i implementacja aspektu QoE (ang. Quality of Experience) w aplikacjac...
Badanie i implementacja aspektu QoE (ang. Quality of Experience) w aplikacjac...Badanie i implementacja aspektu QoE (ang. Quality of Experience) w aplikacjac...
Badanie i implementacja aspektu QoE (ang. Quality of Experience) w aplikacjac...
 
Platforma do automatycznej, obiektywnej oceny jakości usług transmisji wideo
Platforma do automatycznej, obiektywnej oceny jakości usług transmisji wideoPlatforma do automatycznej, obiektywnej oceny jakości usług transmisji wideo
Platforma do automatycznej, obiektywnej oceny jakości usług transmisji wideo
 
Modelling of Quality of Experience in No-Reference (NR) Model
Modelling of Quality of Experience in No-Reference (NR) ModelModelling of Quality of Experience in No-Reference (NR) Model
Modelling of Quality of Experience in No-Reference (NR) Model
 
Definition of Requirements for Accessing Multilingual Information and Opinions
Definition of Requirements for Accessing Multilingual Information and OpinionsDefinition of Requirements for Accessing Multilingual Information and Opinions
Definition of Requirements for Accessing Multilingual Information and Opinions
 
Aplikacja mobilna do rozpoznawania numerów linii komunikacji miejskiej
Aplikacja mobilna do rozpoznawania numerów linii komunikacji miejskiejAplikacja mobilna do rozpoznawania numerów linii komunikacji miejskiej
Aplikacja mobilna do rozpoznawania numerów linii komunikacji miejskiej
 
Badanie możliwości crowdsourcingowej oceny jakości zdjęć
Badanie możliwości crowdsourcingowej oceny jakości zdjęćBadanie możliwości crowdsourcingowej oceny jakości zdjęć
Badanie możliwości crowdsourcingowej oceny jakości zdjęć
 
Intelligent Monitoring for Security of Citizens
Intelligent Monitoring for Security of CitizensIntelligent Monitoring for Security of Citizens
Intelligent Monitoring for Security of Citizens
 
Study of no reference video quality metrics for hevc compression
Study of no reference video quality metrics for hevc compressionStudy of no reference video quality metrics for hevc compression
Study of no reference video quality metrics for hevc compression
 

Recently uploaded

Cot curve, melting temperature, unique and repetitive DNA
Cot curve, melting temperature, unique and repetitive DNACot curve, melting temperature, unique and repetitive DNA
Cot curve, melting temperature, unique and repetitive DNACherry
 
LUNULARIA -features, morphology, anatomy ,reproduction etc.
LUNULARIA -features, morphology, anatomy ,reproduction etc.LUNULARIA -features, morphology, anatomy ,reproduction etc.
LUNULARIA -features, morphology, anatomy ,reproduction etc.Cherry
 
PODOCARPUS...........................pptx
PODOCARPUS...........................pptxPODOCARPUS...........................pptx
PODOCARPUS...........................pptxCherry
 
X-rays from a Central “Exhaust Vent” of the Galactic Center Chimney
X-rays from a Central “Exhaust Vent” of the Galactic Center ChimneyX-rays from a Central “Exhaust Vent” of the Galactic Center Chimney
X-rays from a Central “Exhaust Vent” of the Galactic Center ChimneySérgio Sacani
 
Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.
Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.
Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.Cherry
 
Role of AI in seed science Predictive modelling and Beyond.pptx
Role of AI in seed science  Predictive modelling and  Beyond.pptxRole of AI in seed science  Predictive modelling and  Beyond.pptx
Role of AI in seed science Predictive modelling and Beyond.pptxArvind Kumar
 
Pteris : features, anatomy, morphology and lifecycle
Pteris : features, anatomy, morphology and lifecyclePteris : features, anatomy, morphology and lifecycle
Pteris : features, anatomy, morphology and lifecycleCherry
 
Use of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptxUse of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptxRenuJangid3
 
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptxClimate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptxDiariAli
 
Site specific recombination and transposition.........pdf
Site specific recombination and transposition.........pdfSite specific recombination and transposition.........pdf
Site specific recombination and transposition.........pdfCherry
 
TransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRings
TransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRingsTransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRings
TransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRingsSérgio Sacani
 
POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.Cherry
 
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry Areesha Ahmad
 
GBSN - Microbiology (Unit 3)Defense Mechanism of the body
GBSN - Microbiology (Unit 3)Defense Mechanism of the body GBSN - Microbiology (Unit 3)Defense Mechanism of the body
GBSN - Microbiology (Unit 3)Defense Mechanism of the body Areesha Ahmad
 
Dr. E. Muralinath_ Blood indices_clinical aspects
Dr. E. Muralinath_ Blood indices_clinical  aspectsDr. E. Muralinath_ Blood indices_clinical  aspects
Dr. E. Muralinath_ Blood indices_clinical aspectsmuralinath2
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learninglevieagacer
 

Recently uploaded (20)

Cot curve, melting temperature, unique and repetitive DNA
Cot curve, melting temperature, unique and repetitive DNACot curve, melting temperature, unique and repetitive DNA
Cot curve, melting temperature, unique and repetitive DNA
 
LUNULARIA -features, morphology, anatomy ,reproduction etc.
LUNULARIA -features, morphology, anatomy ,reproduction etc.LUNULARIA -features, morphology, anatomy ,reproduction etc.
LUNULARIA -features, morphology, anatomy ,reproduction etc.
 
PODOCARPUS...........................pptx
PODOCARPUS...........................pptxPODOCARPUS...........................pptx
PODOCARPUS...........................pptx
 
X-rays from a Central “Exhaust Vent” of the Galactic Center Chimney
X-rays from a Central “Exhaust Vent” of the Galactic Center ChimneyX-rays from a Central “Exhaust Vent” of the Galactic Center Chimney
X-rays from a Central “Exhaust Vent” of the Galactic Center Chimney
 
Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.
Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.
Genome Projects : Human, Rice,Wheat,E coli and Arabidopsis.
 
Role of AI in seed science Predictive modelling and Beyond.pptx
Role of AI in seed science  Predictive modelling and  Beyond.pptxRole of AI in seed science  Predictive modelling and  Beyond.pptx
Role of AI in seed science Predictive modelling and Beyond.pptx
 
Pteris : features, anatomy, morphology and lifecycle
Pteris : features, anatomy, morphology and lifecyclePteris : features, anatomy, morphology and lifecycle
Pteris : features, anatomy, morphology and lifecycle
 
Site Acceptance Test .
Site Acceptance Test                    .Site Acceptance Test                    .
Site Acceptance Test .
 
Use of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptxUse of mutants in understanding seedling development.pptx
Use of mutants in understanding seedling development.pptx
 
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptxClimate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
Climate Change Impacts on Terrestrial and Aquatic Ecosystems.pptx
 
Site specific recombination and transposition.........pdf
Site specific recombination and transposition.........pdfSite specific recombination and transposition.........pdf
Site specific recombination and transposition.........pdf
 
TransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRings
TransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRingsTransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRings
TransientOffsetin14CAftertheCarringtonEventRecordedbyPolarTreeRings
 
Clean In Place(CIP).pptx .
Clean In Place(CIP).pptx                 .Clean In Place(CIP).pptx                 .
Clean In Place(CIP).pptx .
 
POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.POGONATUM : morphology, anatomy, reproduction etc.
POGONATUM : morphology, anatomy, reproduction etc.
 
BHUBANESHWAR ODIA CALL GIRL SEIRVEC ❣️ 72051//37929❣️ CALL GIRL IN ODIA HAND ...
BHUBANESHWAR ODIA CALL GIRL SEIRVEC ❣️ 72051//37929❣️ CALL GIRL IN ODIA HAND ...BHUBANESHWAR ODIA CALL GIRL SEIRVEC ❣️ 72051//37929❣️ CALL GIRL IN ODIA HAND ...
BHUBANESHWAR ODIA CALL GIRL SEIRVEC ❣️ 72051//37929❣️ CALL GIRL IN ODIA HAND ...
 
ABHISHEK ANTIBIOTICS PPT MICROBIOLOGY // USES OF ANTIOBIOTICS TYPES OF ANTIB...
ABHISHEK ANTIBIOTICS PPT MICROBIOLOGY  // USES OF ANTIOBIOTICS TYPES OF ANTIB...ABHISHEK ANTIBIOTICS PPT MICROBIOLOGY  // USES OF ANTIOBIOTICS TYPES OF ANTIB...
ABHISHEK ANTIBIOTICS PPT MICROBIOLOGY // USES OF ANTIOBIOTICS TYPES OF ANTIB...
 
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
GBSN - Biochemistry (Unit 2) Basic concept of organic chemistry
 
GBSN - Microbiology (Unit 3)Defense Mechanism of the body
GBSN - Microbiology (Unit 3)Defense Mechanism of the body GBSN - Microbiology (Unit 3)Defense Mechanism of the body
GBSN - Microbiology (Unit 3)Defense Mechanism of the body
 
Dr. E. Muralinath_ Blood indices_clinical aspects
Dr. E. Muralinath_ Blood indices_clinical  aspectsDr. E. Muralinath_ Blood indices_clinical  aspects
Dr. E. Muralinath_ Blood indices_clinical aspects
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learning
 

Automatic Extraction of Machine Tags in Flickr Service

  • 1. “Automatic Extraction of Machine Tags in Flickr Service” Mikołaj Leszczuk, Michał Grega, Jarosław Gliwski 2017-05-09
  • 2. Need for More Flickr Machine Tags 2
  • 4. Previously Reported Automated Extraction of Machine Tags » Face detection/people head-counting » Face recognition » Text detection/recognition » Logo detection/recognition » Watermarks detection/recognition » Dominant colour of clothes » Near-Duplicates (image similarity) » Bokeh effect detector » Profile/en face classification » Smile detection » Unshaved faces » Red eyes detection » Nudity identification » Dominant colour counter » Landmark object recognition » Sky(line) detection » Emotion detection » Age classifier 4
  • 6. Detection of “Talking Head” Pictures (1/2) » Based on Mouth Region of Interest processing » Processed picture- by-picture 6 Face detection Mouth movement detection Cascade classifier Not Talking HeadTalking Head
  • 7. Detection of “Talking Head” Pictures (2/2) » Face detection using Haar Cascades » Sensitivity 88%, Specificity 100% » Developed 7
  • 8. Detection of Day & Night Pictures » Recognising: – Day scenes – Night scenes » Based on neural network » Tested on >2000 photos » Accuracy >90% » Developed 8
  • 9. MOAVI Video Quality Indicators » Video quality assessment system for video sequences » Quality of Experience (QoE) » 13 quality parameters » Temporal Activity (TA) » Spatial Activity (SA) » Developed 9
  • 10. Recognition of Gestures » Creation & implementation of algorithms to recognize gestures in pictures » Pending 10 By Comixboy at English Wikipedia, CC BY 2.5, https://commons.wikimedia.org/w/index.php?curid=9672553
  • 11. Indoor/Outdoor » Recognising: – Indoor scenes – Outdoor scenes » Pending 11
  • 12. Proceeding » Create software allowing use of image indexing technology, to supplement VIME database of Flickr channel images » Expected result of work (June 2017): creation of machine tags in selected Flickr service 12

Editor's Notes

  1. Face should be large enough (3% of the scene size) One face only (90% of the frames in scene with 1 face) Open/closed ratio 20% or higher