SlideShare a Scribd company logo
A B I N J O: U C 
 L  C R  I

  Hannes Schulz, Hauke Strasdat, and Sven Behnke

                    University of Freiburg
               Institute of Computer Science



                    Nov 29, 2007
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
               is easy to confuse with other objects
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
               is easy to confuse with other objects
               is the most important object on the field:
               You cannot play sensibly without knowing its position
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
               is easy to confuse with other objects
               is the most important object on the field:
               You cannot play sensibly without knowing its position

          We should put a lot of effort into finding the single real ball.
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D B L L?
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D B L L?



                                    T E C
Balls and Non-Balls   Finding Ball Candidates    Classification of Ball Candidates   Experiments


 H D B L L?



                                    L C
Balls and Non-Balls   Finding Ball Candidates     Classification of Ball Candidates   Experiments


 H D B L L?



                                    M B
Balls and Non-Balls   Finding Ball Candidates    Classification of Ball Candidates   Experiments


 H D B L L?



                                    C W L
Balls and Non-Balls   Finding Ball Candidates      Classification of Ball Candidates   Experiments


 H D B L L?



                                    C R
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    H  F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    O O
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    O O
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    F
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 C  E  YUV S
Balls and Non-Balls   Finding Ball Candidates     Classification of Ball Candidates   Experiments


 C  E  YUV S




                                                Two ellipses for “orange”
                                                      Actual ball color
                                                      Wider, brownish color
Balls and Non-Balls   Finding Ball Candidates     Classification of Ball Candidates   Experiments


 C  E  YUV S




                                                Two ellipses for “orange”
                                                      Actual ball color
                                                      Wider, brownish color
                                                      Allows for motion blur
Balls and Non-Balls   Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I



                                                                               orange
           YUV Camera Image
                                                                               (-candidate)


                                                                               white


                                                                               green

                                                64 : 1
Balls and Non-Balls   Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I


           1. Find Maximum
           2. Find Weighted Mean                                               orange
                                                                               (-candidate)


                                                                               white


                                                                               green

                                                64 : 1
Balls and Non-Balls   Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I



                                                                               orange
        cut corresponding area
                                                                               (-candidate)


                                                                               white


                                                                               green

                                                64 : 1
Balls and Non-Balls     Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I



                                                                                 orange
        cut corresponding area
                                                                                 (-candidate)


                                                                                 white


       Box size depends on position in image
                                                                                 green

                                                  64 : 1
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 P  C
Balls and Non-Balls      Finding Ball Candidates   Classification of Ball Candidates   Experiments


 P  C




               Projection changes with ellipses: Robust to changes in
               lighting conditions
Balls and Non-Balls      Finding Ball Candidates   Classification of Ball Candidates   Experiments


 P  C




               Projection changes with ellipses: Robust to changes in
               lighting conditions
Balls and Non-Balls      Finding Ball Candidates         Classification of Ball Candidates   Experiments


 P  L



                 YUV-Image                         Y-Image                Subsampled Y-Image




               Subtraction of mean: Robust to changes in lighting conditions
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H L F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H L F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H L F


                                                                         -
                                                                       - + -
                                                                         -
                                                                         -
                                                                       - + -
                                                                         -
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 N N C




                                                               1: Ball


                                                              0: No Ball


           -
         - + -
           -
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 06 – T

                                                H
                                                    520 MHz ARM PocketPC
                                                    VGA HTC Camera

                                                D S
                                                    160 balls
                                                    440 non-balls
                                                    divided randomly in training set
                                                    (80%) and test set (20%)
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 06 – T

                                                H
                                                    520 MHz ARM PocketPC
                                                    VGA HTC Camera

                                                D S
                                                    160 balls
                                                    440 non-balls
                                                    divided randomly in training set
                                                    (80%) and test set (20%)

                                                P (T S)
                                                    100% of distractors classified
                                                    correctly
                                                    1 ball out of 32 not recognized
Balls and Non-Balls   Finding Ball Candidates           Classification of Ball Candidates   Experiments


 NR KS 06 – R T


                                                H
                                                    520 MHz ARM PocketPC
                                                    VGA HTC Camera

                                                R T T




                                                    Robot decides autonomously
                                                    which object to approach.
Balls and Non-Balls   Finding Ball Candidates    Classification of Ball Candidates   Experiments


 NR KS 2007

                                                H
                                                     1.33 GHz PC
                                                     WVGA µEye Camera
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 2007

   S D                                  D S
                                                    273 balls
                                                    548 non-balls
                                                    training set 62%, validation set
                                                    13%, test set 25%
                                                    varying lighting conditions
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 2007

   A S                             D S
        Avg Luminance                               273 balls
   ball            non-ball                         548 non-balls
                                                    training set 62%, validation set
                                                    13%, test set 25%
                                                    varying lighting conditions

    Avg Orange-Greenness
   ball            non-ball
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 2007

   A S                             D S
        Avg Luminance                               273 balls
   ball            non-ball                         548 non-balls
                                                    training set 62%, validation set
                                                    13%, test set 25%
                                                    varying lighting conditions

    Avg Orange-Greenness                        R  T S
   ball            non-ball                         91.1% accuracy
                                                    76.6% if stimuli flipped up/down.
                                                    Drop suggests dependency on
                                                    gradient.
                                                    88.2% if lighting in testset differs.
                                                    Classifier seems indifferent.
Balls and Non-Balls       Finding Ball Candidates          Classification of Ball Candidates   Experiments


 C  C




                                               Classifier
       Task           Neural Net        Linear Classifier            KNN (k = 5)
       Regular            91.1%                     86.5%                      88.5%
       Flipped            74.0%                     70.0%                      76.6%
Balls and Non-Balls      Finding Ball Candidates   Classification of Ball Candidates   Experiments


 C




               The ball has properties aside from being orange
               These properties are exploited by our Neural Network
               Classifiers
               Changes in Lighting conditions can be dealt with by projection
               to lines in YUV-space and Luminance.
               The method introduced here can be generalized to other
               small-sized objects on the field.

More Related Content

Viewers also liked

Using Communication Effectively
Using Communication EffectivelyUsing Communication Effectively
Using Communication Effectively
Owen Kulemeka
 
Coffee1
Coffee1Coffee1
Coffee1
sutrisno2629
 
Cascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land ResourcesCascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land Resources
Ana Cascao
 
Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13
Adrián Chávez
 
Para Pensar 12
Para Pensar 12Para Pensar 12
Para Pensar 12
sutrisno2629
 
Using GradeMark For Effective Feedback
Using GradeMark For Effective FeedbackUsing GradeMark For Effective Feedback
Using GradeMark For Effective Feedback
Karl Luke
 
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
Ana Cascao
 
Seconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta VastoSeconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta Vasto
nanni1952
 
Lead Management
Lead ManagementLead Management
Lead Management
Karan Chengappa
 
The Changing Landscape of Public Relations
The Changing Landscape of Public RelationsThe Changing Landscape of Public Relations
The Changing Landscape of Public Relations
Glen Turpin
 
Starbucks Brandz Report
Starbucks Brandz ReportStarbucks Brandz Report
Starbucks Brandz Report
pmbaird
 
Dades i operadors
Dades i operadorsDades i operadors
Dades i operadors
Alex Muntada Duran
 
13 Frases Para Vivir
13 Frases Para Vivir13 Frases Para Vivir
13 Frases Para Vivir
sutrisno2629
 
Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011
Jukka Manninen
 
Tudlo journey
Tudlo journeyTudlo journey
Adding A Course Using Web Reg Revised
Adding A Course Using Web Reg RevisedAdding A Course Using Web Reg Revised
Adding A Course Using Web Reg Revised
jfgodwin
 
CEx sells @ Bienalto
CEx sells @ BienaltoCEx sells @ Bienalto
CEx sells @ Bienalto
Zafer Bilda
 
Cascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary BasinsCascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary Basins
Ana Cascao
 
Tu Amistad
Tu AmistadTu Amistad
Tu Amistad
sutrisno2629
 

Viewers also liked (20)

Using Communication Effectively
Using Communication EffectivelyUsing Communication Effectively
Using Communication Effectively
 
Knovel2008
Knovel2008Knovel2008
Knovel2008
 
Coffee1
Coffee1Coffee1
Coffee1
 
Cascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land ResourcesCascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land Resources
 
Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13
 
Para Pensar 12
Para Pensar 12Para Pensar 12
Para Pensar 12
 
Using GradeMark For Effective Feedback
Using GradeMark For Effective FeedbackUsing GradeMark For Effective Feedback
Using GradeMark For Effective Feedback
 
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
 
Seconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta VastoSeconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta Vasto
 
Lead Management
Lead ManagementLead Management
Lead Management
 
The Changing Landscape of Public Relations
The Changing Landscape of Public RelationsThe Changing Landscape of Public Relations
The Changing Landscape of Public Relations
 
Starbucks Brandz Report
Starbucks Brandz ReportStarbucks Brandz Report
Starbucks Brandz Report
 
Dades i operadors
Dades i operadorsDades i operadors
Dades i operadors
 
13 Frases Para Vivir
13 Frases Para Vivir13 Frases Para Vivir
13 Frases Para Vivir
 
Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011
 
Tudlo journey
Tudlo journeyTudlo journey
Tudlo journey
 
Adding A Course Using Web Reg Revised
Adding A Course Using Web Reg RevisedAdding A Course Using Web Reg Revised
Adding A Course Using Web Reg Revised
 
CEx sells @ Bienalto
CEx sells @ BienaltoCEx sells @ Bienalto
CEx sells @ Bienalto
 
Cascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary BasinsCascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary Basins
 
Tu Amistad
Tu AmistadTu Amistad
Tu Amistad
 

More from cijat

Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour MethodsLearning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
cijat
 
Toward Optimal Configuration Space Sampling
Toward Optimal Configuration Space SamplingToward Optimal Configuration Space Sampling
Toward Optimal Configuration Space Sampling
cijat
 
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State EstimationCRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
cijat
 
RoboCup Introduction
RoboCup IntroductionRoboCup Introduction
RoboCup Introduction
cijat
 
Local and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic PlasticityLocal and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic Plasticity
cijat
 
Auxiliary
AuxiliaryAuxiliary
Auxiliary
cijat
 
Affordances
AffordancesAffordances
Affordances
cijat
 

More from cijat (7)

Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour MethodsLearning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
 
Toward Optimal Configuration Space Sampling
Toward Optimal Configuration Space SamplingToward Optimal Configuration Space Sampling
Toward Optimal Configuration Space Sampling
 
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State EstimationCRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
 
RoboCup Introduction
RoboCup IntroductionRoboCup Introduction
RoboCup Introduction
 
Local and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic PlasticityLocal and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic Plasticity
 
Auxiliary
AuxiliaryAuxiliary
Auxiliary
 
Affordances
AffordancesAffordances
Affordances
 

Recently uploaded

Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
SitimaJohn
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
Pixlogix Infotech
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
alexjohnson7307
 
Trusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process MiningTrusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process Mining
LucaBarbaro3
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
saastr
 
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - HiikeSystem Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
Hiike
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
shyamraj55
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Jeffrey Haguewood
 
A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024
Intelisync
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
fredae14
 

Recently uploaded (20)

Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptxOcean lotus Threat actors project by John Sitima 2024 (1).pptx
Ocean lotus Threat actors project by John Sitima 2024 (1).pptx
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Best 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERPBest 20 SEO Techniques To Improve Website Visibility In SERP
Best 20 SEO Techniques To Improve Website Visibility In SERP
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
leewayhertz.com-AI in predictive maintenance Use cases technologies benefits ...
 
Trusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process MiningTrusted Execution Environment for Decentralized Process Mining
Trusted Execution Environment for Decentralized Process Mining
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
Overcoming the PLG Trap: Lessons from Canva's Head of Sales & Head of EMEA Da...
 
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - HiikeSystem Design Case Study: Building a Scalable E-Commerce Platform - Hiike
System Design Case Study: Building a Scalable E-Commerce Platform - Hiike
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with SlackLet's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
Let's Integrate MuleSoft RPA, COMPOSER, APM with AWS IDP along with Slack
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
Salesforce Integration for Bonterra Impact Management (fka Social Solutions A...
 
A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024A Comprehensive Guide to DeFi Development Services in 2024
A Comprehensive Guide to DeFi Development Services in 2024
 
Recommendation System using RAG Architecture
Recommendation System using RAG ArchitectureRecommendation System using RAG Architecture
Recommendation System using RAG Architecture
 

The ball is not just orange.

  • 1. A B I N J O: U C  L  C R  I Hannes Schulz, Hauke Strasdat, and Sven Behnke University of Freiburg Institute of Computer Science Nov 29, 2007
  • 2. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small,
  • 3. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects
  • 4. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects is the most important object on the field: You cannot play sensibly without knowing its position
  • 5. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects is the most important object on the field: You cannot play sensibly without knowing its position We should put a lot of effort into finding the single real ball.
  • 6. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 7. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 8. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L?
  • 9. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? T E C
  • 10. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? L C
  • 11. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? M B
  • 12. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? C W L
  • 13. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? C R
  • 14. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L?
  • 15. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? H  F
  • 16. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? O O
  • 17. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? O O
  • 18. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? F
  • 19. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? F
  • 20. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 21. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S
  • 22. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S Two ellipses for “orange” Actual ball color Wider, brownish color
  • 23. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S Two ellipses for “orange” Actual ball color Wider, brownish color Allows for motion blur
  • 24. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange YUV Camera Image (-candidate) white green 64 : 1
  • 25. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I 1. Find Maximum 2. Find Weighted Mean orange (-candidate) white green 64 : 1
  • 26. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange cut corresponding area (-candidate) white green 64 : 1
  • 27. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange cut corresponding area (-candidate) white Box size depends on position in image green 64 : 1
  • 28. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 29. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C
  • 30. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C Projection changes with ellipses: Robust to changes in lighting conditions
  • 31. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C Projection changes with ellipses: Robust to changes in lighting conditions
  • 32. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  L YUV-Image Y-Image Subsampled Y-Image Subtraction of mean: Robust to changes in lighting conditions
  • 33. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F
  • 34. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F
  • 35. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F - - + - - - - + - -
  • 36. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments N N C 1: Ball 0: No Ball - - + - -
  • 37. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 38. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – T H 520 MHz ARM PocketPC VGA HTC Camera D S 160 balls 440 non-balls divided randomly in training set (80%) and test set (20%)
  • 39. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – T H 520 MHz ARM PocketPC VGA HTC Camera D S 160 balls 440 non-balls divided randomly in training set (80%) and test set (20%) P (T S) 100% of distractors classified correctly 1 ball out of 32 not recognized
  • 40. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – R T H 520 MHz ARM PocketPC VGA HTC Camera R T T Robot decides autonomously which object to approach.
  • 41. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 H 1.33 GHz PC WVGA µEye Camera
  • 42. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 S D D S 273 balls 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions
  • 43. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 A S D S Avg Luminance 273 balls ball non-ball 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions Avg Orange-Greenness ball non-ball
  • 44. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 A S D S Avg Luminance 273 balls ball non-ball 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions Avg Orange-Greenness R  T S ball non-ball 91.1% accuracy 76.6% if stimuli flipped up/down. Drop suggests dependency on gradient. 88.2% if lighting in testset differs. Classifier seems indifferent.
  • 45. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  C Classifier Task Neural Net Linear Classifier KNN (k = 5) Regular 91.1% 86.5% 88.5% Flipped 74.0% 70.0% 76.6%
  • 46. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C The ball has properties aside from being orange These properties are exploited by our Neural Network Classifiers Changes in Lighting conditions can be dealt with by projection to lines in YUV-space and Luminance. The method introduced here can be generalized to other small-sized objects on the field.