SlideShare a Scribd company logo
1 of 46
Download to read offline
A B I N J O: U C 
 L  C R  I

  Hannes Schulz, Hauke Strasdat, and Sven Behnke

                    University of Freiburg
               Institute of Computer Science



                    Nov 29, 2007
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
               is easy to confuse with other objects
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
               is easy to confuse with other objects
               is the most important object on the field:
               You cannot play sensibly without knowing its position
Balls and Non-Balls        Finding Ball Candidates   Classification of Ball Candidates   Experiments


 M




       The ball

               is small,
               is easy to confuse with other objects
               is the most important object on the field:
               You cannot play sensibly without knowing its position

          We should put a lot of effort into finding the single real ball.
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D B L L?
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D B L L?



                                    T E C
Balls and Non-Balls   Finding Ball Candidates    Classification of Ball Candidates   Experiments


 H D B L L?



                                    L C
Balls and Non-Balls   Finding Ball Candidates     Classification of Ball Candidates   Experiments


 H D B L L?



                                    M B
Balls and Non-Balls   Finding Ball Candidates    Classification of Ball Candidates   Experiments


 H D B L L?



                                    C W L
Balls and Non-Balls   Finding Ball Candidates      Classification of Ball Candidates   Experiments


 H D B L L?



                                    C R
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    H  F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    O O
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    O O
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H D N-B L L?



                                    F
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 C  E  YUV S
Balls and Non-Balls   Finding Ball Candidates     Classification of Ball Candidates   Experiments


 C  E  YUV S




                                                Two ellipses for “orange”
                                                      Actual ball color
                                                      Wider, brownish color
Balls and Non-Balls   Finding Ball Candidates     Classification of Ball Candidates   Experiments


 C  E  YUV S




                                                Two ellipses for “orange”
                                                      Actual ball color
                                                      Wider, brownish color
                                                      Allows for motion blur
Balls and Non-Balls   Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I



                                                                               orange
           YUV Camera Image
                                                                               (-candidate)


                                                                               white


                                                                               green

                                                64 : 1
Balls and Non-Balls   Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I


           1. Find Maximum
           2. Find Weighted Mean                                               orange
                                                                               (-candidate)


                                                                               white


                                                                               green

                                                64 : 1
Balls and Non-Balls   Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I



                                                                               orange
        cut corresponding area
                                                                               (-candidate)


                                                                               white


                                                                               green

                                                64 : 1
Balls and Non-Balls     Finding Ball Candidates            Classification of Ball Candidates     Experiments


 S  C I



                                                                                 orange
        cut corresponding area
                                                                                 (-candidate)


                                                                                 white


       Box size depends on position in image
                                                                                 green

                                                  64 : 1
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 P  C
Balls and Non-Balls      Finding Ball Candidates   Classification of Ball Candidates   Experiments


 P  C




               Projection changes with ellipses: Robust to changes in
               lighting conditions
Balls and Non-Balls      Finding Ball Candidates   Classification of Ball Candidates   Experiments


 P  C




               Projection changes with ellipses: Robust to changes in
               lighting conditions
Balls and Non-Balls      Finding Ball Candidates         Classification of Ball Candidates   Experiments


 P  L



                 YUV-Image                         Y-Image                Subsampled Y-Image




               Subtraction of mean: Robust to changes in lighting conditions
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H L F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H L F
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 H L F


                                                                         -
                                                                       - + -
                                                                         -
                                                                         -
                                                                       - + -
                                                                         -
Balls and Non-Balls   Finding Ball Candidates   Classification of Ball Candidates   Experiments


 N N C




                                                               1: Ball


                                                              0: No Ball


           -
         - + -
           -
O



  1   I  B  N-B


  2   F B C


  3   C  B C


  4   E
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 06 – T

                                                H
                                                    520 MHz ARM PocketPC
                                                    VGA HTC Camera

                                                D S
                                                    160 balls
                                                    440 non-balls
                                                    divided randomly in training set
                                                    (80%) and test set (20%)
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 06 – T

                                                H
                                                    520 MHz ARM PocketPC
                                                    VGA HTC Camera

                                                D S
                                                    160 balls
                                                    440 non-balls
                                                    divided randomly in training set
                                                    (80%) and test set (20%)

                                                P (T S)
                                                    100% of distractors classified
                                                    correctly
                                                    1 ball out of 32 not recognized
Balls and Non-Balls   Finding Ball Candidates           Classification of Ball Candidates   Experiments


 NR KS 06 – R T


                                                H
                                                    520 MHz ARM PocketPC
                                                    VGA HTC Camera

                                                R T T




                                                    Robot decides autonomously
                                                    which object to approach.
Balls and Non-Balls   Finding Ball Candidates    Classification of Ball Candidates   Experiments


 NR KS 2007

                                                H
                                                     1.33 GHz PC
                                                     WVGA µEye Camera
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 2007

   S D                                  D S
                                                    273 balls
                                                    548 non-balls
                                                    training set 62%, validation set
                                                    13%, test set 25%
                                                    varying lighting conditions
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 2007

   A S                             D S
        Avg Luminance                               273 balls
   ball            non-ball                         548 non-balls
                                                    training set 62%, validation set
                                                    13%, test set 25%
                                                    varying lighting conditions

    Avg Orange-Greenness
   ball            non-ball
Balls and Non-Balls   Finding Ball Candidates              Classification of Ball Candidates   Experiments


 NR KS 2007

   A S                             D S
        Avg Luminance                               273 balls
   ball            non-ball                         548 non-balls
                                                    training set 62%, validation set
                                                    13%, test set 25%
                                                    varying lighting conditions

    Avg Orange-Greenness                        R  T S
   ball            non-ball                         91.1% accuracy
                                                    76.6% if stimuli flipped up/down.
                                                    Drop suggests dependency on
                                                    gradient.
                                                    88.2% if lighting in testset differs.
                                                    Classifier seems indifferent.
Balls and Non-Balls       Finding Ball Candidates          Classification of Ball Candidates   Experiments


 C  C




                                               Classifier
       Task           Neural Net        Linear Classifier            KNN (k = 5)
       Regular            91.1%                     86.5%                      88.5%
       Flipped            74.0%                     70.0%                      76.6%
Balls and Non-Balls      Finding Ball Candidates   Classification of Ball Candidates   Experiments


 C




               The ball has properties aside from being orange
               These properties are exploited by our Neural Network
               Classifiers
               Changes in Lighting conditions can be dealt with by projection
               to lines in YUV-space and Luminance.
               The method introduced here can be generalized to other
               small-sized objects on the field.

More Related Content

Viewers also liked

Using Communication Effectively
Using Communication EffectivelyUsing Communication Effectively
Using Communication EffectivelyOwen Kulemeka
 
Cascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land ResourcesCascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land ResourcesAna Cascao
 
Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13Adrián Chávez
 
Using GradeMark For Effective Feedback
Using GradeMark For Effective FeedbackUsing GradeMark For Effective Feedback
Using GradeMark For Effective FeedbackKarl Luke
 
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...Ana Cascao
 
Seconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta VastoSeconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta Vastonanni1952
 
The Changing Landscape of Public Relations
The Changing Landscape of Public RelationsThe Changing Landscape of Public Relations
The Changing Landscape of Public RelationsGlen Turpin
 
Starbucks Brandz Report
Starbucks Brandz ReportStarbucks Brandz Report
Starbucks Brandz Reportpmbaird
 
13 Frases Para Vivir
13 Frases Para Vivir13 Frases Para Vivir
13 Frases Para Vivirsutrisno2629
 
Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011Jukka Manninen
 
Adding A Course Using Web Reg Revised
Adding A Course Using Web Reg RevisedAdding A Course Using Web Reg Revised
Adding A Course Using Web Reg Revisedjfgodwin
 
CEx sells @ Bienalto
CEx sells @ BienaltoCEx sells @ Bienalto
CEx sells @ BienaltoZafer Bilda
 
Cascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary BasinsCascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary BasinsAna Cascao
 

Viewers also liked (20)

Using Communication Effectively
Using Communication EffectivelyUsing Communication Effectively
Using Communication Effectively
 
Knovel2008
Knovel2008Knovel2008
Knovel2008
 
Coffee1
Coffee1Coffee1
Coffee1
 
Cascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land ResourcesCascao Cortona Gambella Sharing Water Land Resources
Cascao Cortona Gambella Sharing Water Land Resources
 
Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13Trauma Equipo7 SecciòN13
Trauma Equipo7 SecciòN13
 
Para Pensar 12
Para Pensar 12Para Pensar 12
Para Pensar 12
 
Using GradeMark For Effective Feedback
Using GradeMark For Effective FeedbackUsing GradeMark For Effective Feedback
Using GradeMark For Effective Feedback
 
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
AEGIS Conference of African Studies 2011 - Uppsala [Land grabbing in Gambella...
 
Seconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta VastoSeconda Campagna Indagini Relazione Arta Vasto
Seconda Campagna Indagini Relazione Arta Vasto
 
Lead Management
Lead ManagementLead Management
Lead Management
 
The Changing Landscape of Public Relations
The Changing Landscape of Public RelationsThe Changing Landscape of Public Relations
The Changing Landscape of Public Relations
 
Starbucks Brandz Report
Starbucks Brandz ReportStarbucks Brandz Report
Starbucks Brandz Report
 
Dades i operadors
Dades i operadorsDades i operadors
Dades i operadors
 
13 Frases Para Vivir
13 Frases Para Vivir13 Frases Para Vivir
13 Frases Para Vivir
 
Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011Renkomäen koulun veso 30.5.2011
Renkomäen koulun veso 30.5.2011
 
Tudlo journey
Tudlo journeyTudlo journey
Tudlo journey
 
Adding A Course Using Web Reg Revised
Adding A Course Using Web Reg RevisedAdding A Course Using Web Reg Revised
Adding A Course Using Web Reg Revised
 
CEx sells @ Bienalto
CEx sells @ BienaltoCEx sells @ Bienalto
CEx sells @ Bienalto
 
Cascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary BasinsCascao London Resistance Counter-hegemony Transboundary Basins
Cascao London Resistance Counter-hegemony Transboundary Basins
 
Tu Amistad
Tu AmistadTu Amistad
Tu Amistad
 

More from cijat

Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour MethodsLearning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methodscijat
 
Toward Optimal Configuration Space Sampling
Toward Optimal Configuration Space SamplingToward Optimal Configuration Space Sampling
Toward Optimal Configuration Space Samplingcijat
 
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State EstimationCRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State Estimationcijat
 
RoboCup Introduction
RoboCup IntroductionRoboCup Introduction
RoboCup Introductioncijat
 
Local and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic PlasticityLocal and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic Plasticitycijat
 
Auxiliary
AuxiliaryAuxiliary
Auxiliarycijat
 
Affordances
AffordancesAffordances
Affordancescijat
 

More from cijat (7)

Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour MethodsLearning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
Learning Kinematics from direct Self-Observation using Nearest-Neighbour Methods
 
Toward Optimal Configuration Space Sampling
Toward Optimal Configuration Space SamplingToward Optimal Configuration Space Sampling
Toward Optimal Configuration Space Sampling
 
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State EstimationCRF-Filters: Discriminative Particle Filters for Sequential State Estimation
CRF-Filters: Discriminative Particle Filters for Sequential State Estimation
 
RoboCup Introduction
RoboCup IntroductionRoboCup Introduction
RoboCup Introduction
 
Local and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic PlasticityLocal and Global Gating of Synaptic Plasticity
Local and Global Gating of Synaptic Plasticity
 
Auxiliary
AuxiliaryAuxiliary
Auxiliary
 
Affordances
AffordancesAffordances
Affordances
 

Recently uploaded

Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DaySri Ambati
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 

Recently uploaded (20)

Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo DayH2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
H2O.ai CEO/Founder: Sri Ambati Keynote at Wells Fargo Day
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024Designing IA for AI - Information Architecture Conference 2024
Designing IA for AI - Information Architecture Conference 2024
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 

How Do Balls Look Like

  • 1. A B I N J O: U C  L  C R  I Hannes Schulz, Hauke Strasdat, and Sven Behnke University of Freiburg Institute of Computer Science Nov 29, 2007
  • 2. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small,
  • 3. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects
  • 4. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects is the most important object on the field: You cannot play sensibly without knowing its position
  • 5. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects is the most important object on the field: You cannot play sensibly without knowing its position We should put a lot of effort into finding the single real ball.
  • 6. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 7. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 8. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L?
  • 9. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? T E C
  • 10. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? L C
  • 11. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? M B
  • 12. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? C W L
  • 13. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? C R
  • 14. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L?
  • 15. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? H  F
  • 16. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? O O
  • 17. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? O O
  • 18. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? F
  • 19. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? F
  • 20. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 21. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S
  • 22. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S Two ellipses for “orange” Actual ball color Wider, brownish color
  • 23. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S Two ellipses for “orange” Actual ball color Wider, brownish color Allows for motion blur
  • 24. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange YUV Camera Image (-candidate) white green 64 : 1
  • 25. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I 1. Find Maximum 2. Find Weighted Mean orange (-candidate) white green 64 : 1
  • 26. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange cut corresponding area (-candidate) white green 64 : 1
  • 27. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange cut corresponding area (-candidate) white Box size depends on position in image green 64 : 1
  • 28. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 29. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C
  • 30. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C Projection changes with ellipses: Robust to changes in lighting conditions
  • 31. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C Projection changes with ellipses: Robust to changes in lighting conditions
  • 32. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  L YUV-Image Y-Image Subsampled Y-Image Subtraction of mean: Robust to changes in lighting conditions
  • 33. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F
  • 34. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F
  • 35. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F - - + - - - - + - -
  • 36. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments N N C 1: Ball 0: No Ball - - + - -
  • 37. O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • 38. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – T H 520 MHz ARM PocketPC VGA HTC Camera D S 160 balls 440 non-balls divided randomly in training set (80%) and test set (20%)
  • 39. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – T H 520 MHz ARM PocketPC VGA HTC Camera D S 160 balls 440 non-balls divided randomly in training set (80%) and test set (20%) P (T S) 100% of distractors classified correctly 1 ball out of 32 not recognized
  • 40. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – R T H 520 MHz ARM PocketPC VGA HTC Camera R T T Robot decides autonomously which object to approach.
  • 41. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 H 1.33 GHz PC WVGA µEye Camera
  • 42. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 S D D S 273 balls 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions
  • 43. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 A S D S Avg Luminance 273 balls ball non-ball 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions Avg Orange-Greenness ball non-ball
  • 44. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 A S D S Avg Luminance 273 balls ball non-ball 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions Avg Orange-Greenness R  T S ball non-ball 91.1% accuracy 76.6% if stimuli flipped up/down. Drop suggests dependency on gradient. 88.2% if lighting in testset differs. Classifier seems indifferent.
  • 45. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  C Classifier Task Neural Net Linear Classifier KNN (k = 5) Regular 91.1% 86.5% 88.5% Flipped 74.0% 70.0% 76.6%
  • 46. Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C The ball has properties aside from being orange These properties are exploited by our Neural Network Classifiers Changes in Lighting conditions can be dealt with by projection to lines in YUV-space and Luminance. The method introduced here can be generalized to other small-sized objects on the field.