The ball is not just orange.
Upcoming SlideShare
Loading in...5
×
 

The ball is not just orange.

on

  • 1,702 views

How to find balls in images of a moving humanoid robot using neural networks.

How to find balls in images of a moving humanoid robot using neural networks.
Talk from RoboCup Workshop 07 in Pittsburgh.

Statistics

Views

Total Views
1,702
Views on SlideShare
1,505
Embed Views
197

Actions

Likes
0
Downloads
7
Comments
0

6 Embeds 197

http://www.hannes-schulz.de 107
http://hannes-schulz.de 74
http://www.lachnuss-zehn.de 10
http://www.slideee.com 4
http://www.slideshare.net 1
http://translate.googleusercontent.com 1

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

The ball is not just orange. The ball is not just orange. Presentation Transcript

  • A B I N J O: U C  L  C R  I Hannes Schulz, Hauke Strasdat, and Sven Behnke University of Freiburg Institute of Computer Science Nov 29, 2007
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small,
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects is the most important object on the field: You cannot play sensibly without knowing its position
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments M The ball is small, is easy to confuse with other objects is the most important object on the field: You cannot play sensibly without knowing its position We should put a lot of effort into finding the single real ball.
  • O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L?
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? T E C
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? L C
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? M B
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? C W L
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D B L L? C R
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L?
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? H  F
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? O O
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? O O
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? F
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H D N-B L L? F
  • O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S Two ellipses for “orange” Actual ball color Wider, brownish color
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  E  YUV S Two ellipses for “orange” Actual ball color Wider, brownish color Allows for motion blur
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange YUV Camera Image (-candidate) white green 64 : 1
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I 1. Find Maximum 2. Find Weighted Mean orange (-candidate) white green 64 : 1
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange cut corresponding area (-candidate) white green 64 : 1
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments S  C I orange cut corresponding area (-candidate) white Box size depends on position in image green 64 : 1
  • O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C Projection changes with ellipses: Robust to changes in lighting conditions
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  C Projection changes with ellipses: Robust to changes in lighting conditions
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments P  L YUV-Image Y-Image Subsampled Y-Image Subtraction of mean: Robust to changes in lighting conditions
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments H L F - - + - - - - + - -
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments N N C 1: Ball 0: No Ball - - + - -
  • O 1 I  B  N-B 2 F B C 3 C  B C 4 E
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – T H 520 MHz ARM PocketPC VGA HTC Camera D S 160 balls 440 non-balls divided randomly in training set (80%) and test set (20%)
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – T H 520 MHz ARM PocketPC VGA HTC Camera D S 160 balls 440 non-balls divided randomly in training set (80%) and test set (20%) P (T S) 100% of distractors classified correctly 1 ball out of 32 not recognized
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 06 – R T H 520 MHz ARM PocketPC VGA HTC Camera R T T Robot decides autonomously which object to approach.
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 H 1.33 GHz PC WVGA µEye Camera
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 S D D S 273 balls 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 A S D S Avg Luminance 273 balls ball non-ball 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions Avg Orange-Greenness ball non-ball
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments NR KS 2007 A S D S Avg Luminance 273 balls ball non-ball 548 non-balls training set 62%, validation set 13%, test set 25% varying lighting conditions Avg Orange-Greenness R  T S ball non-ball 91.1% accuracy 76.6% if stimuli flipped up/down. Drop suggests dependency on gradient. 88.2% if lighting in testset differs. Classifier seems indifferent.
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C  C Classifier Task Neural Net Linear Classifier KNN (k = 5) Regular 91.1% 86.5% 88.5% Flipped 74.0% 70.0% 76.6%
  • Balls and Non-Balls Finding Ball Candidates Classification of Ball Candidates Experiments C The ball has properties aside from being orange These properties are exploited by our Neural Network Classifiers Changes in Lighting conditions can be dealt with by projection to lines in YUV-space and Luminance. The method introduced here can be generalized to other small-sized objects on the field.