Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
We behave effectively with respect to the world.  What makes that possible?
 
 
 
1 2 3 4
 
 
 
 
 
 
 
 
Problem : the world is at some remove.  How do we achieve  action at a distance ? We behave effectively with respect to th...
Phenomena What kinds of properties of the world are perceived? Philosophy What kinds of properties and theoretical assumpt...
Phenomena What kinds of properties are perceived? Problem : the world is at some remove.  How do we achieve  action at a d...
<ul><li>Ancient notions…  (500 B.C. to 1000 A.D.) </li></ul><ul><li>eyes receive  facsimiles  of objects </li></ul>Indirec...
The image is ambiguous, impoverished.  (1) It doesn’t match the world. (2) It doesn’t match our experience. E nvironment  ...
What gets linked? What do you need to fix the bad link?  Experience    Knowledge: Empiricism 3 Old Guys who set the conce...
1. Berkeley (1700s)  Eventually, visual image    memories of motions    idea of distance. <ul><li>touch is the rationali...
worries about physiology & its psychological counterpart 2. Müller (1826) <ul><li>Sensory receptors </li></ul><ul><li>Are ...
Müller’s Theory of Specific Nerve Energies    impose their own characteristics— “specific nerve energies”—on the mind.  ...
S P  must be interpreted re: what is normal <ul><li>What would  normally  have produced these features? </li></ul><ul><li>...
Normalcy is embodied in internal  algorithms   or rules. cues + rules =  Unconscious Inference The input is a disjointed, ...
The Perceptual Process: Attended Stimulus Environmental Stimulus Action Stimulus on the receptors Transduction Processing ...
Berkeley:  coupling of percepts uses meaningfulness of one to explain another Müller:  the sensory apparatus itself contri...
The nature of E    S influences the nature of S    P    currency is converted into    currency:  How does physical ene...
Energy     Sensation     Experience Energy   Sensation E    S Physical   Psychological        Perceive event (  ...
Anticipated by Weber (mid-late 1800s) If the amount of energy is too small, it’s not noticeable. Psychophysics  looks at t...
Trial 1 Trial 2 No No No No No No Yes Yes Yes Yes Yes Yes Yes Yes Yes No Intensity (I) Determining the Absolute threshold:...
Anticipated by Weber (mid-late 1800s) If change in amount of energy is too small, it’s not noticeable. Psychophysics  look...
J ust  N oticeable  D ifference  (JND)  I  sensed is not absolute!!  Rather, the  JND  is a constant threshold. Differenc...
Consider what happens when we use different values of intensity (I) 100 +  2  =  102  2/100  =  1/50 (.02) 200 +  4  =  20...
 I = 20 The correspondence between a physical stimulus and our perception of it is systematic but it is not always 1:1. I...
Weber’s goal was to study jnd s ;   Fechner’s insight was that such a quantification allows you to  probe mental states . ...
0  1000  2000  3000 Stimulus Intensity 300 200 100 10 Standard = 100 Response = 160 Response = 130 Response = 200 Response...
Subjective intensity of magnitide (  )  is some constant multiplied by the  intensity (I) to some power (n). Stimulus Int...
Implicit Metatheory:  To say there is a absolute or noticeable threshold is to say that there are un-noticeable things. To...
Assumes the some    currency has some    currency May not be 1:1, but we must therefore  understand: Understanding these...
Understanding these things might help in understanding the processes of perception. Lets start with vision… <ul><li>The  p...
Light:  The stimulus for vision Electromagnetic radiation structured in  waves * over space distance energy amplitude = In...
Wavelength: most relevant for color vision… Complexity or Purity Different wavelengths hue multiple of wavelength saturati...
How is light structured? <ul><li>Light travels far </li></ul><ul><li>we can know about far objects  </li></ul><ul><li>Ligh...
Camera Obscura  (Alhazen) Limitation :  Doesn’t let in much light—blurry image Problem :  Spatial ordering of rays reflect...
Limitation :  Clear focus depends on the  power   of the lens and  angle of divergence  of light rays. Problem :  Spatial ...
Limitation :  Clear focus depends on the  power   of the lens and  angle of divergence  of light rays. Problem :  Spatial ...
… of objects at varying distances. Problem :  Spatial ordering of rays reflected from the object have to be recovered from...
The eye as a chamber for capturing light Optical parts Structures for gathering and  focusing  light What properties shoul...
Retinal Image is Starting Point for Vision … and we have two Visual Fields defined relative to fixation  x : L VF  project...
Retinal Image is Starting Point for Vision … and we have two Visual Fields defined relative to fixation  x : R VF  project...
<ul><li>Philosophy :  Begin with objective physical properties </li></ul><ul><li>Physics :  Intensity, wavelength of refle...
Before we had techniques to see cells, we had behavioral data: Go from bright light into dark room—can’t see at first Impr...
Location, number, connections differ. <ul><li>across  periphery </li></ul><ul><li>fovea  only has cones </li></ul>Blindspo...
Return to dark adaptation curves for hints very little light required more light required Differ in Sensitivity 2 weak sig...
How a pattern is experienced depends on where it projects on the retina Is there a cost to pooling signals? Is there a ben...
<ul><li>mosaic of receptors breaks up continuity of world </li></ul>Array of ≈ 130,000,000 photoreceptors converts the ret...
<ul><li>mosaic of receptors breaks up continuity of world </li></ul>Array of ≈ 130,000,000 photoreceptors converts the ret...
Ganglia respond to receptors, not to light (register  differences  in light) Examine the language of ganglia:  action pote...
Without stimulus there is a base level of  spontaneous  activity .  Task: Find the region on the retina whose stimulation ...
Spontaneous firing rate is affected up or down concentric   ON/OFF  regions  Ganglion cell’s  receptive field (a collectio...
How does  Center/Surround  organization work? <ul><li>Uniform illumination on region    modest activity </li></ul><ul><li...
Dark edges over OFF surround with light on ON center  vigorous response: whole receptive field is getting its preferred s...
Consequences of antagonistic relationship between center and surround same    response to dif.    intensities dif.    r...
From what we know about acuity, how should size vary in different areas of the retina?  large in periphery;  small near f...
Acuity : smallest high contrast detail perceived  at a given distance Receptive fields have consequences for the kinds of ...
Note disparities between    and   made possible by  lateral inhibition   —  mechanism that highlights edges through side...
 
 
Mach bands —regions of heightened and reduced brightnesses.
Intensity  changes in stepwise fashion activity w/NO neighbor:  40  40  40  40  100  100  100  100 Inhibition from Left:  ...
<ul><li>Mach bands do not exist  physically  wouldn’t be picked up by a photometer </li></ul><ul><li>Physiology imposes i...
A LEFT   looks darker  than A RIGHT Initial “strength” of signals (registered by rods) A LEFT  = A RIGHT B LEFT  > B RIGHT...
<ul><li>ganglia pool information , change from what is given   </li></ul><ul><li> copies  (which are  inadequate ) </li>...
sends excitatory signal when stimulated sends inhibitory signal when stimulated front view <ul><li>many:1 with later cells...
Receptive fields care about size & shape… … but not orientation. Orientation influences what objects mean    Pool some mo...
Receptive fields overlap Across a collection of receptive fields, orientation matters  Collection reports to  cells in the...
stimuli must be positioned appropriately maximal response to stimuli of a particular orientation ±15°. Simple cells recept...
Complex and Hypercomplex cells   Some cells prefer movement of those features in a particular direction <ul><li>don’t care...
Are Cortical Cells Feature Detectors? Rate of firing is the only vocabulary—how is ambiguity resolved? Reduced response if...
<ul><li>Multiple representations   (> 100,000,000 cortical cells) of the retina and visual field </li></ul><ul><li>Each co...
<ul><li>What kinds of images does the eye produce? </li></ul><ul><li>   which  qualitative  properties are preserved, los...
<ul><li>Reality question is emphasized in color perception. </li></ul><ul><li>Objects  have no color.  </li></ul><ul><li>R...
Color is totally  subjective <ul><li>Light rays, paints, filters, etc. merely  use   radiant energy  selectively. </li></u...
White light decomposed into  s p e c t r a l   c o m p o n e n t s    refracted  by a prism and split into rays of differ...
Complexity or Purity Different wavelengths hue multiple of wavelength saturation brightness Different intensities Amplitud...
How do we respond to different kinds of light?  Pure #1 + Pure #2 = Composite <ul><li>   equivalence is due to nervous sy...
 : wavelength       : hue  You can add pure colors and get one that’s not a spectral color    no characteristic wavele...
Other  experiences  suggest organizations more elaborate than a circle  : intensity       :  brightness What happens wh...
Colors on opposite sides    gray Broadest portion appears at medium lightness. Any cross-section   color wheel for a par...
<ul><li>Phenomenological observations:  </li></ul><ul><li>the color solid, metamers, complementary colors </li></ul><ul><l...
Young:  3 specialized cones   each acts as a channel responsive to specific spectral composition.  Retina as mosaic of  in...
Trichromatic theory not the whole story Color afterimages Color blindness comes in pairs
 
 
Trichromatic theory not the whole story Color afterimages complementary colors: R - G  &  B - Y Color blindness comes in p...
Opponent Process Theory:  Perhaps outputs of cones are re-coded somewhere into pairs whose members are antagonists (Hurvic...
Opponent  Organization <ul><li>Hue  determined by relative activity of  R - G  and  B - Y ;  </li></ul><ul><li>lightness  ...
DESIGN OF RETINA TO OPTIC NERVE To Brain light optic nerve fovea retina RODS CONES BIPOLARS GANGLIONS LIGHT LIGHT
A NEURAL SYSTEM OF OPPONENT PROCESSES IF  + > – , THEN “BLUE” IF  – > + ,   THEN “YELLOW” IF  + > – , THEN “RED” IF  – > +...
Wavelength info at retinal level;   feed into opponency Fits into the overall theme of the perceptual system missing physi...
Edges are a specialty of the visual system. Specialty  implicates a mechanism for perceiving separable objects.  • Neuroph...
How do I know that this pattern is a hand? Examples of types of representations and types of computations Analysis must pr...
Keep track of vertex-connected surfaces    eliminate those that are inconsistent For complicated—natural—scenes, occlusio...
Different neural activity = different forms… HOWEVER…  Form (object) recognition  still presupposes a solution…an internal...
<ul><li>A cross … But why? </li></ul><ul><li>Perception is  not  simple addition of elements  </li></ul><ul><li>“ Crossnes...
Grouping or organization  is not in the stimulus . <ul><li>Seen as 3 pairs of lines </li></ul><ul><li>S P  does not dictat...
What counts as a  form or grouping  distinct from a  background? In general,  Simplicity 3-D or 2-D?
What is the figure can be complicated Ambiguous Figures:   For same  S D  and same  S P ,  two percepts  are possible How ...
Of the alternatives allowed by the proximal stimulus… infer the more likely. The  Helmholtzian  Solution: Use   knowledge ...
Structuralists  emphasized  identifying primitives   as   adding or associating sensations… theirs were too subjective, to...
Pattern recognition = ƒ(distance, size, shape) How do we know both  relative distance  and  absolute distance? Back to Hel...
<ul><li>S P  was  probably  caused by a particular S D </li></ul>II. Attempts to simulate depth:  pictorial cues I. Berkel...
III. 2 eyes that receive slightly different views:    binocular disparity Left thumb behind, Right thumb in front; Both f...
Motion Based Cue for Depth: Ever look out the window while riding in a car? Direction of Travel Objects in the foreground ...
Size Perception But there’s ambiguity… II. Familiar Size     pumpkins are larger than apples…  <ul><li>except for small p...
Knowledge  is needed to make sense of ambiguous cues to attribute the proper cause to your S P .  Helmholtz’s Unconscious ...
Size Perceived  = ƒ( RI Size , Distance Perceived ) Tested by  Holway & Boring (1941) <ul><li>2 hallways: </li></ul><ul><l...
Manipulate available  cues to distance  and assess effect on  perceived  size : <ul><li>fewer cues to distance  more re...
<ul><li>Helmholtz  </li></ul><ul><li>S P  is bad (   shows it) </li></ul><ul><li>Perception good (experience shows it) <...
<ul><li>Rule: RI size decreases with D. So… </li></ul><ul><li>If  A  &  B  project same size S P </li></ul><ul><li>And if ...
S P1  ≠  S P2 Percept @ p1   =  Percept @ p2 Shape Constancy Ex. II. Perceived Shape is unaffected by perspective p1 p2
Appearance is affected by interpretation! Parallelograms look similar in size and shape (one is rotation of other) Shape P...
Fixing S P  is logically prior to  pattern recognition . What form is it?  Fundamental problem is  normalization  of image...
Motion Perception Perception Apparent (Stroboscopic) Movement Do we see things as they are because of the proximal stimulu...
Interpret with respect to  likelihoods . Apparent motion of the disk  induced  by  assumption  that enclosures don’t move....
BUT… Helmholtzian account:   compare RI with commands to muscles  Did I tell myself to move? <ul><li>ambiguity if I’m bei...
Form Perception    Motion Perception <ul><li>Sequence of static RI </li></ul><ul><li>   infer motion </li></ul><ul><li>x...
Shortest-Path Constraint … simplicity again!!!
Themes from the Overview <ul><li>Phenomena:  What kinds of properties are perceived? </li></ul><ul><li>Physics:  What kind...
The Phenomena of  ATTENTION:   Orienting What is the girl feeling…emotion? What is the information for making these judgme...
The Phenomena of  ATTENTION:   Search for the letter ‘c’ 8 8 8 8 8 8 s c z k e t 8 8 8 8 8 8 s k z c f t e s c z k e t s k...
The Phenomena of  ATTENTION:   Goal Directed – Intentional/Change Blindness Does the number of white T-shirt players chang...
Movie
The Phenomena of  ATTENTION:   Selective Listening WHAT IS KNOWN ABOUT UNATTENDED? Only physical characteristics (speech l...
Indirect Perspective of Perception Assumes: Both relinquish the responsibility of perception to an “internal”, “mental”, k...
Upcoming SlideShare
Loading in …5
×

Psyc230 lecture slides_firsthalfofcourse

572 views

Published on

refuses to upload to Google docs. "Too many objects"

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

Psyc230 lecture slides_firsthalfofcourse

  1. 1. We behave effectively with respect to the world. What makes that possible?
  2. 5. 1 2 3 4
  3. 14. Problem : the world is at some remove. How do we achieve action at a distance ? We behave effectively with respect to the world. What makes that possible? What are the mechanisms that allow perceptual agents to achieve action at a distance?
  4. 15. Phenomena What kinds of properties of the world are perceived? Philosophy What kinds of properties and theoretical assumptions should anchor our theory of perception? Physics What kinds of properties are present or “recorded” in the energy media of the world? Physiology What kinds of properties can sense organs and nerve cells “record” and how doe these sense organs influence the perception? What do we have to understand to understand the mechanisms of perception?
  5. 16. Phenomena What kinds of properties are perceived? Problem : the world is at some remove. How do we achieve action at a distance ? Themes from the Overview We behave effectively with respect to the world. What makes that possible? Philosophy What kinds of properties/assumptions should anchor our theory? Physics What kinds of properties are present or “recorded” in the energy media? Physiology What kinds of properties can sense organs and nerve cells “record”?
  6. 17. <ul><li>Ancient notions… (500 B.C. to 1000 A.D.) </li></ul><ul><li>eyes receive facsimiles of objects </li></ul>Indirect Realism We know the world through intermediaries  eye is a chamber that captures images <ul><li>… persist in modern view </li></ul><ul><li>copies stand between us and the world </li></ul><ul><li> eye as camera </li></ul><ul><li>disconnected sensations get connected higher up </li></ul><ul><li>light rays hit eye as pointillistic mosaic </li></ul>
  7. 18. The image is ambiguous, impoverished. (1) It doesn’t match the world. (2) It doesn’t match our experience. E nvironment  O rganism link is bad therefore… Perception requires processes to elaborate input, constructing a series of representations of the world that increasingly come to resemble it. Examine the E  O link How good are the images? Molyneux’s Premise (1692): distance is not perceivable by eye A B C D A B C D
  8. 19. What gets linked? What do you need to fix the bad link? Experience  Knowledge: Empiricism 3 Old Guys who set the conceptual agenda An object in the world at some distance from me that goads me or stimulates me to act: distal stimulus or S D The pattern at a sense organ caused by an energy pattern in the world: proximal stimulus or S P
  9. 20. 1. Berkeley (1700s) Eventually, visual image  memories of motions  idea of distance. <ul><li>touch is the rationalizer </li></ul><ul><li>direct contact with the world </li></ul><ul><li>not susceptible to the loss of structure </li></ul><ul><li>can help out those senses that are susceptible </li></ul><ul><li> muscular feelings can help fix defects in visual image once I learn which images co-occur with which feelings . </li></ul>extended arm grasps bottle contract arm— image expands 45˚ 90˚
  10. 21. worries about physiology & its psychological counterpart 2. Müller (1826) <ul><li>Sensory receptors </li></ul><ul><li>Are stimulated by energy (light, sound, pressure) </li></ul><ul><li>But not mere conductors of those properties </li></ul>Emphasizes the contribution of anatomy & physiology
  11. 22. Müller’s Theory of Specific Nerve Energies  impose their own characteristics— “specific nerve energies”—on the mind.  This, not the physical properties themselves, is why the qualities for the different senses are different. ELECTRIC PULSE PRESSURE CHEMICALS Visual sensation OPTIC NERVE LIGHT Eye designed to capture light SOUND AUDITORY NERVES Auditory sensation Ear designed to capture sound
  12. 23. S P must be interpreted re: what is normal <ul><li>What would normally have produced these features? </li></ul><ul><li>What goes with what? </li></ul>3. Helmholtz (1821-1894): THE MAJOR FIGURE S D  S P patchwork of sensations Helmholtz’s Theory of Unconscious Inference S P is converted to sensations —a mental response to energy ( direct ) Sensations that habitually occur together become linked through memory— associations . object
  13. 24. Normalcy is embodied in internal algorithms or rules. cues + rules = Unconscious Inference The input is a disjointed, inadequate copy of the world. Perception works by improving the copy via rules. Perception of the world is indirect .
  14. 25. The Perceptual Process: Attended Stimulus Environmental Stimulus Action Stimulus on the receptors Transduction Processing Perception Recognition Stimulus Perception Stimulus Energy Sensation Physiological sensation Perception Three key relationships Knowledge cues & rules Unconscious Inference
  15. 26. Berkeley: coupling of percepts uses meaningfulness of one to explain another Müller: the sensory apparatus itself contributes its character to the input Helmholtz: mental computations reflect internalized knowledge of the world and how it affects us. The nature of E  S influences the nature of S  P All share the theory of inadequate input  currency is converted into  currency: How does physical energy map onto psychological experience? Measurement is the key to making perceptual psychology a science World Energy Sensations Perception ignored link historically important links
  16. 27. The nature of E  S influences the nature of S  P  currency is converted into  currency: How does physical energy map onto psychological experience? Measurement is the key to making perceptual psychology a science World Energy Sensations Perception ignored link historically important links
  17. 28. Energy  Sensation  Experience Energy  Sensation E  S Physical  Psychological    Perceive event (  cat rubbing leg ) Event in world Pressure (  energy ) Sense properties of pressure (  ) e.g. amount, location. Pressure sensitive nerves Energy  Sensation Psychophysics
  18. 29. Anticipated by Weber (mid-late 1800s) If the amount of energy is too small, it’s not noticeable. Psychophysics looks at the E  S link minimum energy that can just be detected Say “now” when you see the gray square. Absolute threshold
  19. 30. Trial 1 Trial 2 No No No No No No Yes Yes Yes Yes Yes Yes Yes Yes Yes No Intensity (I) Determining the Absolute threshold: Method of Limits Trial 5 No No No No Yes Trial 3 No No No No No Yes Trial 4 No Yes Yes Yes Trial 6 Yes Yes Yes Yes Yes Yes No 3 4 5 6 7 8 9 10 2 1 11 12 0 6 5 4 1 3 2 Trial Smallest Intensity Detected 6 5 7 6 7 5 Absolute threshold Mean 6 6
  20. 31. Anticipated by Weber (mid-late 1800s) If change in amount of energy is too small, it’s not noticeable. Psychophysics looks at the E  S link Weber’s focus was on discriminating two detectable stimuli: How similar could they be and still be sensed as different? Not absolute change but relative change J ust N oticeable D ifference  I / I = K A change in intensity relative to the initial intensity equals a constant. – =
  21. 32. J ust N oticeable D ifference (JND)  I sensed is not absolute!! Rather, the JND is a constant threshold. Difference Thresholds: How similar can objects be and still be sensed as different? I2 I1 102 g 100 g I2 - I1 =  I I : physical intensity I2 I1 101 g 100 g Same
  22. 33. Consider what happens when we use different values of intensity (I) 100 + 2 = 102 2/100 = 1/50 (.02) 200 + 4 = 204 4/200 = 1/50 (.02) 400 + 8 = 408 8/400 = 1/50 (.02) The greater the value of I the greater must be the value of  I for a difference to be sensed. JND’s for all senses: - Vision (e.g. change in brightness) - Hearing (e.g. change in loudness) WEBER’S LAW: = K (a constant)  I I Intensity I JND I +  I  I I Change in I  I K
  23. 34.  I = 20 The correspondence between a physical stimulus and our perception of it is systematic but it is not always 1:1. I = 500  I = 500 smaller K  more sensitive lower threshold K = 1 I = 20 I = 1000  I = 500 K = .5 I = 20  I = 10  I / I = K 1st truly quantitative law of psychology Fechner (mid-late 1800s)  I I  I I .2 .5 1 Slope
  24. 35. Weber’s goal was to study jnd s ; Fechner’s insight was that such a quantification allows you to probe mental states . Fechner (mid-late 1800s) Demonstrated how mental activity could be measured quantitatively!! … also started to examine whether we can assume a  equivalence of changes in intensity of stimulation? Steven’s attempted to understand the relationships between  and intensity in his examination of Magnitude estimation.
  25. 36. 0 1000 2000 3000 Stimulus Intensity 300 200 100 10 Standard = 100 Response = 160 Response = 130 Response = 200 Response = 25 Response = 50 T1 T2 T3 T4 T5 Response = 150 Response = 225 Response = 350 Response = 90 Response = 95 300 200 100 10 0 1000 2000 3000 Stimulus Intensity T1 T2 T3 T4 T5 Standard = 100
  26. 37. Subjective intensity of magnitide (  ) is some constant multiplied by the intensity (I) to some power (n). Stimulus Intensity Magnitude Estimate n = the slope of the line in the log-log plot Perceptual Sense reflects Power Law Functions Log Stimulus Intensity Log Magnitude Estimate  = kI n
  27. 38. Implicit Metatheory: To say there is a absolute or noticeable threshold is to say that there are un-noticeable things. To say there is a just noticeable difference is to say that there are also un-noticeable differences. To say the perception is power law like is to say that the… Connection between mind & body is in the quantitative relation between mental sensation & material stimulus  I/I = k and  = kI n highlight slippage between  &  (not 1:1). How do you measure the change in stimulation? You need methods… … that yield quantities that can be put into law form Fechner formally developed Psychophysics as the methodology, a methodology that endorses a metatheory
  28. 39. Assumes the some  currency has some  currency May not be 1:1, but we must therefore understand: Understanding these things might help in understanding the processes of perception. Lets start with vision… Psychophysics looks at the E  S link <ul><li>The physics of different energy medium, </li></ul><ul><li>How the physiology is designed to transduce this energy and… </li></ul><ul><li>3. How his transduction maps onto sensory and psychological experience? </li></ul>
  29. 40. Understanding these things might help in understanding the processes of perception. Lets start with vision… <ul><li>The physics of different energy medium, </li></ul><ul><li>How the physiology is designed to transduce this energy and… </li></ul><ul><li>3. How this transduction maps onto sensory and psychological experience? </li></ul> currency is converted into  currency: How does physical energy map onto psychological experience? World Energy Sensations Perception Assumes the some  currency has some  currency May not be 1:1, but we must therefore understand: Psychophysics looks at the E  S link
  30. 41. Light: The stimulus for vision Electromagnetic radiation structured in waves * over space distance energy amplitude = Intensity Wavelength same amplitude different wavelengths multiple wavelengths (vs. pure) same wavelength different amplitude
  31. 42. Wavelength: most relevant for color vision… Complexity or Purity Different wavelengths hue multiple of wavelength saturation brightness Different intensities Amplitude ≈ Intensity Wavelength
  32. 43. How is light structured? <ul><li>Light travels far </li></ul><ul><li>we can know about far objects </li></ul><ul><li>Light travels fast </li></ul><ul><li>we can know them immediately </li></ul><ul><li>Light travels straight </li></ul><ul><li>good for image-production </li></ul>Why light? Vision as a distance sense The eye captures light reflected from objects and forms an image on the back of the eye. How “should” the image be formed? surfaces, substances source Some light gets to eye reflected scattered absorbed
  33. 44. Camera Obscura (Alhazen) Limitation : Doesn’t let in much light—blurry image Problem : Spatial ordering of rays reflected from the object have to be recovered from the divergent light. box with a pinhole as the eye Solution #1 : Allow one ray from each part of the object into the eye.
  34. 45. Limitation : Clear focus depends on the power of the lens and angle of divergence of light rays. Problem : Spatial ordering of rays reflected from the object have to be recovered from the divergent light. … while letting in enough light for a clear image. Allows larger hole  more light  sharper image Solution #2 : Use a lens that refracts light so that rays from the same point on the object converge .
  35. 46. Limitation : Clear focus depends on the power of the lens and angle of divergence of light rays. Problem : Spatial ordering of rays reflected from the object have to be recovered from the divergent light … while letting in enough light for a clear image. Different distance of object from eye  changes angle of light rays  Out of focus for that lens. Solution #2 : Use a lens that refracts light so that rays from the same point on the object converge .
  36. 47. … of objects at varying distances. Problem : Spatial ordering of rays reflected from the object have to be recovered from the divergent light …while letting in enough light for a clear image Solution #3 : Lens with variable optical power changes shape to accom- modate the distance of the object to the size of the eye.
  37. 48. The eye as a chamber for capturing light Optical parts Structures for gathering and focusing light What properties should the eye have? Translating parts Structures for copying light and sending signals <ul><li>Light is focused on light-sensitive photoreceptors of retina that convert or transduce physical energy into neural activity </li></ul><ul><li>Lens shape can be changed to accommodate to the distance of an object for focusing on the back of the eye—the retina —centering on the fovea </li></ul><ul><li>Fluid in eye keeps its shape from changing so that focusing properties are reliable </li></ul><ul><li>Focusing-relevant features highlight the importance of the retinal image </li></ul>cornea iris lens pupil optic nerve retina fovea
  38. 49. Retinal Image is Starting Point for Vision … and we have two Visual Fields defined relative to fixation x : L VF projects to right side of each eye and on to the Right Hemisphere LVF RVF Right Visual Cortex
  39. 50. Retinal Image is Starting Point for Vision … and we have two Visual Fields defined relative to fixation x : R VF projects to left side of each eye and on to the Left Hemisphere Right Visual Cortex Regions of left eye correspond to regions of right eye At some point we have to (re)connect visual fields. L VF projects to right side of each eye and on to the Right Hemisphere LVF RVF Left Visual Cortex
  40. 51. <ul><li>Philosophy : Begin with objective physical properties </li></ul><ul><li>Physics : Intensity, wavelength of reflected light </li></ul><ul><li>Physiology : Brightness, color but not 1:1 </li></ul><ul><li>Phenomena : Product of mental computation </li></ul>Physics Psycho- Anatomy & Algorithms physics Physiology Goals: Get copy of world inside head Difficulty: Pointillisitic nature of light (and sensations) Solution & Problem: Eyes capture images Pervasive Themes world  energy  sensations  pattern  perception
  41. 52. Before we had techniques to see cells, we had behavioral data: Go from bright light into dark room—can’t see at first Improves for 5 min., levels off… improves again for 15–20 min. Kink in function is clue  2 functions 2 functions  2 types of photoreceptors  2 job descriptions: Transducing the image <ul><li>work in dim and bright light </li></ul><ul><li>provide sensitivity and clarity </li></ul><ul><li>work in B&W and Color </li></ul>threshold minutes in dark <ul><li>1st acts fast, adapts less. </li></ul><ul><li>2nd adapts slowly but more. </li></ul>
  42. 53. Location, number, connections differ. <ul><li>across periphery </li></ul><ul><li>fovea only has cones </li></ul>Blindspot: no receptors because the optic nerve leaves the eye. <ul><li>many:1 connections </li></ul><ul><li>1:1 connections </li></ul><ul><li>more plentiful </li></ul><ul><li>120,000,000 </li></ul><ul><li>fewer in number </li></ul><ul><li>8,000,000 </li></ul>Rods no. of receptors per square mm What are consequences? What are consequences? So does shape: rods and cones Cones
  43. 54. Return to dark adaptation curves for hints very little light required more light required Differ in Sensitivity 2 weak signals that are separate remain below threshold of next cell less sensitive 2 weak signals that are connected can exceed threshold of next cell more sensitive <ul><li>many:1 with later cells </li></ul><ul><li>1:1 with later cells </li></ul>Ø ! Ø Ø Ø minutes in dark Threshold (minimal visible light intensity) Ø Ø ganglia ganglia
  44. 55. How a pattern is experienced depends on where it projects on the retina Is there a cost to pooling signals? Is there a benefit to keeping signals separate? detail is missed: less acuity detail is noticed: greater acuity
  45. 56. <ul><li>mosaic of receptors breaks up continuity of world </li></ul>Array of ≈ 130,000,000 photoreceptors converts the retinal image into a neural image to be transmitted to the brain. But… How good is mapping between world and experience? Which of these problems get fixed higher up? How are they fixed? <ul><li>image is upside down </li></ul><ul><li>different parts of retina have different sensitivities </li></ul>
  46. 57. <ul><li>mosaic of receptors breaks up continuity of world </li></ul>Array of ≈ 130,000,000 photoreceptors converts the retinal image into a neural image to be transmitted to the brain. But… Receptors outnumber cells in the next layer  pooling of information, editing, altering before signals are passed along How good is mapping between world and experience? Which of these problems get fixed higher up? How are they fixed? mechanisms rules <ul><li>image is upside down </li></ul><ul><li>different parts of retina have different sensitivities </li></ul>
  47. 58. Ganglia respond to receptors, not to light (register differences in light) Examine the language of ganglia: action potentials All or None Cells beyond receptors condense and reorganize data <ul><li>130,000,000 receptors  1,000,000 ganglia </li></ul><ul><li>many, many rods : 1 ganglion ; 1 (or a few) cones : 1 ganglion </li></ul><ul><li> a lot of editing </li></ul>What kind? What kind of stimulus does a ganglion prefer? Use single cell recording with electrodes <ul><li>a still eye to keep stimulus where you want it. </li></ul><ul><li>stimulate various areas of the retina </li></ul><ul><li> see effect on a particular ganglion. </li></ul> reveals editing oscilloscope amplifier microelectrode time (sec) voltage
  48. 59. Without stimulus there is a base level of spontaneous activity . Task: Find the region on the retina whose stimulation will change the resting level (higher or lower) of Ganglion “A”. How: Scan retina with stimulus to see where ganglion’s activity is affected ( where matters ) Homogeneous gray  spontaneous activity. Spot of light  greater than spontaneous activity Dark spot in area  less than spontaneous activity Within area  greater than spontaneous activity Outside area  less than spontaneous activity
  49. 60. Spontaneous firing rate is affected up or down concentric ON/OFF regions Ganglion cell’s receptive field (a collection of retinal cells) What happens with light outside the ON/OFF region? What is experienced depends on where it hits retina Assessing various ganglia yields a receptive field map  overlap, producing a mosaic covering the whole retina (also OFF center/ON surround cells) “ ON” response “ OFF” response Distribution of concentric ON/OFF regions arises from connections among preganglion collectors spontaneous rate excited rate inhibited rate spontaneous rate
  50. 61. How does Center/Surround organization work? <ul><li>Uniform illumination on region  modest activity </li></ul><ul><li>ON center “prefers” light; surrounding OFF circle “prefers” dark </li></ul>antagonistic responses from center and surround lateral inhibition patch of light over entire field patch of dark over entire field Increased activation from ON center countered by decreased activation from OFF surround. Decreased activation from ON center countered by increased activation from OFF surround.
  51. 62. Dark edges over OFF surround with light on ON center  vigorous response: whole receptive field is getting its preferred stimulus  detects and accents light/dark boundary Edges are preferred by this kind of cell. illuminate only the center dark bar on the surround What pattern on the retina would be preferred by a Center/Surround cell?
  52. 63. Consequences of antagonistic relationship between center and surround same  response to dif.  intensities dif.  responses to the same  intensity Constancy Illusions Good mapping in a limited range? Intensity of Center Response Intensity of Center Response Intensity of Center Response   
  53. 64. From what we know about acuity, how should size vary in different areas of the retina?  large in periphery; small near fovea Many:1 vs. 1:1—Receptive fields vary in size Physiological mechanisms are recovering edge and size information  building blocks of meaning. Small receptive fields respond best to small objects; large to large  beginning of object size extraction . From what we know about preferences of receptive fields, how should they respond to objects of different sizes?
  54. 65. Acuity : smallest high contrast detail perceived at a given distance Receptive fields have consequences for the kinds of patterns that go into Unconscious Inferences. What letter is this? F E A H O D P R Identification Acuity Can you see this? Detection Acuity 1 or 2? Pattern or gray? Resolution Acuity K
  55. 66. Note disparities between  and  made possible by lateral inhibition — mechanism that highlights edges through sideways connections among cells. Illusory consequences illustrate how it works.  dependence on “irrelevant” conditions (e.g., distance) The “private line” from foveal cones to the brain provides fine detail… … but it’s neurologically expensive  receptive field organization is important
  56. 69. Mach bands —regions of heightened and reduced brightnesses.
  57. 70. Intensity changes in stepwise fashion activity w/NO neighbor: 40 40 40 40 100 100 100 100 Inhibition from Left: -2 -4 -4 -4 -4 -10 -10 -10 Inhibition from Right: -4 -4 -4 -10 -10 -10 -10 -18 Total Output: 34 32 32 26 86 80 80 72 Perceived Lightness lightness does not. Receptors (activity - inhibition) Light Intensity 1 2 3 4 5 6 Position high low Light Intensity 100 40 a b c d e f g h
  58. 71. <ul><li>Mach bands do not exist physically  wouldn’t be picked up by a photometer </li></ul><ul><li>Physiology imposes its character on the input </li></ul><ul><li>A physical contrast —a border— that does exist is accentuated </li></ul><ul><li>Machinery can be inferred from experience </li></ul> stimuli ≠ perception of those stimuli Lightness Contrast Implies interaction in connections between neighboring cells:  some signals boosted, some signals reduced  : Central squares reflect same amount of light.  : The darker the surround, the lighter they look .  : Central squares reflect same amount of light.
  59. 72. A LEFT looks darker than A RIGHT Initial “strength” of signals (registered by rods) A LEFT = A RIGHT B LEFT > B RIGHT <ul><li>excitatory or inhibitory </li></ul>Signal from B LEFT inhibits signal from A LEFT lateral inhibition B A B A If signal from B exceeds threshold of laterally connecting cells, signal from A will be reduced Signal from B RIGHT does not affect A RIGHT  Consequently, A LEFT < A RIGHT <ul><li>sideways </li></ul><ul><li>Subsequent connections </li></ul><ul><li>end-to-end </li></ul>
  60. 73. <ul><li>ganglia pool information , change from what is given </li></ul><ul><li> copies (which are inadequate ) </li></ul>Evidence for assumptions of Indirect Realism <ul><li>separate receptors , connected into receptive fields </li></ul><ul><li> disconnected sensations, mosaic </li></ul><ul><li>eye as camera , receptors as film </li></ul><ul><li> image language </li></ul>Same mechanism is destructive and constructive <ul><li>It distorts  relative to   Illusions </li></ul><ul><li>It enhances the detection of an important feature of the world  edges </li></ul>
  61. 74. sends excitatory signal when stimulated sends inhibitory signal when stimulated front view <ul><li>many:1 with later cells </li></ul><ul><li> greater sensitivity </li></ul><ul><li>1:1 or few:1 with later cells </li></ul><ul><li> greater acuity </li></ul>side view
  62. 75. Receptive fields care about size & shape… … but not orientation. Orientation influences what objects mean  Pool some more. To overcome mosaic, connect receptive fields. ” reduced rate: stimulus hits both excitatory and inhibitory cells
  63. 76. Receptive fields overlap Across a collection of receptive fields, orientation matters Collection reports to cells in the cortex . They have receptive fields too Record from 3 cortical cells Cortical cells do edge detection but more cleverly Cortical receptive field shapes are not uniform Hubel & Wiesel (1959, 1962; Nobel Prize 1981)
  64. 77. stimuli must be positioned appropriately maximal response to stimuli of a particular orientation ±15°. Simple cells receptive fields look like their preferred orientations response rate response rate
  65. 78. Complex and Hypercomplex cells Some cells prefer movement of those features in a particular direction <ul><li>don’t care about precise placement </li></ul><ul><li>larger receptive fields </li></ul><ul><li>no clear ON-OFF regions </li></ul><ul><li>prefer moving stimulus </li></ul><ul><li>combinations of features </li></ul>Measure activity in cell that prefers downward moving horizontal 3 cm line Provide some information about where, what, and what’s it doing.
  66. 79. Are Cortical Cells Feature Detectors? Rate of firing is the only vocabulary—how is ambiguity resolved? Reduced response if orientation or size or motion is not exact  which is it? More complex response is still ambiguous <ul><li>Response is ambiguous </li></ul><ul><li>Respond maximally , not exclusively, to their feature </li></ul>ambiguity at level of single cell direction orientation response rate response rate
  67. 80. <ul><li>Multiple representations (> 100,000,000 cortical cells) of the retina and visual field </li></ul><ul><li>Each cortical area performs different processing tasks , extracting specific feature </li></ul><ul><li>Integrated with other properties </li></ul><ul><li>Hierarchical organization of visual system geared for building up ever-better representations of world : simple to complex </li></ul>Activity of cell ensemble reduces ambiguity in coding
  68. 81. <ul><li>What kinds of images does the eye produce? </li></ul><ul><li> which qualitative properties are preserved, lost, distorted </li></ul>Physical Psychological light or an object detection thresholds differences in intensity, etc. jnd s , acuity Intensity, reflectance constancy, contrast different wavelengths not distinguished in dim light X-ray, infrared visible spectrum  gives us variables  builds from elements meaningless adds meaning Strategies of Indirect Realism <ul><li>Psychophysics </li></ul><ul><li> Characterize match to the world quantitatively </li></ul>
  69. 82. <ul><li>Reality question is emphasized in color perception. </li></ul><ul><li>Objects have no color. </li></ul><ul><li>Reflected light is no more colored than are radio waves! </li></ul><ul><li>To appear colored , reflected light must be picked up by the right kind of eye and nervous system . </li></ul><ul><li> Color is a psychological thing. </li></ul>Which level is real, the simple end of the hierarchy or the complex end? The  variables or the  experiences? The first representation— levels of contrast —is meaningless and must be reconstituted to get more specific and more meaningful. Is an edge real? Visual stimuli are built hierarchically  from simple to complex surface pigment shadow
  70. 83. Color is totally subjective <ul><li>Light rays, paints, filters, etc. merely use radiant energy selectively. </li></ul><ul><li>Color is a product of the visual system, not the visible spectrum. </li></ul>wavelengths, not colors produce; reflect, absorb; transmit how our retinal physiology responds
  71. 84. White light decomposed into s p e c t r a l c o m p o n e n t s  refracted by a prism and split into rays of different wavelengths.  amount of refraction determined by wavelength Newton (with some refinements) Nonetheless, color sensations are related in consistent and measurable ways to physical features of light infrared (not visible) red orange yellow green blue violet ultraviolet (not visible)
  72. 85. Complexity or Purity Different wavelengths hue multiple of wavelength saturation brightness Different intensities Amplitude ≈ Intensity Wavelength
  73. 86. How do we respond to different kinds of light? Pure #1 + Pure #2 = Composite <ul><li> equivalence is due to nervous system </li></ul><ul><li>Different  things with identical neural effects: metamers </li></ul>pure vs. composite light If Pure #1 + Pure #2 + … = White then 1 & 2 are complementary Components “cancel” or “blend” psychologically but not physically  spectral components would still be detectable to instruments. Both are white
  74. 87.  : wavelength   : hue You can add pure colors and get one that’s not a spectral color  no characteristic wavelength 530 650 Metamers tell us how to organize the optics : Complementary colors are opposites in some sense 580 460 A color circle, but… 600 O R G B Y ??? P 490 B - G G - Y 490
  75. 88. Other experiences suggest organizations more elaborate than a circle  : intensity   : brightness What happens when there is more or less light? What does the color look like? The higher the %white the less saturated a color will look. The higher the % other wavelengths, the less saturated a color will look.  : spectral purity   : saturation blue . . . heather blue . . . gray green . . . heather green . . .gray red . . . pink . . . gray Maximal at moderate intensities only
  76. 89. Colors on opposite sides  gray Broadest portion appears at medium lightness. Any cross-section  color wheel for a particular lightness Wavelength + Intensity + Purity  Color experience all colors can be obtained from a few primaries  tells us about the physiology of color perception The Color Solid brightness white black
  77. 90. <ul><li>Phenomenological observations: </li></ul><ul><li>the color solid, metamers, complementary colors </li></ul><ul><li> allow inferences about physiology </li></ul>A single wavelength is matched by different amounts of 3 primaries  indicate limits of the information senses pick up  indicate how the brain uses that information Metameric Matching : Present a target color and have observer match it with a mix of others. Would 1 cone type work? Or 1 cone per color? 3 primaries Comparison x R + y G + z B 1 wavelength Test Field C =
  78. 91. Young: 3 specialized cones each acts as a channel responsive to specific spectral composition. Retina as mosaic of independent triads of cones Light at each retinal point analyzed into 3 components <ul><li>Return to experience: </li></ul><ul><li>Why is there no reddish-green ? </li></ul><ul><li>Why is color blindness a matter of confusions ? </li></ul><ul><li> most common is red with green </li></ul><ul><li>color afterimages show same combinations </li></ul>S M L Young-Helmholtz (and Newton and Maxwell) Tri-chromatic Theory Helmholtz: 3 types of cones, each with a graded sensitivity function 100 0 400 500 600 Wavelength % of Max. Absorption What is the origin of the pairings?
  79. 92. Trichromatic theory not the whole story Color afterimages Color blindness comes in pairs
  80. 95. Trichromatic theory not the whole story Color afterimages complementary colors: R - G & B - Y Color blindness comes in pairs
  81. 96. Opponent Process Theory: Perhaps outputs of cones are re-coded somewhere into pairs whose members are antagonists (Hurvich & Jameson, 20th Century)  Y Y B R G Y Y B R G 
  82. 97. Opponent Organization <ul><li>Hue determined by relative activity of R - G and B - Y ; </li></ul><ul><li>lightness determined by activity of B - W cells; </li></ul><ul><li>saturation by which kinds of cells are most active: </li></ul><ul><li>Complementary colors cannot coexist because a pair cannot respond actively to both </li></ul><ul><li>Color deficiencies are characterized by pairs </li></ul>violet
  83. 98. DESIGN OF RETINA TO OPTIC NERVE To Brain light optic nerve fovea retina RODS CONES BIPOLARS GANGLIONS LIGHT LIGHT
  84. 99. A NEURAL SYSTEM OF OPPONENT PROCESSES IF + > – , THEN “BLUE” IF – > + , THEN “YELLOW” IF + > – , THEN “RED” IF – > + , THEN “GREEN” + – – CONES GANGLION CONES GANGLION – + + FOR BOTH OPPONENT PROCESS SYSTEMS: IF + = – , THEN “GRAY” (ACHROMATIC)
  85. 100. Wavelength info at retinal level; feed into opponency Fits into the overall theme of the perceptual system missing physical detail, restoring lost structure, making things up as it goes along. But it is also an example of the visual system getting what it needs: There is a biological advantage to seeing color. Note: We’ve really been limited to sensations . Perception is still to come. Color coding is a two-stage process. Puzzle: All this happens inside eyes and brain. How do we experience the world as outside?
  86. 101. Edges are a specialty of the visual system. Specialty implicates a mechanism for perceiving separable objects. • Neurophysiology: primitives  hierarchical combos Old theories illustrate persistent issues analytic introspection : specialized technique for observation  stimulus error: mistaking the object for experience Sensations vs. Perceptions Structuralism was a kind of mental chemistry. Elemental structures combine to build perception What does the visual system start with? What are the elements? What do you really see, without interpretation? No, really No, really No, really <ul><li>Important historically because of </li></ul><ul><li>its strategy  atomistic & anatomistic </li></ul><ul><li>reaction against it </li></ul>Bananas? 3 pointy cone shapes? angled planes, ellipse? black lines, yellow patches
  87. 102. How do I know that this pattern is a hand? Examples of types of representations and types of computations Analysis must provide components abstract enough to match stored representation. More candidate primitives <ul><li>“ geons” </li></ul><ul><li>and their relationships </li></ul><ul><li>applied to S P & to stored representation </li></ul><ul><li>Structural Description </li></ul>Or this? Or this?
  88. 103. Keep track of vertex-connected surfaces  eliminate those that are inconsistent For complicated—natural—scenes, occlusion is a problem Even if these are identified as cylinders, how do we know they are part of the same object? We need rules about what’s likely. … with what you know about objects  Given experience, assign to S P the S D that is most likely to have caused it. Overcomes problem caused by occlusion corner of front surface not always 3-D corner of one object not always
  89. 104. Different neural activity = different forms… HOWEVER… Form (object) recognition still presupposes a solution…an internal representation. Still doesn’t answer the how question. How (where) does perception occur? =
  90. 105. <ul><li>A cross … But why? </li></ul><ul><li>Perception is not simple addition of elements </li></ul><ul><li>“ Crossness” not derived from adding circles </li></ul><ul><li>Defects (e.g., gaps) in RI would be preserved in brain </li></ul>Structuralism ignored interactions in nervous system  play organizing role The Gestaltists Why do things appear as they do? Gestalt is German for whole form “ The whole is different from the sum of its parts.” Principles of Organization encourage grouping, segregation  form emerges Yes! But what are they? i. They are what they are? iii. The brain processes are what they are? ii. S P are what they are? What do you see? is 9 circles 1 S P  2 experiences
  91. 106. Grouping or organization is not in the stimulus . <ul><li>Seen as 3 pairs of lines </li></ul><ul><li>S P does not dictate that over </li></ul><ul><li>Seen as intersecting shapes </li></ul><ul><li>S P does not favor </li></ul>The Law of Proximity does <ul><li>Seen as alternating columns </li></ul><ul><li>S P does not dictate that over </li></ul>The Law of Similarity does The Law of Good Continuation does <ul><li>Seen as triangle in front of 3 circles </li></ul><ul><li>S P does not dictate that over </li></ul>The Law of Closure does or or over
  92. 107. What counts as a form or grouping distinct from a background? In general, Simplicity 3-D or 2-D?
  93. 108. What is the figure can be complicated Ambiguous Figures: For same S D and same S P , two percepts are possible How can you have 2 simultaneous, incompatible representations of the same thing? <ul><li>Figure-ground is reversible </li></ul><ul><li>Can be shifted by attention </li></ul>Figure vs. Ground: What does the edge belong to?
  94. 109. Of the alternatives allowed by the proximal stimulus… infer the more likely. The Helmholtzian Solution: Use knowledge of which configurations are likely: Principle of maximum likelihood. Make Unconscious Inferences about the world. Contrast detection is not enough  identify which form the edge belongs to ( Pattern recognition presupposes a solution) Figure vs. Ground: What does the edge belong to?
  95. 110. Structuralists emphasized identifying primitives as adding or associating sensations… theirs were too subjective, too qualitative Gestaltists emphasized emergent properties or organizing through grouping laws theirs were descriptive, not predictable. But, how it looks ≠ what it is. Form requires further processing. Teacher through your glasses? Teacher in your locket? far near For example, distance matters
  96. 111. Pattern recognition = ƒ(distance, size, shape) How do we know both relative distance and absolute distance? Back to Helmholtz and Unconscious Inference How does S P come to indicate a particular S D given that S P is 2-dimensional and, therefore, ambiguous? Reasonably reliable in a Helmholtzian what-is-normal sense is provided by cues RI for large, far objects = RI for small, near objects Is there reasonably reliable structure that might be used to solve Molyneux’s problem? A B C D
  97. 112. <ul><li>S P was probably caused by a particular S D </li></ul>II. Attempts to simulate depth: pictorial cues I. Berkeley “on-line”: oculomotor cues convergence accommodation Distance Perception <ul><li>texture gradient </li></ul><ul><li>interposition </li></ul><ul><li>Become associated with properties of S D through experience. </li></ul><ul><li>relative size </li></ul>Aspect of S P X X X X <ul><li>linear perspective </li></ul>
  98. 113. III. 2 eyes that receive slightly different views:  binocular disparity Left thumb behind, Right thumb in front; Both far away Thumbs close together Amount of disparity indicates relative distance, separation Thumbs far apart Both up close R R L L L R L R
  99. 114. Motion Based Cue for Depth: Ever look out the window while riding in a car? Direction of Travel Objects in the foreground move by faster than objects in the background - Very distant objects appear to remain stationary Motion Parallax
  100. 115. Size Perception But there’s ambiguity… II. Familiar Size  pumpkins are larger than apples… <ul><li>except for small pumpkins </li></ul><ul><li> compare to similar objects in the scene: </li></ul><ul><li>III. Relative Size </li></ul>Unconscious Inference uses knowledge about what’s normal  RI pumpkin = RI apple  Which is bigger?  RI pumpkin > RI apple  pumpkin is larger than apple I. Retinal Image Size : Larger objects project larger RI
  101. 116. Knowledge is needed to make sense of ambiguous cues to attribute the proper cause to your S P . Helmholtz’s Unconscious Inference In natural scenes cues co-occur  strengthen the impression of depth & size. In experiments, cues are manipulated  alter the impression of depth & size. <ul><li>Strategy: isolate cues or put them in conflict to assess </li></ul><ul><ul><li>cues’ relative potency </li></ul></ul><ul><ul><li>illusions </li></ul></ul><ul><ul><li> gain insight into normal processes, algorithms </li></ul></ul>We perceive constant object properties despite variability in the S P that is our contact with them. Perceptual Constancies
  102. 117. Size Perceived = ƒ( RI Size , Distance Perceived ) Tested by Holway & Boring (1941) <ul><li>2 hallways: </li></ul><ul><li>target disk on L </li></ul>Indicate size by method of adjustment Targets chosen to project same RI @ every distance Percept-Percept Coupling <ul><li>response on R </li></ul>
  103. 118. Manipulate available cues to distance and assess effect on perceived size : <ul><li>fewer cues to distance  more reliance on RI </li></ul><ul><li>Breakdown of Size Constancy </li></ul>F M S P Actual Size Perceived Size constancy slope = 1 retinal size slope = 0 Full Cue Monocular Static Peephole
  104. 119. <ul><li>Helmholtz </li></ul><ul><li>S P is bad (  shows it) </li></ul><ul><li>Perception good (experience shows it) </li></ul><ul><li>fixed by rules (experiments show it) </li></ul>Perception is indirect S P1 ≠ S P2 Percept @ d1 = Percept @ d2 Size Constancy Ex. I. Perceived Size is unaffected by distance Perceptual Constancies d1 d2
  105. 120. <ul><li>Rule: RI size decreases with D. So… </li></ul><ul><li>If A & B project same size S P </li></ul><ul><li>And if A is farther than B </li></ul><ul><li> A must be bigger than B </li></ul><ul><li>percept-percept coupling </li></ul>Cue: S P:A = S P:B Perc’d size is derived from perc’d distance A looks bigger than B A B A = B Cue: linear perspective says “ A is farther than B ”
  106. 121. S P1 ≠ S P2 Percept @ p1 = Percept @ p2 Shape Constancy Ex. II. Perceived Shape is unaffected by perspective p1 p2
  107. 122. Appearance is affected by interpretation! Parallelograms look similar in size and shape (one is rotation of other) Shape Perc’d is derived from distance Perc’d Adding distance cues changes inferred shape. percept-percept coupling Manipulate depth cues & assess consequences for Shape Perc’d .
  108. 123. Fixing S P is logically prior to pattern recognition . What form is it? Fundamental problem is normalization of image for memory. <ul><li>Compare to stored representations </li></ul><ul><li>How abstract can the representations be? </li></ul><ul><li>How tolerant are matching processes? </li></ul>How would a representational account handle movement? Objects in the world often move…they are not not static!!
  109. 124.
  110. 125.
  111. 126. Motion Perception Perception Apparent (Stroboscopic) Movement Do we see things as they are because of the proximal stimulus? No Do we see things as they are because of brain states? Yes Or… A temporal property (change over time) is derived from a succession of static retinal images. t 2 t 3 t 1 Physical Event
  112. 127. Interpret with respect to likelihoods . Apparent motion of the disk induced by assumption that enclosures don’t move. The same assumption would underlie our experience of non-illusory motion, too. Again, illustrated by an illusion : “induced motion”
  113. 128. BUT… Helmholtzian account: compare RI with commands to muscles  Did I tell myself to move? <ul><li>ambiguity if I’m being moved passively </li></ul><ul><li>ambiguity if we’re both moving </li></ul>Puzzle: How is leftward movement of something distinguished from rightward movement of me (or my eyes)? 1 2 3 4 1 4 2 3 Stimulation of successive retinal locations  motion 1 2 3 4 Same pattern for car moving to left and me moving to right. 1 2 3 4
  114. 129. Form Perception  Motion Perception <ul><li>Sequence of static RI </li></ul><ul><li> infer motion </li></ul><ul><li>xyz at t 1 vs xyz at t 2 vs xyz at t 3 </li></ul><ul><li>deduce rotation about Y </li></ul>How do you know which points correspond if you don’t already know the type of motion? Helmholtz asked “what is likely?” What if both are likely? t 1 t 2 t 3
  115. 130. Shortest-Path Constraint … simplicity again!!!
  116. 131. Themes from the Overview <ul><li>Phenomena: What kinds of properties are perceived? </li></ul><ul><li>Physics: What kinds of properties are “recorded” in the energy media? </li></ul><ul><li>Physiology: What kinds of properties can sense organs and nerve cells “record”? </li></ul><ul><li>Philosophy: What kinds of properties should anchor our theory? </li></ul>We behave effectively with respect to the world. What makes that possible? WHAT WHO HOW
  117. 132. The Phenomena of ATTENTION: Orienting What is the girl feeling…emotion? What is the information for making these judgments? <ul><li>Attention drawn to most informative aspects of picture. </li></ul>Eye Movements
  118. 133. The Phenomena of ATTENTION: Search for the letter ‘c’ 8 8 8 8 8 8 s c z k e t 8 8 8 8 8 8 s k z c f t e s c z k e t s k z c f t e 8 8 8 8 8 8 Stimulus Driven Attention
  119. 134. The Phenomena of ATTENTION: Goal Directed – Intentional/Change Blindness Does the number of white T-shirt players change? Any Gorillas???????
  120. 135. Movie
  121. 136. The Phenomena of ATTENTION: Selective Listening WHAT IS KNOWN ABOUT UNATTENDED? Only physical characteristics (speech like sounds). Not meaning. “ unattended” “ attended” DICHOTIC LISTENING I cannot tell a lie Never kill a snake SHADOWING I cannot tell a lie COCKTAIL PARTY EFFECT Except when important or relevant (e.g. name) The ever present Unconscious at work yet again….
  122. 137. Indirect Perspective of Perception Assumes: Both relinquish the responsibility of perception to an “internal”, “mental”, knower… a homunculus … who organizes and isolates cues and compares percepts and representations. Proximal Stimulus Meaningless Sensations Association/Cues Distal Stimulus Incomplete “ Percepts” Incomplete “ Percepts” Perception Unconscious Inferences, information processing, Laws of organization

×