SPECULAR FLOW AND THE PERCEPTION OF SURFACE REFLECTANCE Stefan Roth * Fulvio Domini † Michael J....
1
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% convex speculardots concave speculardots convex specularlines concave specular lines Percentage seen convex convex diffuse concave diffuse SPECULAR FLOW AND THE PERCEPTION OF SURFACE REFLECTANCE Stefan Roth * Fulvio Domini † Michael J. Black * * Computer Science † Cognitive and Linguistic Sciences BROWN UNIVERSITY I. Motivation and Introduction SA73 II. Basic Stimuli III. Experiment 1 IV. Experiment 2 Acknowledgements V. Conclusions Observations Specular flow applied to random dots or random lines is not perceived as “shiny”. As the illumination sources become more “natural” the object is increasingly perceived as “shiny”. The further away the illumination sphere is, the less reflective the objects This material is based upon work supported by the National Science Foundation under Grant No. 78441. Results Single motion pattern with either diffuse (only dots) or specular reflection (dots or lines) visible 10 random convex trials per stimulus and subject, 10 random concave trials, 8 subjects overall Subjects view each stimulus for at most 2.5 seconds before the animation stops. Subjects make forced choice between convex and concave shapes Diffuse and specular motion patterns are superimposed Both can either be convex or concave (i.e., they can agree or disagree) The number of trials per stimulus, the number of subjects, and the duration of trials remains unchanged. Subjects still make a forced choice between convex and concave shape. The combination of diffuse and specular flow allows significant discrimination between convex and concave shapes. Convex/concave combinations show a strong bias towards convex. Simple specular flow patterns are not perceived as “shiny”, but nevertheless significantly improve the ability to distinguish convex and concave shapes when combined with diffuse motion cues. Specular flow: Dense (or semi-dense) image motion of specular reflections (as opposed to just specular highlights). Specularities have been shown to be used by humans for: • Judging material properties (Hartung & Kersten, VSS ’01) • Static stereo perception (Blake & Bülthoff, Nature 1990) Open question: Is specular flow used in the perception of 3D shape? convex concave diffuse specular Figure 2: Motion traces showing the flow of random dots corresponding to diffuse and specular motion. References 1. Hartung, B., & Kersten, D. Distinguishing Shiny from Matte. Vision Sciences 2002. 2. Blake, A., & Bülthoff, H. Does the brain know the physics of specular reflection? Nature, 343, 1990. Using a sphere as basic shape Exterior of sphere as convex shape Interior (“bowl”) as concave shape. Diffuse reflection is shown using random-dot displays with uniform dot density. Specular reflections are displayed using random-dot or random-line displays. Specularities originate from a fixed illumination sphere around the shape. The camera is rotating around the object and views the scene through a round aperture. Stimuli are generated in real- time using hardware-accelerated OpenGL (Nvidia GeForce). Here: We study in the absence of spatial cues whether specular flow improves discrimination capabilities between convex and concave shapes when combined with diffuse motion. Our results show that combining specular and diffuse flow does improve this discrimination capability. Figure 1: Objects with diffuse and specular reflections. Results No significant level of distinction between convex and concave shapes from just diffuse reflection Specular reflections cause a strong bias towards concave. Specular motion patterns show significant differences between the perception of convex and concave. Figure 3: Scene setup (left – convex shape, right – concave shape). * * * * * = specular and diffuse geometry agree r=1 d=5 camera random dots on illumination sphere d=25 random dots on surface aperture 0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100% convex concave Percentage seen convex dots (diffuse) dots (specular) lines (specular)
-
Upload
lilian-hampton -
Category
Documents
-
view
214 -
download
0
Transcript of SPECULAR FLOW AND THE PERCEPTION OF SURFACE REFLECTANCE Stefan Roth * Fulvio Domini † Michael J....
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
convex specular dots concave specular dots convex specular lines concave specularlines
Pe
rce
nta
ge
se
en
co
nve
x
convex diffuse concave diffuse
SPECULAR FLOW AND THE PERCEPTION OF SURFACE REFLECTANCE
Stefan Roth* Fulvio Domini† Michael J. Black*
*Computer Science †Cognitive and Linguistic SciencesBROWN UNIVERSITY
I. Motivation and Introduction
SA73
II. Basic Stimuli
III. Experiment 1
IV. Experiment 2
Acknowledgements
V. ConclusionsObservations Specular flow applied to random dots or random lines is not perceived as “shiny”. As the illumination sources become more “natural” the object is increasingly perceived as “shiny”. The further away the illumination sphere is, the less reflective the objects seem.
This material is based upon work supported by the National Science Foundation under Grant No. 78441.
Results
Single motion pattern with either diffuse (only dots) or specular reflection (dots or lines) visible
10 random convex trials per stimulus and subject, 10 random concave trials, 8 subjects overall
Subjects view each stimulus for at most 2.5 seconds before the animation stops.
Subjects make forced choice between convex and concave shapes
Diffuse and specular motion patterns are superimposed
Both can either be convex or concave (i.e., they can agree or disagree)
The number of trials per stimulus, the number of subjects, and the duration of trials remains unchanged.
Subjects still make a forced choice between convex and concave shape.
The combination of diffuse and specular flow allows significant discrimination between convex and concave shapes.
Convex/concave combinations show a strong bias towards convex.
Simple specular flow patterns are not perceived as “shiny”, but nevertheless significantly improve the ability to distinguish convex and concave shapes when combined with diffuse motion cues.
Specular flow: Dense (or semi-dense) image motion of specular reflections (as opposed to just specular highlights).
Specularities have been shown to be used by humans for:• Judging material properties (Hartung & Kersten, VSS ’01)• Static stereo perception (Blake & Bülthoff, Nature 1990)
Open question: Is specular flow used in the perception of 3D shape?
convex concave
diffu
sesp
ecul
ar
Figure 2: Motion traces showing the flow of random dots corresponding to diffuse and specular motion.
References1. Hartung, B., & Kersten, D. Distinguishing Shiny from
Matte. Vision Sciences 2002.2. Blake, A., & Bülthoff, H. Does the brain know the
physics of specular reflection? Nature, 343, 1990.
Using a sphere as basic shape
Exterior of sphere as convex shape
Interior (“bowl”) as concave shape.
Diffuse reflection is shown using random-dot displays with uniform dot density.
Specular reflections are displayed using random-dot or random-line displays. Specularities originate from a fixed illumination sphere around the shape.
The camera is rotating around the object and views the scene through a round aperture.
Stimuli are generated in real-time using hardware-accelerated OpenGL (Nvidia GeForce).
Here: We study in the absence of spatial cues whether specular flow improves discrimination capabilities between convex and concave shapes when combined with diffuse motion. Our results show that combining specular and diffuse flow does improve this discrimination capability.
Figure 1: Objects with diffuse and specular reflections.
Results
No significant level of distinction between convex and concave shapes from just diffuse reflection Specular reflections cause a strong bias towards concave. Specular motion patterns show significant differences between the perception of convex and concave.
Figure 3: Scene setup (left – convex shape, right – concave shape).
* **
*
* = specular and diffuse geometry agree
r=1
d=5
camera
random dots on illumination sphered=25
random dots on surface
aperture
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
convex concave
Pe
rce
nta
ge
se
en
co
nve
x
dots (diffuse) dots (specular) lines (specular)
