Real world occlusion constraints and binocular rivalry

doi:10.1016/0042-6989(90)90128-8

Vision Research

Volume 30, Issue 1, 1990, Pages 69-80

https://doi.org/10.1016/0042-6989(90)90128-8 Get rights and content

Abstract

A surface occluding a more distant surface gives rise to interocularly unpaired regions to its immediate left and right. The unpaired region on the left side is visible only to the left eye, whereas that on the right side is visible only to the right eye. Thus for real world scenes there are opto-geometrical constraints which determine whether particular combinations of relative depth and right-eye-only or left-eye-only stimuli are ecologically valid or invalid. We report a demonstration and experiments to show that opto-geometrically “valid” unpaired regions are seen as continuous with the rear plane and escape interocular suppression, whereas “invalid” unpaired regions are perceived as closer and are suppressed vigorously. An additional experiment indicates that the results cannot be understood in terms of correspondence solving, but require neural mechanisms that embody real-world occlusion constraints. These results suggest a rather close interaction between stereopsis and rivalry “modules”. Since explicit eye-of-origin information is lost relatively early in the hierarchical organization of cortical visual processing, we argue that occlusion-related constraints must be embodied at such early levels.

References (23)

KayeM.
Stereopsis without binocular correlation
Vision Research
(1978)
ShimojoS. et al.
Occlusion and the solution to the aperture problem for motion
Vision Research
(1989)
BurkhalterA. et al.
Processing of color, form and disparity information in visual areas VP and C2 of ventral extrastriate cortex in the macaque monkey
Journal of Neuroscience
(1986)
ColleT.S.
Extrapolating and interpolating surfaces in depth
FrisbyJ.P. et al.
The relationship between apparent depth and disparity in rivalrous-texture stereograms
Perception
(1978)
HelmholtzH.V.
Treatise on physiological optics
(1924)
HollidayI.E. et al.
Depth perception of uncorrelated areas in random-dot stereograms
Perception
(1985)
HubelD.H. et al.
Segregation of form, color and stereopsis in primate area 18
Journal of Neuroscience
(1987)
JuleszB.
Binocular depth perception of computergenerated patterns
Bell System Technical Journal
(1960)
JuleszB.
Foundation of cyclopean perception
(1971)

JuleszB. et al.

Interaction between pools of binocular disparity detectors tuned to different disparities

Biological Cybernetics

(1976)

Cited by (131)

Evidence in Support of the Border-Ownership Neurons for Representing Textured Figures
2020, iScience
We presented one eye with a monocular-boundary-contour (MBC) square, created by phase-shifting a central region of grating relative to a larger uniform grating surround, and the fellow eye with the larger uniform grating. In addition, the grating within the MBC region was rendered with lower contrast relative to the remaining stimulus. Despite this, we found the lower contrast MBC region dominated the perceived cyclopean contrast, with the corresponding region in the fellow eye being suppressed. Secondly, we found for dichoptic stimuli with half-images having square grating regions of different BC strengths, the interocular BC strength ratio determined the perceived contrast of the cyclopean square. Thirdly, we found perceived spatial phase of the cyclopean square was dominated by the spatial phase of the MBC half-image. Altogether, these psychophysical findings provided evidence for a border-to-interior representation strategy, that constructing surface begins at the boundary contour (BC), in binocular contrast and phase integration.
Perceptual mechanisms underlying amodal surface integration of 3-D stereoscopic stimuli
2018, Vision Research
Citation Excerpt :
Therefore, if one applies the same contrast polarity rule to the scenarios in Fig. 1b and c, it is predictable that the visual system has a larger bias to amodally integrate the three rectangular segments with the same contrast-polarity in Fig. 1b, than the ones in Fig. 1c where the middle rectangle (lighter than the background) and the two flanking rectangular segments (darker than the background) have opposite contrast polarity (Su et al., 2010a, 2010b). An objective way to study amodal surface completion is by measuring its effect on a specific perceptual task (e.g., Gerbino & Fantoni, 2006; Kellman et al., 2005a; Marr, 1982; Ringach & Shapley, 1996; Rubin, 2001; Sekuler et al., 1994; Shimojo & Nakayama, 1990a, 1990b; Su et al., 2010a, 2010b; van Bogaert, Ooi, & He, 2008; Yin et al., 2000). For example, when spatially separated images are amodally integrated into a single surface entity, all separated components of the surface will exhibit similar surface properties (e.g., Su et al., 2010a).
The visual system can represent a partially occluded 3-D surface from images of separated surface segments. The underlying amodal surface integration process accomplishes this by amodally extending each surface segment behind the occluder (amodal surface extension) and integrating the extended surfaces to form a whole surface representation. We conducted five experiments to investigate how depth cues, such as binocular disparity, half-occlusion, and monocular depth cues (T-junctions and L-junctions), contribute to amodal surface extension, and how the geometrical relationship and image similarity among the surface segments affect surface integration. This was achieved by having observers adjust the stereoscopic depth and slant of a comparison stimulus to match those of the tested 3-D stimulus. We found that both binocular disparity and half-occlusion cues are used to determine border-ownership assignment of surface segments and for amodal surface extension. We also found that separated surface segments need to have the same luminance contrast-polarity for them to be integrated as a whole surface. Finally, we found that having the same motion direction, minimum misalignment between boundary contours, and proximity among separated segments facilitate their integration. Overall, our findings reveal a set of “perceptual factors” for amodal surface integration, which arguably reflects our visual system’s built-in knowledge of the regularities in natural scenes.
Visually cued action timing in the primary visual cortex
2015, Neuron
Most behaviors are generated in three steps: sensing the external world, processing that information to instruct decision-making, and producing a motor action. Sensory areas, especially primary sensory cortices, have long been held to be involved only in the first step of this sequence. Here, we develop a visually cued interval timing task that requires rats to decide when to perform an action following a brief visual stimulus. Using single-unit recordings and optogenetics in this task, we show that activity generated by the primary visual cortex (V1) embodies the target interval and may instruct the decision to time the action on a trial-by-trial basis. A spiking neuronal model of local recurrent connections in V1 produces neural responses that predict and drive the timing of future actions, rationalizing our observations. Our data demonstrate that the primary visual cortex may contribute to the instruction of visually cued timed actions.
Binocular rivalry under naturalistic geometry: Evidence from worlds simulated in virtual reality
2024, PNAS Nexus
The Perceptual Science of Augmented Reality
2023, Annual Review of Vision Science
Neuronal Representations Supporting Three-Dimensional Vision in Nonhuman Primates
2023, Annual Review of Vision Science

View all citing articles on Scopus

^*: Current address: Department of Psychology, College of Arts and Sciences, University of Tokyo, Komaba, Meguro-ku, Tokyo 153, Japan.

View full text

Real world occlusion constraints and binocular rivalry

Abstract

Vision Research

Vision Research

Processing of color, form and disparity information in visual areas VP and C2 of ventral extrastriate cortex in the macaque monkey

Journal of Neuroscience

Extrapolating and interpolating surfaces in depth

The relationship between apparent depth and disparity in rivalrous-texture stereograms

Perception

Treatise on physiological optics

Depth perception of uncorrelated areas in random-dot stereograms

Perception

Segregation of form, color and stereopsis in primate area 18

Journal of Neuroscience

Binocular depth perception of computergenerated patterns

Bell System Technical Journal

Foundation of cyclopean perception

Interaction between pools of binocular disparity detectors tuned to different disparities

Biological Cybernetics