PubMed HealthSearch

Biomedical subjects

H H Bülthoff

Publications and source records attributed to H H Bülthoff.

4 recordsLinked to original sources

Psychophysical support for a two-dimensional view interpolation theory of object recognition.

Does the human brain represent objects for recognition by storing a series of two-dimensional snapshots, or are the object models, in some sense, three-dimensional analogs of the objects they represent? One way to address this question is to explore the ability of the human visual system to generalize recognition from familiar to unfamiliar views of three-dimensional objects. Three recently proposed theories of object recognition--viewpoint normalization or alignment of three-dimensional models [Ullman, S. (1989) Cognition 32, 193-254], linear combination of two-dimensional views [Ullman, S. & Basri, R. (1990) Recognition by Linear Combinations of Models (Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge), A. I. Memo No. 1152], and view approximation [Poggio, T. & Edelman, S. (1990) Nature (London) 343, 263-266]--predict different patterns of generalization to unfamiliar views. We have exploited the conflicting predictions to test the three theories directly in a psychophysical experiment involving computer-generated three-dimensional objects. Our results suggest that the human visual system is better described as recognizing these objects by two-dimensional view interpolation than by alignment or other methods that rely on object-centered three-dimensional models.

Computer Graphics

Orientation dependence in the recognition of familiar and novel views of three-dimensional objects.

We report four experiments that investigated the representation of novel three-dimensional (3D) objects by the human visual system. In the first experiment, canonical views were demonstrated for novel objects seen equally often from all test viewpoints. The next two experiments showed that the canonical views persisted under repeated testing, and in the presence of a variety of depth cues, including binocular stereo. The fourth experiment probed the ability of subjects to generalize recognition to unfamiliar views of objects previously seen at a limited range of attitudes. Both mono and stereo conditions yielded the same increase in the error rate with misorientation relative to the training attitude. Taken together, these results support the notion that 3D objects are represented by multiple specific views, possibly augmented by partial viewer-centered 3D information.

Computer Simulation

Inverse perspective mapping simplifies optical flow computation and obstacle detection.

We present a scheme for obstacle detection from optical flow which is based on strategies of biological information processing. Optical flow is established by a local "voting" (non-maximum suppression) over the outputs of correlation-type motion detectors similar to those found in the fly visual system. The computational theory of obstacle detection is discussed in terms of space-variances of the motion field. An efficient mechanism for the detection of disturbances in the expected motion field is based on "inverse perspective mapping", i.e., a coordinate transform or retinotopic mapping applied to the image. It turns out that besides obstacle detection, inverse perspective mapping has additional advantages for regularizing optical flow algorithms. Psychophysical evidence for body-scaled obstacle detection and related neurophysiological results are discussed.

Algorithms

Integration of depth modules: stereo and shading.

We studied the integration of image disparities, edge information, and shading in the three-dimensional perception of complex yet well-controlled images generated with a computer-graphics system. The images showed end-on views of flat- and smooth-shaded ellipsoids, i.e., images with and without intensity discontinuities (edges). A map of perceived depth was measured by adjusting a small stereo depth probe interactively to the perceived surface. Our data show that disparate shading (even in the absence of disparate edges) yields a vivid stereoscopic depth perception. The perceived depth is significantly reduced if the disparities are completely removed (shape-from-shading). If edge information is available, it overrides both shape-from-shading and disparate shading. Degradations of depth perception corresponded to a reduced depth rather than to an increased scatter in the depth measurement. The results are compared with computer-vision algorithms for both single cues and their integration for three-dimensional vision.

Computer Graphics