To study the impact of visually presented spatial cues on the human perception of mechanical stiffness in virtual environments, a three degree of freedom, force-reflecting haptic interface, the Planar Grasper, was utilized. In a series of psychophysical experiments on the discrimination of stiffness of two virtual springs, subjects pressed the springs and felt the corresponding displacements and forces through their hands, in addition to seeing the deformation of the springs displayed graphically on a computer monitor. Unknown to the subjects, the relationship between the visually presented deformation of each spring and actual deformation was systematically varied between experimental trials. This relationship ranged from fully registered (visual deformation was equal to the actual deformation of each spring) to completely interchanged (visual deformation of the softer spring was equal to the deformation of the harder spring for that force and vice versa). The results demonstrated a clear visual dominance over the kinesthetic sense of hand position. The subjects essentially ignored all kinesthetic hand position information regarding spring deformation, and based their judgment on the relationship between the visual position information and the indentation force sensed factually. This caused an increasing misperception of stiffness with increasing mismatch between the visual and haptic position information, culminating in totally erroneous judgments when the two were interchanged. These results indicate such haptic illusions can be exploited to overcome some of the limitations of haptic interfaces and to enhance the range of haptic experience.
Human psychophysical experiments were designed and conducted to investigate the effect of 3D perspective visual images on the visual and haptic perception of size and stiffness in multimodal virtual environments (VEs). Virtual slots of varying length and buttons of varying stiffness were displayed to the subjects, who then were asked to discriminate their size and stiffness respectively using visual and/or haptic cues. The results of the size experiments show that under vision alone, farther objects are perceived to be smaller due to perspective cues and the addition of haptic feedback reduces this visual bias. Similarly, the results of the stiffness experiments show that compliant objects that are farther are perceived to be softer when there is only haptic feedback and the addition of visual feedback reduces this haptic bias. Hence, we conclude that our visual and haptic systems compensate for each other such that the sensory information that comes from visual and haptic channels is fused in an optimal manner.
This paper proposes a novel haptic rendering algorithm and describes a perceptual experiment that demonstrates its effectiveness in causing humans to perceive shapes during manual interactions with virtual environments. The algorithm, called “Force Shading” (analogous to Phong Shading for visual displays), refers to a controlled variation in the direction of the force vector displayed by the haptic renderer for the purpose of creating the illusion of a non-flat shape on a nominally flat surface. Experiments on shape perception were done on 5 subjects using the Phantom as the haptic interface device. In these experiments, subjects manually explored the haptic display of various virtual polyhedral approximations of a circular cylindrical bump, with or without force shading. They then indicated the perceived shape by selecting one from a menu of shapes displayed on a computer monitor. Without force shading, the subjects accurately identified the polyhedral nature of the virtual bumps. With force shading, however, the subjects identified the polyhedral approximations as feeling closer to that of a smooth cylinder. The higher the number of polygons, the higher was the percentage of trials in which the shape was identified with a smooth cylinder.