1 August 2000 in PRESENCE: Virtual and Augmented Reality
Contact sounds can provide important perceptual cues in virtual environments. We investigated the relation between material perception and variables that govern the synthesis of contact sounds. A shape-invariant, auditory-decay parameter was a powerful determinant of the perceived material of an object. Subjects judged the similarity of synthesized sounds with respect to material (Experiment 1 and 2) or length (Experiment 3). The sounds corresponded to modal frequencies of clamped bars struck at an intermediate point, and they varied in fundamental frequency and frequency-dependent rate of decay. The latter parameter has been proposed as reflecting a shape-invariant material property: damping. Differences between sounds in both decay and frequency affected similarity judgments (magnitude of similarity and judgment duration), with decay playing a substantially larger role. Experiment 2, which varied the initial sound amplitude, showed that decay rate—rather than total energy or sound duration—was the critical factor in determining similarity. Experiment 3 demonstrated that similarity judgments in the first two studies were specific to instructions to judge material. Experiment 4, in which subjects assigned the sounds to one of four material categories, showed an influence of frequency and decay, but confirmed the greater importance of decay. Decay parameters associated with each category were estimated and found to correlate with physical measures of damping. The results support the use of a simplified model of material in virtual auditory environments.
1 November 2016 in Journal of Vision
Eye movements aid visual perception and guide actions such as reaching or grasping. Most previous work on eye-hand coordination has focused on saccadic eye movements. Here we show that smooth pursuit eye movement accuracy strongly predicts both interception accuracy and the strategy used to intercept a moving object. We developed a naturalistic task in which participants (n = 42 varsity baseball players) intercepted a moving dot (a “2D fly ball”) with their index finger in a designated “hit zone.” Participants were instructed to track the ball with their eyes, but were only shown its initial launch (100–300 ms). Better smooth pursuit resulted in more accurate interceptions and determined the strategy used for interception, i.e., whether interception was early or late in the hit zone. Even though early and late interceptors showed equally accurate interceptions, they may have relied on distinct tactics: early interceptors used cognitive heuristics, whereas late interceptors' performance was best predicted by pursuit accuracy. Late interception may be beneficial in real-world tasks as it provides more time for decision and adjustment. Supporting this view, baseball players who were more senior were more likely to be late interceptors. Our findings suggest that interception strategies are optimally adapted to the proficiency of the pursuit system.
1 August 2010 in Journal of Biomechanics
1 January 2013 in Frontiers in Computational Neuroscience
To generate a force at the hand in a given spatial direction and with a given magnitude the central nervous system (CNS) has to coordinate the recruitment of many muscles. Because of the redundancy in the musculoskeletal system, the CNS can choose one of infinitely many possible muscle activation patterns which generate the same force. What strategies and constraints underlie such selection is an open issue. The CNS might optimize a performance criterion, such as accuracy or effort. Moreover, the CNS might simplify the solution by constraining it to be a combination of a few muscle synergies, coordinated recruitment of groups of muscles. We tested whether the CNS generates forces by minimum effort recruitment of either individual muscles or muscle synergies. We compared the activation of arm muscles observed during the generation of isometric forces at the hand across multiple three-dimensional force targets with the activation predicted by either minimizing the sum of squared muscle activations or the sum of squared synergy activations. Muscle synergies were identified from the recorded muscle pattern using non-negative matrix factorization. To perform both optimizations we assumed a linear relationship between rectified and filtered electromyographic (EMG) signal which we estimated using multiple linear regressions. We found that the minimum effort recruitment of synergies predicted the observed muscle patterns better than the minimum effort recruitment of individual muscles. However, both predictions had errors much larger than the reconstruction error obtained by the synergies, suggesting that the CNS generates three-dimensional forces by sub-optimal recruitment of muscle synergies.
1 September 2012 in The Journal of Spinal Cord Medicine
In order to guide and improve rehabilitation interventions for grip function after spinal cord injury (SCI), it is important to have a detailed understanding of the motor control strategies that the central nervous system uses to control the hand. We examined whether changes in the motor control of the hand after SCI are manifested in the form of changes to muscle synergies. We further sought to determine a correlation between functional ability and the extent of muscle synergy disruption. Surface electromyographic (EMG) data were recorded from 8 hand muscles in 10 able-bodied subjects and 6 subjects with SCI as they performed various functional tasks using grip types relevant to activities of daily living. Muscle synergies were extracted using non-negative matrix factorization. Functional performance in each task was quantified using a 5-point clinical scale. The synergies most commonly observed in able-bodied subjects were co-activation of extensor digitorum communis and extensor indicis proprius, as well as of flexor digitorum superficialis with flexor carpi ulnaris. The proportion of subjects in which particular synergies occurred was significantly different for subjects with SCI compared to able-bodied subjects (P < 0.001). Deviations from the average able-bodied synergies in subject with SCI were found to be poorly correlated (r = -0.04) with functional ability. Results suggest that the disruptions and re-organizations of neural circuitry after SCI are reflected by the extracted muscle synergies, but the question of how muscle synergies can guide rehabilitation interventions remains open.
1 December 2010 in Progress in Biophysics and Molecular Biology