While empirical studies have shown the beneficial role of observing and producing hand gestures mimicking pitch features in the learning of L2 tonal or intonational contrasts, mixed results have been obtained for the use of gestures encoding durational contrasts at the perceptual level. This study investigates the potential benefits of horizontal hand-sweep gestures encoding durational features for boosting the perception and production of nonnative vowel-length contrasts. In a between-subjects experiment with a pretest–posttest design, 50 Catalan participants without any knowledge of Japanese practiced perceiving and producing minimal pairs of Japanese disyllabic words featuring vowel-length contrasts in one of two conditions, namely with gestures or without them. Pretest and posttest consisted of the completion of identical vowel-length identification and imitation tasks. The results showed that while participants improved equally at posttest across the two conditions in the identification task, the Gesture group obtained a larger improvement than the No Gesture group in the imitation task. These results corroborate the claim that producing hand gestures encoding prosodic properties of speech may help naïve learners to learn novel phonological contrasts in a foreign language.
This study explores the effects of embodied prosodic training on the production of non-native French front rounded vowels (i.e. /y, ø, œ/) and the overall pronunciation proficiency. Fifty-seven Catalan learners of French practiced pronunciation in one of two conditions: one group observed hand gestures embodying prosodic features of the sentences they were listening to, while the other group did not see any such gestures. The learning outcome was assessed in a pretest, posttest, and delayed posttest through a dialogue-reading task and a sentence imitation task in terms of accentedness, comprehensibility and fluency scores, and through formant analysis of participant-produced target vowels. The results showed that compared to non-embodied training, embodied prosodic training yielded continuous improvement in accentedness in both tasks and improved the F2 values of French front rounded vowels (more fronted). As for comprehensibility and fluency scores, both groups showed similar levels of significant improvement. This study highlights the interaction between prosodic and segmental features of speech by showing that training with embodied prosodic features benefitted accentedness and the production accuracy of non-native vowels.
13 November 2020 in Journal of Speech, Language, and Hearing Research
Purpose: Research has shown that observing hand gestures mimicking pitch movements or rhythmic patterns can improve the learning of second language (L2) suprasegmental features. However, less is known about the effects of hand gestures on the learning of novel phonemic contrasts. This study examines (a) whether hand gestures mimicking phonetic features can boost L2 segment learning by naive learners and (b) whether a mismatch between the hand gesture form and the target phonetic feature influences the learning effect.Method: Fifty Catalan native speakers undertook a short multimodal training session on two types of Mandarin Chinese consonants (plosives and affricates) in either of two conditions: Gesture and No Gesture. In the Gesture condition, a fist-to-open-hand gesture was used to mimic air burst, while the No Gesture condition included no such use of gestures. Crucially, while the hand gesture appropriately mimicked the air burst produced in plosives, this was not the case for affricates. Before and after training, participants were tested on two tasks, namely, the identification task and the imitation task. Participants' speech output was rated by five Chinese native speakers.Results: The perception results showed that training with or without gestures yielded similar degrees of improvement for the identification of aspiration contrasts. By contrast, the production results showed that, while training without gestures did not help improve L2 pronunciation, training with gestures improved pronunciation, but only when the given gestures appropriately mimicked the phonetic properties they represented.Conclusions: Results revealed that the efficacy of observing hand gestures on the learning of nonnative phonemes depends on the appropriateness of the form of those gestures relative to the target phonetic features. That is, hand gestures seem to be more useful when they appropriately mimic phonetic features.Supplemental Material: https://doi.org/10.23641/asha.13105442
2 June 2021 in Language, Cognition and Neuroscience
This study investigates the impact of embodied training of pronunciation with visuospatial hand gestures cueing Mandarin aspirated plosives. Sixty-seven Catalan participants learned to pronounce and memorised novel Mandarin words containing non-native aspirated plosives with or without performing hand gestures. They were tested on perception, production, and word-meaning recognition in a pretest, an immediate, and a delayed posttest. Results show that participants who appropriately performed hand gestures gained enhanced voice onset time (VOT) values of the aspirated plosives and yielded a continuous improvement in the overall pronunciation of the target words. Furthermore, gestural training helped maintain word recognition accuracy after three days, while non-gestural training did not. These results suggest that appropriate gesture performance during training is crucial in maintaining the effects of L2 pronunciation training. Overall, the results highlight the relevance of embodied training for L2 pronunciation and the need to assess the learners’ gesture performance during the training.
18 August 2022 in Language Learning and Development
The present study investigates whether training second language pronunciation with tactile cues facilitates the production of non-native sounds involving accessible articulatory features. In a between-subjects experiment with a pretest-training-posttest design, 50 Turkish learners of English received audiovisual training on a set of target words and sentences containing two English interdental fricatives, /θ/ and /ð/, in one of two conditions, tactile and non-tactile. The tactile condition involved self-touching the tongue as it protruded during pronunciation of the two target sounds. Participants’ pronunciation performance was assessed through a word-imitation task, a sentence-imitation task, and a discourse reading task. Results showed that while both training conditions helped learners to improve their pronunciation performance in all three tasks, the tactile condition triggered greater improvements in the discourse reading task. These results extend previous findings on the benefits of tactile input for speech perception and suggest the efficacy of multisensory training paradigms for improving second language pronunciation.
This study investigates whether audiovisual phonetic training with hand gestures encoding visible or nonvisible articulation features has a differential impact on learning second language sounds. Ninety‐nine Catalan–Spanish bilingual students were trained to differentiate English /æ/ and /ʌ/, which differ in the visible lip aperture and nonvisible tongue position, with training involving no gestures, gestures representing the lip aperture, or gestures representing the tongue position. Before, immediately after, and 1 week after the training, participants’ perception of the targets was assessed through a word‐identification task, and their production was tested through paragraph‐reading, picture‐naming, and word‐imitation tasks. Although all participants improved in perception and production, the lip hand gesture was more effective in adjusting lip aperture than the other two conditions in the paragraph‐reading and picture‐naming tasks. These results suggest that hand gestures encoding visible rather than nonvisible articulation features are more effective for improving second language pronunciation.