Stefanie Shattuck-Hufnagel

Dr. Stefanie Shattuck-Hufnagel


Research Focus & Metrics

Academic Career Length

17Years (2010-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
16 March 2016 in Laboratory Phonology
Verified
Journal Article
Open access
PDF file
JCJennifer Cole
Jennifer Cole
SSStefanie Shattuck-Hufnagel
Stefanie Shattuck-Hufnagel
Understanding the role of prosody in encoding linguistic meaning and in shaping phonetic form requires the analysis of prosodically annotated speech drawn from a wide variety of speech materials. Yet obtaining accurate and reliable prosodic annotations for even small datasets is challenging due to the time and expertise required. We discuss several factors that make prosodic annotation difficult and impact its reliability, all of which relate to 'variability': in the patterning of prosodic elements (features and structures) as they relate to the linguistic and discourse context, in the acoustic cues for those prosodic elements, and in the parameter values of the cues. We propose two novel methods for prosodic transcription that capture variability as a source of information relevant to the linguistic analysis of prosody. The first is 'Rapid Prosody Transcription '(RPT), which can be performed by non-experts using a simple set of unary labels to mark prominence and boundaries based on immediate auditory impression. Inter-transcriber variability is used to calculate continuous-valued prosody ‘scores’ that are assigned to each word and represent the perceptual salience of its prosodic features or structure. RPT can be used to model the relative influence of top-down factors and acoustic cues in prosody perception, and to model prosodic variation across many dimensions, including language variety,speech style, or speaker’s affect. The second proposed method is the identification of individual cues to the contrastive prosodic elements of an utterance. Cue specification provides a link between the contrastive symbolic categories of prosodic structures and the continuous-valued parameters in the acoustic signal, and offers a framework for investigating how factors related to the grammatical and situational context influence the phonetic form of spoken words and phrases. While cue specification as a transcription tool has not yet been explored as RPT has, it has the potential to provide a level of detail that will be useful in modelling systematic context-governed variation in the implementation of prosodic categories, with applications in automatic speech synthesis and recognition, as well as modelling human speech production and perception. We discuss how RPT and cue specification, particularly when combined, can improve the efficiency and reliability of prosodic transcription and how they can be integrated with expert phonological transcription

7 September 2018 in Frontiers in Psychology
Verified
Journal Article
Open access
PDF file
SSStefanie Shattuck-Hufnagel
Stefanie Shattuck-Hufnagel
ARAda Ren
Ada Ren
Many studies have documented a close timing relationship between speech prosody and co-speech gesture, but some studies have not, and it is unclear whether these differences in speech-gesture alignment are due to different speaking tasks, different target gesture types, different prosodic elements, different definitions of alignment, or even different languages/speakers. This study contributes to the ongoing effort to elucidate the precise nature of the gesture–speech timing relationship by examining an understudied variety of American English, i.e., academic-lecture-style speech, with a focus on an understudied type of gesture: Non-Referential gestures, which make up the majority of this corpus. Results for the 1,334 Stroke-Defined Gestures in this 20-min sample suggest that the stroke phase of a Non-Referential gesture tends to align with a pitch-accented syllable, just as reported in studies of other gesture types (e.g., deictic gestures) and in other speaking styles (such as narration). Preliminary results are presented suggesting that trajectory shapes of these Non-Referential gestures are consistent across a higher-level prosodic grouping, supporting earlier proposals for kinematic constancy across spoken prosodic constituents (Kendon, 1972, 1980, 2004). Analysis also raises the possibility that the category of Non-Referential gestures is not solely made up of ‘beats,’ defined as simple bi-phasic flick-like movements that beat out the rhythm of the speech, but includes gestures with multiple phases and various types of rhythmicity. Taken together, the results of this analysis suggest (1) a wide range of gesture configurations within the undifferentiated category of Non-Referential gestures or ‘beats,’ which requires further investigation, and (2) a close coordination between co-speech gestures and the prosodic structure of spoken utterances across speaking styles and gesture referentiality, which has profound implications for modeling the process of planning an utterance.

22 May 2012
Verified
Conference Paper
Open access
PDF file
HMHansjörg Mixdorff
Hansjörg Mixdorff
JCJennifer Cole
Jennifer Cole
SSStefanie Shattuck-Hufnagel
Stefanie Shattuck-Hufnagel
Unlike audio recording devices, a human speaker imitating a heard utterance or reading a sentence aloud must formulate a cognitive representation of the linguistic object to guide the phonology and phonetics of the spoken output. The current study used two different production tasks to explore the prosodic aspect of these representations: an imitation experiment in which speakers heard and then imitated spontaneous utterances from a Maptask corpus, and a read enactment task in which speakers read the same sentences aloud from a video display. For each task, the resulting utterances were compared for similarity a) to the original Maptask utterance and b) to each other. Similarity measures included perceptual accent and boundary labels and syllable durations, as well as Fujisaki model-based F0 parameters. The imitations showed strong agreement with the stimulus utterances both in their phonological structure (perceptually labeled accents and boundaries), and in several phonetic cues to prosody from measures of duration and F0. Furthermore, agreement between imitated utterances and the original spoken stimulus was higher than between different imitations. Finally, read and enacted utterances were substantially different from the original spoken stimulus, in terms of their phonology and F0 characteristics, though duration patterns were less variable. Overall, these results are consistent with the view that listeners extract the prosodic form of an utterance in terms of both phonological features and phonetic cues, and that the syntactic and semantic content of the text is not sufficient to determine a reliable prosodic outcome across subjects.

8 January 2023 in Laboratory Phonology
Verified
Journal Article
Open access
JCJennifer Cole
Jennifer Cole
JSJeremy Steffman
Jeremy Steffman
SSStefanie Shattuck-Hufnagel
Stefanie Shattuck-Hufnagel
STSam Tilsen
Sam Tilsen
In Autosegmental-Metrical models of intonational phonology, different types of pitch accents, phrase accents, and boundary tones concatenate to create a set of phonologically distinct phrase-final nuclear tunes. This study asks if an eight-way distinction in nuclear tune shape in American English, predicted from the combination of two (monotonal) pitch accents, two phrase accents, and two boundary tones, is evident in speech production and in speech perception. F0 trajectories from a large-scale imitative speech production experiment were analyzed using bottom-up(k-means) clustering, neural net classification, GAMM modeling, and modeling of turning point alignment. Listeners’ perception of the same tunes is tested in a perceptual discrimination task and related to the imitation results. Emergent grouping of tunes in the clustering analysis, and related classification accuracy from the neural net, show a merging of some of the predicted distinctions among tunes whereby tune shapes that vary primarily in the scaling of final f0 are not reliably distinguished. Within five emergent clusters, subtler distinctions among tunes are evident in GAMMs and f0 turning point modeling. Clustering of individual participants’ production data shows a range of partitions of the data, with nearly all participants making a primary distinction between a class of High-Rising and Non-High-Rising tunes, and with up to four secondary distinctions among the non-Rising class. Perception results show a similar pattern, with poor pairwise discrimination for tunes that differ primarily, but by a small degree, in final f0, and highly accurate discrimination when just one member of a pair is in the High-Rising tune class. Together, the results suggest a hierarchy of distinctiveness among nuclear tunes, with a robust distinction based on holistic tune shape and poorly differentiated distinctions between tunes with the same holistic shape but small differences in final f0. The observed distinctions from clustering, classification, and perception analyses align with the tonal specification of a binary pitch accent contrast {H*, L*} and a maximally ternary {H%, M%, L%} boundary tone contrast; the findings do not support distinct tonal specifications for the phrase accent and boundary tone from the AM model.

4 September 2019 in Language, Cognition and Neuroscience
Verified
Journal Article
Closed access
SSStefanie Shattuck-Hufnagel
Stefanie Shattuck-Hufnagel
Since the publication of Speaking in 1989, with its extraordinary goal of modelling the entire process of human speech generation from message conceptualisation to articulation, encompassing results from a wide range of empirical studies, much new information has emerged about three aspects of speech production that were not clearly in focus at that time. This evidence has revealed 1) the systematic patterns of context-governed surface phonetic variation, and the active control of these patterns exercised by speakers and listeners, 2) the depth and pervasiveness of prosodic influences on those patterns, and 3) the close alignment of co-speech gestures with the prosodic structure of an utterance. This paper reviews some of that evidence, and suggests how its implications may constrain models of speech production planning, as those models become more comprehensive in their treatment of higher-level structures, and of aspects of the communicative act beyond the articulation of lexical and syntactic elements.

27 November 2018 in Phonetica
Verified
Journal Article
Open access
PDF file
CMChristine Mooshammer
Christine Mooshammer
MTMark Tiede
Mark Tiede
SSStefanie Shattuck-Hufnagel
Stefanie Shattuck-Hufnagel
LGLouis Goldstein
Louis Goldstein
Sequences of similar (i.e., partially identical) words can be hard to say, as indicated by error frequencies, longer reaction and execution times. This study investigates the role of the location of this partial identity and the accompanying differences, i.e. whether errors are more frequent with mismatches in word onsets (top cop), codas (top tock) or both (pop tot). Number of syllables (tippy ticky) and empty positions (top ta) were also varied. Since the gradient nature of errors can be difficult to determine acoustically, articulatory data were investigated. Articulator movements were recorded using electromagnetic articulography, for up to 9 speakers of American English repeatedly producing 2-word sequences to an accelerating metronome. Most word pairs showed more intrusions and greater variability in coda than in onset position, in contrast to the predominance of onset position errors in corpora from perceptual observation.