The analysis of spoken language requires a principled way of dividing transcribed data into units in order to assess features such as accuracy and complexity. If such analyses are to be comparable across different studies, there must be agreement on the nature of the unit, and it must be possible to apply this unit reliably to a range of different types of speech data. There are a number of different units in use, the various merits of which have been discussed by Crookes (1990). However, while these have been used to facilitate the analysis of spoken language data, there is presently no comprehensive, accessible definition of any of them, nor are detailed guides available on how to identify such units in data sets. Research reports tend to provide simplistic two-line definitions of units exemplified, if at all, by unproblematic written examples. These are inadequate when applied to transcriptions of complex oral data, which tend not to lend themselves easily to a clear division into units. This paper was motivated by the need each of the three authors felt for a reliable and comprehensively defined unit to assist with the analysis of a variety of recordings of native and non-native speakers of English. We first discuss in very general terms the criteria according to which such a unit might be selected. Next, we examine the main categories of unit which have been adopted previously and provide a justification for the particular type of unit that we have chosen. Focusing on this unit, we identify a number of problems which are associated with the definition and exemplification of units of this type, and give examples of the awkward cases found in actual data. Finally we offer a definition of our unit, the Analysis of Speech Unit (AS-unit), providing adequate detail to address the problematic data analyses we have illustrated.
The assessment of oral language is now quite commonly done in pairs or groups, and there is a growing body of research which investigates the related issues (e.g. May, 2007). Writing generally tends to be thought of as an individual activity, although a small number of studies have documented the advantages of collaboration in writing in the second language classroom (e.g. DiCamilla & Anton, 1997; Storch, 2005; Swain & Lapkin, 1998). Particularly in university contexts, group or pair assignments are widely used in many disciplines. In addition, collaborative writing could be used in second language classroom assessment contexts as formative assessment. However, research which compares texts produced by learners collaboratively to texts produced individually, and the implications of this for assessment practices, is rare. This study is a first step in the investigation of using collaborative writing in second language contexts and comparing the performance of two groups of second language learners: one group worked individually, and the other group worked in pairs. When writing in pairs, each pair produced a single text. All participants completed one writing task: an argumentative essay. The performances of the individuals (N = 48) and the pairs (N = 48) were compared on detailed discourse analytic measures of fluency, complexity and accuracy. This comparison revealed that collaboration impacted positively on accuracy, but did not affect fluency and complexity. A detailed analysis of the pair transcripts recorded during the writing activity provides insights into the ways in which pairs work together, and the foci of their endeavour. The implications of these findings for in-class assessment of second language writing are discussed.
23 April 2010 in Studies in Second Language Acquisition
The literature on corrective feedback (CF) that second language writers receive in response to their grammatical and lexical errors is plagued by controversies and conflicting findings about the merits of feedback. Although more recent studies suggest that CF is valuable (e.g., Bitchener, 2008; Sheen, 2007), it is still not clear whether direct or indirect feedback is the most effective, or why. This study explored the efficacy of two different forms of CF. The investigation focused on the nature of the learners’ engagement with the feedback received to gain a better understanding of why some feedback is taken up and retained and some is not. The study was composed of three sessions. In session 1, learners worked in pairs to compose a text based on a graphic prompt. Feedback was provided either in the form of reformulations (direct feedback) or editing symbols (indirect feedback). In session 2 (day 5), the learners reviewed the feedback they received and rewrote their text. All pair talk was audio-recorded. In session 3 (day 28), each of the learners composed a text individually using the same prompt as in session 1. The texts produced by the pairs after feedback were analyzed for evidence of uptake of the feedback given and texts produced individually in session 3 for evidence of retention. The learners’ transcribed pair talk proved a very rich source of data that showed not only how learners processed the feedback received but also their attitudes toward the feedback and their beliefs about language conventions and use. Closer analysis of four case study pairs suggests that uptake and retention may be affected by a host of linguistic and affective factors, including the type of errors the learners make in their writing and, more importantly, learners’ attitudes, beliefs, and goals. The findings suggest that, although often ignored in research on CF, these affective factors play an important role in uptake and retention of feedback.
The inclusion of planning time in semi-direct oral interaction tests adds consider ably to the overall length of the test, and it is important to be clear that the increase in length is justified by the language outcome. Previous research has shown that the effect of planning time in second language can differentially influence the resultant discourse with planned discourse eliciting more complex language on a range of measures. However, where planning time has been provided it has gener ally been a substantial amount of time (ten minutes or more), and in a second language classroom situation, rather than a testing situation. Where planning time is provided in an oral interaction test it is generally limited to one or two minutes. In this study planning time was manipulated as a variable in a trial administration of a semi-direct test. Discourse analytic techniques were then used to determine the nature and/or significance of differences in the elicited discourse across the two conditions in terms of complexity and accuracy. In addition, candidates were divided into high-proficiency versus low-proficiency groups. The findings suggest that for the high-proficiency candidates, planning time may improve accuracy on some measures where the cognitive load of the task is high, but that this effect does not extend to the low-proficiency candidates.