Stuart McLean

Stuart McLean

Auto-generated profile, based on publicly available information

Stuart McLean

Kindai University, Japan

Research Focus & Metrics

Academic Career Length

10Years (2017-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 January 2020 in Language Testing
Verified
Journal Article
Closed access
PDF file
SMStuart McLean
Stuart McLean
JSJeffrey Stewart
Jeffrey Stewart
ABAaron Olaf Batty
Aaron Olaf Batty
Vocabulary’s relationship to reading proficiency is frequently cited as a justification for the assessment of L2 written receptive vocabulary knowledge. However, to date, there has been relatively little research regarding which modalities of vocabulary knowledge have the strongest correlations to reading proficiency, and observed differences have often been statistically non-significant. The present research employs a bootstrapping approach to reach a clearer understanding of relationships between various modalities of vocabulary knowledge to reading proficiency. Test-takers (N = 103) answered 1000 vocabulary test items spanning the third 1000 most frequent English words in the New General Service List corpus (Browne, Culligan, & Phillips, 2013). Items were answered under four modalities: Yes/No checklists, form recall, meaning recall, and meaning recognition. These pools of test items were then sampled with replacement to create 1000 simulated tests ranging in length from five to 200 items and the results were correlated to the Test of English for International Communication (TOEIC®) Reading scores. For all examined test lengths, meaning-recall vocabulary tests had the highest average correlations to reading proficiency, followed by form-recall vocabulary tests. The results indicated that tests of vocabulary recall are stronger predictors of reading proficiency than tests of vocabulary recognition, despite the theoretically closer relationship of vocabulary recognition to reading.

29 June 2020 in Studies in Second Language Acquisition
Verified
Journal Article
Closed access
PDF file
TSTim Stoeckel
Tim Stoeckel
SMStuart McLean
Stuart McLean
PNPaul Nation
Paul Nation
Two commonly used test types to assess vocabulary knowledge for the purpose of reading are size and levels tests. This article first reviews several frequently stated purposes of such tests (e.g., materials selection, tracking vocabulary growth) and provides a reasoned argument for the precision needed to serve such purposes. Then three sources of inaccuracy in existing tests are examined: the overestimation of lexical knowledge from guessing or use of test strategies under meaning-recognition item formats; the overestimation of vocabulary knowledge when receptive understanding of all word family members is assumed from a correct response to an item assessing knowledge of just one family member; and the limited precision that a small, random sample of target words has in representing the population of words from which it is drawn. The article concludes that existing tests lack the accuracy needed for many specified testing purposes and discusses possible improvements going forward.

23 December 2020 in Language Testing
Verified
Journal Article
Open access
PDF file
Henrik GyllstadHenrik Gyllstad
Henrik Gyllstad
SMStuart McLean
Stuart McLean
JSJeffrey Stewart
Jeffrey Stewart
The last three decades have seen an increase of tests aimed at measuring an individual’s vocabulary level or size. The target words used in these tests are typically sampled from word frequency lists, which are in turn based on language corpora. Conventionally, test developers sample items from frequency bands of 1000 words; different tests employ different sampling ratios. Some have as few as 5 or 10 items representing the underlying population of words, whereas other tests feature a larger number of items, such as 24, 30, or 40. However, very rarely are the sampling size choices supported by clear empirical evidence. Here, using a bootstrapping approach, we illustrate the effect that a sample-size increase has on confidence intervals of individual learner vocabulary knowledge estimates, and on the inferences that can safely be made from test scores. We draw on a unique dataset consisting of adult L1 Japanese test takers’ performance on two English vocabulary test formats, each featuring 1000 words. Our analysis shows that there are few purposes and settings where as few as 5 to 10 sampled items from a 1000-word frequency band (1K) are sufficient. The use of 30 or more items per 1000-word frequency band and tests consisting of fewer bands is recommended.

28 March 2024 in Language Learning
Verified
Journal Article
Open access
PLPaul Leeming
Paul Leeming
JVJoseph P. Vitta
Joseph P. Vitta
PHPhil Hiver
Phil Hiver
DHDillon Hicks
Dillon Hicks
SMStuart McLean
Stuart McLean
CNChristopher Nicklin
Christopher Nicklin
This study investigated how students’ self‐reported individual differences predicted second language (L2) spoken discussion task output, an objective behavioral outcome, in the Japanese university English as a Foreign Language (EFL) context. Although numerous psychological theories are used as a rationale for task‐based language teaching (TBLT), few studies have investigated the impact of individual differences variables on task performance. To address this gap, a cross‐validation procedure was used with students ( N = 439) from two different universities. They completed questionnaires to measure willingness to communicate (WTC), speaking self‐efficacy (SSE), and perceived communicative competence (PCC). They also engaged in a quasiacademic eight‐minute group discussion task (TBLT design). This discussion was recorded and transcribed, with the number of words produced used as an objective measure of L2 task production. In the better fitting mediation structural equation model, the influences of SSE and PCC on spoken L2 task production were fully mediated by WTC ( R 2 = .21).

6 September 2021 in Studies in Second Language Acquisition
Verified
Journal Article
Closed access
PDF file
JVJoseph P. Vitta
Joseph P. Vitta
CNChristopher Nicklin
Christopher Nicklin
SMStuart McLean
Stuart McLean
In this focused methodological synthesis, the sample construction procedures of 110 second language (L2) instructed vocabulary interventions were assessed in relation to effect size–driven sample-size planning, randomization, and multisite usage. These three areas were investigated because inferential testing makes better generalizations when researchers consider them during the sample construction process. Only nine reports used effect sizes to plan or justify sample sizes in any fashion, with only one engaging in an a priori power procedure referencing vocabulary-centric effect sizes from previous research. Randomized assignment was observed in 56% of the reports while no report involved randomized sampling. Approximately 15% of the samples observed were constructed from multiple sites and none of these empirically investigated the effect of site clustering. Leveraging the synthesized findings, we conclude by offering suggestions for future L2 instructed vocabulary researchers to consider a priori effect size–driven sample planning processes, randomization, and multisite usage when constructing samples.

30 March 2022 in TESOL Quarterly
Verified
Journal Article
Closed access
JCJunyu Cheng
Junyu Cheng
JMJoshua Matthews
Joshua Matthews
KLKriss Lange
Kriss Lange
SMStuart McLean
Stuart McLean