Jui-Teng Liao

Prof. Dr. Jui-Teng Liao

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 February 2022 in Language Testing
Verified
Journal Article
Closed access
JLJui-Teng Liao
Jui-Teng Liao
Among the variety of selected response formats used in L2 reading assessment, multiple-choice (MC) is the most commonly adopted, primarily due to its efficiency and objectiveness. Given the impact of assessment results on teaching and learning, it is necessary to investigate the degree to which the MC format reliably measures learners’ L2 reading comprehension in the classroom context. While researchers have claimed that the longer the reading test (i.e., more test items and passages), the higher its overall reliability, few studies have investigated the optimal number of items and passages required for reliable classroom-based L2 reading assessment. To address this research gap, I adopted generalizability (G) theory to investigate the score reliability of the MC format in classroom-based L2 reading tests. A total of 108 ESL students at an American college completed an English reading test that included four passages, each of which was accompanied by five MC comprehension questions. The results showed that the score reliability of the L2 reading test was critically influenced by the number of items and passages, inasmuch as a different combination of the number of passages and items altered the degree of reliability. Implications for practitioners and educational researchers are discussed.

3 April 2024 in Education Sciences
Verified
Journal Article
Open access
PDF file
JLJui-Teng Liao
Jui-Teng Liao
KLKwangmin Lee
Kwangmin Lee
In the context of L2 academic reading, teachers tend to use a variety of question formats to assess students’ reading comprehension. Studies have revealed that not only question formats but also L2 language proficiency might affect how students use metacognitive strategies. Moreover, studies have determined that students’ L2 reading comprehension is positively influenced by their metacognitive knowledge, though whether this positive influence is reflected in students’ test scores is still under debate. This study therefore adopted path analyses to investigate the relationship between metacognitive knowledge, L2 reading proficiency, L2 reading test scores, and question formats. A total of 108 ESL students took English reading tests in multiple-choice and short-answer question formats and completed a reading strategy survey to measure their metacognitive knowledge of three types of strategies: global, problem-solving, and supporting. In both question formats, path analyses indicated that (1) metacognitive knowledge contributed to L2 reading test scores and (2) students’ L2 reading proficiency mediated the impact of metacognitive knowledge on their test performance. Moreover, path analyses revealed that question formats might play an important role in altering the impact of metacognitive knowledge on L2 reading test scores. Implications for instruction and L2 reading assessment are discussed.

13 May 2023 in Language Testing
Verified
Journal Article
Closed access
JLJui-Teng Liao
Jui-Teng Liao
RORenka Ohta
Renka Ohta
KLKwangmin Lee
Kwangmin Lee
As integrated writing tasks in large-scale and classroom-based writing assessments have risen in popularity, research studies have increasingly concentrated on providing validity evidence. Given the fact that most of these studies focus on adult second language learners rather than younger ones, this study examined the relationship between written discourse features, vocabulary support, and integrated listening-to-write scores for adolescent English learners. The participants of this study consisted of 198 Taiwanese high school students who completed two integrated listening-to-write tasks. Prior to each writing task, a list of key vocabulary was provided to aid the students’ comprehension of the listening passage. Their written products were coded and analyzed for measures of discourse features and vocabulary use, including complexity, accuracy, fluency, organization, vocabulary use ratio, and vocabulary use accuracy. We then adopted descriptive statistics and hierarchical linear regression analyses to investigate the extent to which such measures were predictive of integrated listening-to-write test scores. The results showed that fluency, organization, grammatical accuracy, and vocabulary use accuracy were significant predictors of the writing test scores. Moreover, the results revealed that providing vocabulary support may not necessarily jeopardize the validity of integrated listening-to-write tasks. The implications for research and test development were also discussed.

15 October 2021 in Reading in a Foreign Language
Verified
Journal Article
Open access
PDF file
JLJui-Teng Liao
Jui-Teng Liao
This study was to compare the processes that second language learners implemented when completing reading tasks in a multiple-choice question format (MCQ) with those in a short-answer question format (SAQ). Sixteen nonnative English-speaking students from a large Midwestern college in the United States were invited to complete MCQ and SAQ English reading tasks and then to engage in retrospective verbal reporting and semi-structured interviews. Results showed that when processing information in the source texts, students constructed text and situation models to (a) obtain a general understanding of the texts and (b) deepen their textual understanding. As students answered the comprehension questions, their question-answering processes were informed by the test format itself. Moreover, students employed different styles of interactive processing depending on whether they were completing MCQ or SAQ tasks. The implications of the study encourage test developers and teachers to implement a variety of test formats when possible.

28 January 2024 in Journal of English for Academic Purposes
Verified
Journal Article
Closed access
RYRebecca Yeager
Rebecca Yeager
GPGoMee Park
GoMee Park
JLJui-Teng Liao
Jui-Teng Liao

10 May 2021 in Language Assessment Quarterly
Verified
Journal Article
Closed access
JLJui-Teng Liao
Jui-Teng Liao
Jessica Wu is Research and Development Program Director at the Language Training and Testing Center (LTTC) in Taipei, Taiwan. Jessica has been deeply involved in the development and validation of the General English Proficiency Test (GEPT) in addition to a number of other foreign language testing programs. Her research focuses on speaking assessment and the impact of standardized language testing. Jessica is a founding member of the Asian Association for Language Assessment (AALA), for which she has served as both co-president (2016 to 2017) and president (2018 to 2019). She currently serves as an advisor for the development and administration of L1 tests (i.e., Hakka, Southern Min, and Indigenous language proficiency certifications) in Taiwan. Jessica has authored a number of publications, including articles and book chapters in the field of language testing, and has presented her work at conferences around the world. Most recently, she co-edited English Language Proficiency Testing in Asia: A New Paradigm Bridging Global and Local Contexts with Cyril Weir and I-Wen Su. Her contributions to language testing are significant and immeasurable, particularly with regard to Asia. The following interview with Jessica, which was conducted via an online meeting platform due to the COVID-19 pandemic, took place in January 2021.