Lexin Zhou

Lexin Zhou

Auto-generated profile, based on publicly available information

Lexin Zhou

Princeton University, Princeton, USA

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
25 September 2024 in Nature
Verified
Journal Article
Open access
PDF file
LZLexin Zhou
Lexin Zhou
WSWout Schellaert
Wout Schellaert
FMFernando Martínez-Plumed
Fernando Martínez-Plumed
YMYael Moros-Daval
Yael Moros-Daval
CFCèsar Ferri
Cèsar Ferri
Jose Hernandez-OralloJose Hernandez-Orallo
Jose Hernandez-Orallo
The prevailing methods to make large language models more powerful and amenable have been based on continuous scaling up (that is, increasing their size, data volume and computational resources1) and bespoke shaping up (including post-filtering2,3, fine tuning or use of human feedback4,5). However, larger and more instructable large language models may have become less reliable. By studying the relationship between difficulty concordance, task avoidance and prompting stability of several language model families, here we show that easy instances for human participants are also easy for the models, but scaled-up, shaped-up models do not secure areas of low difficulty in which either the model does not err or human supervision can spot the errors. We also find that early models often avoid user questions but scaled-up, shaped-up models tend to give an apparently sensible yet wrong answer much more often, including errors on difficult questions that human supervisors frequently overlook. Moreover, we observe that stability to different natural phrasings of the same question is improved by scaling-up and shaping-up interventions, but pockets of variability persist across difficulty levels. These findings highlight the need for a fundamental shift in the design and development of general-purpose artificial intelligence, particularly in high-stakes areas for which a predictable distribution of errors is paramount.

1 April 2026 in Nature
Verified
Journal Article
Open access
PDF file
LZLexin Zhou
Lexin Zhou
LPLorenzo Pacchiardi
Lorenzo Pacchiardi
FMFernando Martínez-Plumed
Fernando Martínez-Plumed
KCKatherine M. Collins
Katherine M. Collins
YMYael Moros-Daval
Yael Moros-Daval
Jose Hernandez-OralloJose Hernandez-Orallo
Jose Hernandez-Orallo
Ensuring safe and effective use of artificial intelligence (AI) requires understanding and anticipating its performance on new tasks, from advanced scientific challenges to transformed workplace activities 1–3 . So far, benchmarking has guided progress in AI but has offered limited explanatory and predictive power for general-purpose AI systems 4–8 , attributed to limited transferability across specific tasks 9–11 . Here we introduce general scales for AI evaluation that elicit demand profiles explaining what capabilities common AI benchmarks truly measure, extract ability profiles quantifying the general strengths and limits of AI systems and robustly predict AI performance for new task instances. Our fully automated methodology builds on 18 rubrics, capturing a broad range of cognitive and intellectual demands, which place different task instances on the same general scales, illustrated on 15 large language models (LLMs) and 63 tasks. Both the demand and the ability profiles on these scales bring new insights such as construct validity through benchmark sensitivity and specificity and explain conflicting claims about whether AI has reasoning capabilities. Ultimately, high predictive power at the instance level becomes possible using the general scales, providing superior estimates over strong black-box baseline predictors, especially in out-of-distribution settings (new tasks and benchmarks). The scales, rubrics, battery, techniques and results presented here constitute a solid foundation for a science of AI evaluation, underpinning the reliable deployment of AI in the years ahead.

30 March 2022 in JMIR Public Health and Surveillance
Verified
Journal Article
Open access
LZLexin Zhou
Lexin Zhou
NRNekane Romero-Garcia
Nekane Romero-Garcia
Juan Martínez-MirandaJuan Martínez-Miranda
Juan Martínez-Miranda
J. Alberto ConejeroJ. Alberto Conejero
J. Alberto Conejero
JGJuan Miguel Garcia-Gomez
Juan Miguel Garcia-Gomez
CSCarlos Sáez
Carlos Sáez
Background: The COVID-19 pandemic has led to an unprecedented global health care challenge for both medical institutions and researchers. Recognizing different COVID-19 subphenotypes—the division of populations of patients into more meaningful subgroups driven by clinical features—and their severity characterization may assist clinicians during the clinical course, the vaccination process, research efforts, the surveillance system, and the allocation of limited resources. Objective: We aimed to discover age-sex unbiased COVID-19 patient subphenotypes based on easily available phenotypical data before admission, such as pre-existing comorbidities, lifestyle habits, and demographic features, to study the potential early severity stratification capabilities of the discovered subgroups through characterizing their severity patterns, including prognostic, intensive care unit (ICU), and morbimortality outcomes. Methods: We used the Mexican Government COVID-19 open data, including 778,692 SARS-CoV-2 population-based patient-level data as of September 2020. We applied a meta-clustering technique that consists of a 2-stage clustering approach combining dimensionality reduction (ie, principal components analysis and multiple correspondence analysis) and hierarchical clustering using the Ward minimum variance method with Euclidean squared distance. Results: In the independent age-sex clustering analyses, 56 clusters supported 11 clinically distinguishable meta-clusters (MCs). MCs 1-3 showed high recovery rates (90.27%-95.22%), including healthy patients of all ages, children with comorbidities and priority in receiving medical resources (ie, higher rates of hospitalization, intubation, and ICU admission) compared with other adult subgroups that have similar conditions, and young obese smokers. MCs 4-5 showed moderate recovery rates (81.30%-82.81%), including patients with hypertension or diabetes of all ages and obese patients with pneumonia, hypertension, and diabetes. MCs 6-11 showed low recovery rates (53.96%-66.94%), including immunosuppressed patients with high comorbidity rates, patients with chronic kidney disease with a poor survival length and probability of recovery, older smokers with chronic obstructive pulmonary disease, older adults with severe diabetes and hypertension, and the oldest obese smokers with chronic obstructive pulmonary disease and mild cardiovascular disease. Group outcomes conformed to the recent literature on dedicated age-sex groups. Mexican states and several types of clinical institutions showed relevant heterogeneity regarding severity, potentially linked to socioeconomic or health inequalities. Conclusions: The proposed 2-stage cluster analysis methodology produced a discriminative characterization of the sample and explainability over age and sex. These results can potentially help in understanding the clinical patient and their stratification for automated early triage before further tests and laboratory results are available and even in locations where additional tests are not available or to help decide resource allocation among vulnerable subgroups such as to prioritize vaccination or treatments.

30 January 2026 in Artificial Intelligence
Verified
Journal Article
Open access
LZLexin Zhou
Lexin Zhou
PCPablo A.M. Casares
Pablo A.M. Casares
FMFernando Martínez-Plumed
Fernando Martínez-Plumed
JBJohn Burden
John Burden
RBRyan Burnell
Ryan Burnell
Jose Hernandez-OralloJose Hernandez-Orallo
Jose Hernandez-Orallo

2 February 2022 in Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology
Verified
Journal Article
Closed access
PDF file
LZLexin Zhou
Lexin Zhou
WYWenzhong Yang
Wenzhong Yang
TWTing Wang
Ting Wang
YWyongzhi wu
yongzhi wu
Aspect-based sentiment analysis (ABSA) contains three subtasks, namely aspect term extraction, opinion term extraction and aspect-level sentiment classification. In order to make full use of the relationship between the three subtasks, some recent studies have successfully tried to use a unified framework to solve the problem of aspect-based sentiment analysis. However, these studies have not yet integrated domain knowledge into the model. Inspired by the post-training task, we propose a joint model (RACL-BERT-PT). This model combines the pre-training model BERT-PT with domain knowledge and the unified joint training framework RACL. The experimental results show that our model has achieved better results than previous experiments on three public data.

29 April 2021 in JMIR Preprints
Verified
Preprint
Open access
LZLexin Zhou
Lexin Zhou
NRNekane Romero-Garcia
Nekane Romero-Garcia
Juan Martínez-MirandaJuan Martínez-Miranda
Juan Martínez-Miranda
J. Alberto ConejeroJ. Alberto Conejero
J. Alberto Conejero
JGJuan Miguel Garcia-Gomez
Juan Miguel Garcia-Gomez
CSCarlos Sáez
Carlos Sáez
BACKGROUND The COVID-19 pandemic has led to an unprecedented global health care challenge for both medical institutions and researchers. Recognizing different COVID-19 subphenotypes—the division of populations of patients into more meaningful subgroups driven by clinical features—and their severity characterization may assist clinicians during the clinical course, the vaccination process, research efforts, the surveillance system, and the allocation of limited resources. OBJECTIVE We aimed to discover age-sex unbiased COVID-19 patient subphenotypes based on easily available phenotypical data before admission, such as pre-existing comorbidities, lifestyle habits, and demographic features, to study the potential early severity stratification capabilities of the discovered subgroups through characterizing their severity patterns, including prognostic, intensive care unit (ICU), and morbimortality outcomes. METHODS We used the Mexican Government COVID-19 open data, including 778,692 SARS-CoV-2 population-based patient-level data as of September 2020. We applied a meta-clustering technique that consists of a 2-stage clustering approach combining dimensionality reduction (ie, principal components analysis and multiple correspondence analysis) and hierarchical clustering using the Ward minimum variance method with Euclidean squared distance. RESULTS In the independent age-sex clustering analyses, 56 clusters supported 11 clinically distinguishable meta-clusters (MCs). MCs 1-3 showed high recovery rates (90.27%-95.22%), including healthy patients of all ages, children with comorbidities and priority in receiving medical resources (ie, higher rates of hospitalization, intubation, and ICU admission) compared with other adult subgroups that have similar conditions, and young obese smokers. MCs 4-5 showed moderate recovery rates (81.30%-82.81%), including patients with hypertension or diabetes of all ages and obese patients with pneumonia, hypertension, and diabetes. MCs 6-11 showed low recovery rates (53.96%-66.94%), including immunosuppressed patients with high comorbidity rates, patients with chronic kidney disease with a poor survival length and probability of recovery, older smokers with chronic obstructive pulmonary disease, older adults with severe diabetes and hypertension, and the oldest obese smokers with chronic obstructive pulmonary disease and mild cardiovascular disease. Group outcomes conformed to the recent literature on dedicated age-sex groups. Mexican states and several types of clinical institutions showed relevant heterogeneity regarding severity, potentially linked to socioeconomic or health inequalities. CONCLUSIONS The proposed 2-stage cluster analysis methodology produced a discriminative characterization of the sample and explainability over age and sex. These results can potentially help in understanding the clinical patient and their stratification for automated early triage before further tests and laboratory results are available and even in locations where additional tests are not available or to help decide resource allocation among vulnerable subgroups such as to prioritize vaccination or treatments.