Santiago Miret

Santiago Miret

Auto-generated profile, based on publicly available information

Santiago Miret

Intel Labs, Santa Clara, USA

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 December 2024 in Chemical Society Reviews
Verified
Journal Article
Open access
PDF file
MSMara Schilling-Wilhelmi
Mara Schilling-Wilhelmi
MRMartiño Ríos-García
Martiño Ríos-García
SSSherjeel Shabih
Sherjeel Shabih
MGM. Victoria Gil
M. Victoria Gil
SMSantiago Miret
Santiago Miret
KJKevin Maik Jablonka
Kevin Maik Jablonka
Large language models (LLMs) allow for the extraction of structured data from unstructured sources, such as scientific papers, with unprecedented accuracy and performance.

20 May 2025 in Nature Chemistry
Verified
Journal Article
Open access
AMAdrian Mirza
Adrian Mirza
NANawaf Alampara
Nawaf Alampara
SKSreekanth Kunchapu
Sreekanth Kunchapu
MRMartiño Ríos-García
Martiño Ríos-García
BEBenedict Emoekabu
Benedict Emoekabu
KJKevin Maik Jablonka
Kevin Maik Jablonka
Large language models (LLMs) have gained widespread interest owing to their ability to process human language and perform tasks on which they have not been explicitly trained. However, we possess only a limited systematic understanding of the chemical capabilities of LLMs, which would be required to improve models and mitigate potential harm. Here we introduce ChemBench, an automated framework for evaluating the chemical knowledge and reasoning abilities of state-of-the-art LLMs against the expertise of chemists. We curated more than 2,700 question–answer pairs, evaluated leading open- and closed-source LLMs and found that the best models, on average, outperformed the best human chemists in our study. However, the models struggle with some basic tasks and provide overconfident predictions. These findings reveal LLMs’ impressive chemical capabilities while emphasizing the need for further research to improve their safety and usefulness. They also suggest adapting chemistry education and show the value of benchmarking frameworks for evaluating LLMs in specific domains.

1 January 2024
Verified
Conference Paper
Open access
PDF file
HZHuan Zhang
Huan Zhang
YSYu Song
Yu Song
ZHZiyu Hou
Ziyu Hou
SMSantiago Miret
Santiago Miret
BLBang Liu
Bang Liu
Huan Zhang, Yu Song, Ziyu Hou, Santiago Miret, Bang Liu. Findings of the Association for Computational Linguistics: EMNLP 2024. 2024.

10 July 2025 in Nature Machine Intelligence
Verified
Journal Article
Closed access
PDF file
SMSantiago Miret
Santiago Miret
NKN M Anoop Krishnan
N M Anoop Krishnan

4 March 2024 in Digital Discovery
Verified
Journal Article
Open access
PDF file
VBVaibhav Bihani
Vaibhav Bihani
SMSajid Mannan
Sajid Mannan
UPUtkarsh Pratiush
Utkarsh Pratiush
TDTao Du
Tao Du
ZCZhimin Chen
Zhimin Chen
NKN M Anoop Krishnan
N M Anoop Krishnan
EGraFFBench: a framework for evaluating equivariant graph neural network force fields on dynamic atomistic simulations.

1 January 2023
Verified
Conference Paper
Open access
PDF file
PBParishad BehnamGhader
Parishad BehnamGhader
SMSantiago Miret
Santiago Miret
SRSiva Reddy
Siva Reddy
Parishad BehnamGhader, Santiago Miret, Siva Reddy. Findings of the Association for Computational Linguistics: EMNLP 2023. 2023.