Gerardo Sierra

Gerardo Sierra


Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
7 November 2024 in Preprints.org
Verified
Preprint
Open access
PDF file
ÁCÁngel Cadena-Bautista
Ángel Cadena-Bautista
FPFrancisco Fernando López Ponce
Francisco Fernando López Ponce
SOSergio Ojeda-Trueba
Sergio Ojeda-Trueba
GSGerardo Sierra
Gerardo Sierra
GBGemma Bel-Enguix
Gemma Bel-Enguix
In this paper various LLMs are tested in a specific domain using a Retrieval-Augmented Generation (RAG) system. The study focuses on the performance and behaviour of the models and was conducted in Spanish. A questionnaire based on The Bible, which consist of questions that vary in complexity of reasoning, was created in order to evaluate the reasoning capabilities of each model. The RAG system matches a question with the most similar passage from The Bible and feeds the pair to each LLM. The evaluation aims to determine whether each model can reason solely with the provided information or if it disregards the instructions given and makes use on its pretrained knowledge.