Lorraine Goeuriot

Dr. Lorraine Goeuriot

Laboratoire d'informatique de Grenoble - Equipe MRIM, Université Grenoble Alpes, 38400 Saint-Martin-d'Hères, France

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 November 2015 in Lecture Notes in Computer Science
Verified
Book Chapter
Open access
PDF file
Lorraine GoeuriotLorraine Goeuriot
Lorraine Goeuriot
LKLiadh Kelly
Liadh Kelly
HSHanna Suominen
Hanna Suominen
LHLeif Hanlen
Leif Hanlen
ANAurélie Névéol
Aurélie Névéol
GZGuido Zuccon
Guido Zuccon
This paper reports on the 3rd CLEFeHealth evaluation lab, which continues our evaluation resource building activities for the medical domain. In this edition of the lab, we focus on easing patients and nurses in authoring, understanding, and accessing eHealth information. The 2015 CLEFeHealth evaluation lab was structured into two tasks, focusing on evaluating methods for information extraction (IE) and information retrieval (IR). The IE task introduced two new challenges. Task 1a focused on clinical speech recognition of nursing handover notes; Task 1b focused on clinical named entity recognition in languages other than English, specifically French. Task 2 focused on the retrieval of health information to answer queries issued by general consumers seeking information to understand their health symptoms or conditions. The number of teams registering their interest was 47 in Tasks 1 (2 teams in Task 1a and 7 teams in Task 1b) and 53 in Task 2 (12 teams) for a total of 20 unique teams. The best system recognized 4, 984 out of 6, 818 test words correctly and generated 2, 626 incorrect words (i.e., \(38.5 \%\) error) in Task 1a; had the F-measure of 0.756 for plain entity recognition, 0.711 for normalized entity recognition, and 0.872 for entity normalization in Task 1b; and resulted in P@10 of 0.5394 and nDCG@10 of 0.5086 in Task 2. These results demonstrate the substantial community interest and capabilities of these systems in addressing challenges faced by patients and nurses. As in previous years, the organizers have made data and tools available for future research and development.

11 January 2016 in Information Retrieval Journal
Verified
Journal Article
Open access
PDF file
Lorraine GoeuriotLorraine Goeuriot
Lorraine Goeuriot
GJGareth J. F. Jones
Gareth J. F. Jones
LKLiadh Kelly
Liadh Kelly
HMHenning Müller
Henning Müller
JZJustin Zobel
Justin Zobel

15 September 2020
Verified
Book Chapter
Closed access
PDF file
Lorraine GoeuriotLorraine Goeuriot
Lorraine Goeuriot
HSHanna Suominen
Hanna Suominen
LKLiadh Kelly
Liadh Kelly
AMAntonio Miranda-Escalada
Antonio Miranda-Escalada
MKMartin Krallinger
Martin Krallinger
CXChenchen Xu
Chenchen Xu

18 July 2023
Verified
Conference Paper
Open access
PGPetra Galuscáková
Petra Galuscáková
RDRomain Deveaud
Romain Deveaud
GSGabriela González Sáez
Gabriela González Sáez
PMPhilippe Mulhem
Philippe Mulhem
Lorraine GoeuriotLorraine Goeuriot
Lorraine Goeuriot
MPMartin Popel
Martin Popel
LongEval-Retrieval is a Web document retrieval benchmark that focuses on continuous retrieval evaluation. This test collection is intended to be used to study the temporal persistence of Information Retrieval systems and will be used as the test collection in the Longitudinal Evaluation of Model Performance Track (LongEval) at CLEF 2023. This benchmark simulates an evolving information system environment - such as the one a Web search engine operates in - where the document collection, the query distribution, and relevance all move continuously, while following the Cranfield paradigm for offline evaluation. To do that, we introduce the concept of a dynamic test collection that is composed of successive sub-collections each representing the state of an information system at a given time step. In LongEval-Retrieval, each sub-collection contains a set of queries, documents, and soft relevance assessments built from click models. The data comes from Qwant, a privacy-preserving Web search engine that primarily focuses on the French market. LongEval-Retrieval also provides a 'mirror' collection: it is initially constructed in the French language to benefit from the majority of Qwant's traffic, before being translated to English. This paper presents the creation process of LongEval-Retrieval and provides baseline runs and analysis.

11 September 2023
Verified
Book Chapter
Closed access
PDF file
RARabab Alkhalifa
Rabab Alkhalifa
IBIman Bilal
Iman Bilal
HBHsuvas Borkakoty
Hsuvas Borkakoty
JCJose Camacho-Collados
Jose Camacho-Collados
RDRomain Deveaud
Romain Deveaud
Arkaitz ZubiagaArkaitz Zubiaga
Arkaitz Zubiaga

27 July 2018 in JMIR Research Protocols
Verified
Journal Article
Open access
HSHanna Suominen
Hanna Suominen
LKLiadh Kelly
Liadh Kelly
Lorraine GoeuriotLorraine Goeuriot
Lorraine Goeuriot
Background: The eHealth initiative of the Conference and Labs of the Evaluation Forum (CLEF) has aimed since 2012 to provide researchers working on health text analytics with annual workshops, shared development challenges and tasks, benchmark datasets, and software for processing and evaluation. In 2012, it ran as a scientific workshop with the aim of establishing an evaluation lab, and since 2013, this annual workshop has been supplemented with 3 or more preceding labs each year. An evaluation lab is an activity where the participating individuals or teams’ goal is to solve the same problem, typically using the same dataset in a given time frame. The overall purpose of this initiative is to support patients, their next of kin, clinical staff, health scientists, and health care policy makers in accessing, understanding, using, and authoring health information in a multilingual setting. In the CLEF eHealth 2013 to 2017 installations, the aim was to address patient-centric text processing. From 2015, the scope was also extended to aid both patients’ understanding and clinicians’ authoring of various types of medical content. CLEF eHealth 2017 introduced a new pilot task on technology-assisted reviews (TARs) in empirical medicine in order to support health scientists and health care policymakers’ information access. Objectives: This original research paper reports on the outcomes of the first 6 installations of CLEF eHealth from 2012 to 2017. The focus is on measuring and analyzing the scholarly influence by reviewing CLEF eHealth papers and their citations. Methods: A review and bibliometric study of the CLEF eHealth proceedings, working notes, and author-declared paper extensions were conducted. Citation content analysis was used for the publications and their citations collected from Google Scholar. Results: As many as 718 teams registered their interest in the tasks, leading to 130 teams submitting to the 15 tasks. A total of 184 papers using CLEF eHealth data generated 1299 citations, yielding a total scholarly citation influence of almost 963,000 citations for the 741 coauthors, and included authors from 33 countries across the world. Eight tasks produced statistically significant improvements (2, 3, and 3 times with P<.001, P=.009, and P=.04, respectively) in processing quality by at least 1 out of the top 3 methods. Conclusions: These substantial participation numbers, large citation counts, and significant performance improvements encourage continuing to develop these technologies to address patient needs. Consequently, data and tools have been opened for future research and development, and the CLEF eHealth initiative continues to run new challenges.