Lucia Specia

Lucia Specia

Auto-generated profile, based on publicly available information

Lucia Specia

Imperial College London

Research Focus & Metrics

Academic Career Length

21Years (2006-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2017
Verified
Conference Paper
Open access
DCDaniel Cer
Daniel Cer
MDMona Diab
Mona Diab
EAEneko Agirre
Eneko Agirre
IÑIGO LOPEZ-GAZPIOIÑIGO LOPEZ-GAZPIO
IÑIGO LOPEZ-GAZPIO
LSLucia Specia
Lucia Specia

1 January 2016
Verified
Conference Paper
Open access
DEDesmond Elliott
Desmond Elliott
SFStella Frank
Stella Frank
KSKhalil Sima'AN
Khalil Sima'AN
LSLucia Specia
Lucia Specia

22 June 2007
Verified
Book Chapter
Closed access
PDF file
LSLucia Specia
Lucia Specia
EMEnrico Motta
Enrico Motta

1 January 2017
Verified
Conference Paper
Open access
OBOndřej Bojar
Ondřej Bojar
RCRajen Chatterjee
Rajen Chatterjee
CFChristian Federmann
Christian Federmann
YGYvette Graham
Yvette Graham
BHBarry Haddow
Barry Haddow
MTMarco Turchi
Marco Turchi

23 December 2021 in Computational Linguistics
Verified
Journal Article
Open access
PDF file
FAFernando Alva-Manchego
Fernando Alva-Manchego
CSCarolina Scarton
Carolina Scarton
LSLucia Specia
Lucia Specia
In order to simplify sentences, several rewriting operations can be performed, such as replacing complex words per simpler synonyms, deleting unnecessary information, and splitting long sentences. Despite this multi-operation nature, evaluation of automatic simplification systems relies on metrics that moderately correlate with human judgments on the simplicity achieved by executing specific operations (e.g., simplicity gain based on lexical replacements). In this article, we investigate how well existing metrics can assess sentence-level simplifications where multiple operations may have been applied and which, therefore, require more general simplicity judgments. For that, we first collect a new and more reliable data set for evaluating the correlation of metrics and human judgments of overall simplicity. Second, we conduct the first meta-evaluation of automatic metrics in Text Simplification, using our new data set (and other existing data) to analyze the variation of the correlation between metrics’ scores and human judgments across three dimensions: the perceived simplicity level, the system type, and the set of references used for computation. We show that these three aspects affect the correlations and, in particular, highlight the limitations of commonly used operation-specific metrics. Finally, based on our findings, we propose a set of recommendations for automatic evaluation of multi-operation simplifications, suggesting which metrics to compute and how to interpret their scores.

1 January 2016
Verified
Conference Paper
Open access
LSLucia Specia
Lucia Specia
SFStella Frank
Stella Frank
KSKhalil Sima'AN
Khalil Sima'AN
DEDesmond Elliott
Desmond Elliott