Francisco Guzmán

Francisco Guzmán

Auto-generated profile, based on publicly available information

Francisco Guzmán

Facebook AI

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 September 2017 in Computer Speech & Language
Verified
Journal Article
Closed access
FGFrancisco Guzmán
Francisco Guzmán
SJShafiq Joty
Shafiq Joty
LMLluís Màrquez
Lluís Màrquez
PNPreslav Nakov
Preslav Nakov

1 December 2017 in Computational Linguistics
Verified
Journal Article
Open access
SJShafiq Joty
Shafiq Joty
FGFrancisco Guzmán
Francisco Guzmán
LMLluís Màrquez
Lluís Màrquez
PNPreslav Nakov
Preslav Nakov
In this article, we explore the potential of using sentence-level discourse structure for machine translation evaluation. We first design discourse-aware similarity measures, which use all-subtree kernels to compare discourse parse trees in accordance with the Rhetorical Structure Theory (RST). Then, we show that a simple linear combination with these measures can help improve various existing machine translation evaluation metrics regarding correlation with human judgments both at the segment level and at the system level. This suggests that discourse information is complementary to the information used by many of the existing evaluation metrics, and thus it could be taken into account when developing richer evaluation metrics, such as the WMT-14 winning combined metric DiscoTKparty. We also provide a detailed analysis of the relevance of various discourse elements and relations from the RST parse trees for machine translation evaluation. In particular, we show that (i) all aspects of the RST tree are relevant, (ii) nuclearity is more useful than relation type, and (iii) the similarity of the translation RST tree to the reference RST tree is positively correlated with translation quality.

1 January 2020
Verified
Conference Paper
Open access
PDF file
LSLucia Specia
Lucia Specia
FBFrédéric Blain
Frédéric Blain
MFMarina Fomicheva
Marina Fomicheva
EFErick Fonseca
Erick Fonseca
VCVishrav Chaudhary
Vishrav Chaudhary
AMAndré F. T. Martins
André F. T. Martins
Lucia Specia, Frédéric Blain, Marina Fomicheva, Erick Fonseca, Vishrav Chaudhary, Francisco Guzmán, André F. T. Martins. Proceedings of the Fifth Conference on Machine Translation. 2020.


1 January 2020
Verified
Conference Paper
Open access
PDF file
PKPhilipp Koehn
Philipp Koehn
VCVishrav Chaudhary
Vishrav Chaudhary
AEAhmed El-Kishky
Ahmed El-Kishky
NGNaman Goyal
Naman Goyal
PCPeng-Jen Chen
Peng-Jen Chen
FGFrancisco Guzmán
Francisco Guzmán
Philipp Koehn, Vishrav Chaudhary, Ahmed El-Kishky, Naman Goyal, Peng-Jen Chen, Francisco Guzmán. Proceedings of the Fifth Conference on Machine Translation. 2020.

15 November 2019 in arXiv
Verified
Preprint
Open access
PDF file
GWGuillaume Wenzek
Guillaume Wenzek
MLMarie-Anne Lachaux
Marie-Anne Lachaux
ACAlexis Conneau
Alexis Conneau
VCVishrav Chaudhary
Vishrav Chaudhary
FGFrancisco Guzmán
Francisco Guzmán
EGEdouard Grave
Edouard Grave
Pre-training text representations have led to significant improvements in many areas of natural language processing. The quality of these models benefits greatly from the size of the pretraining corpora as long as its quality is preserved. In this paper, we describe an automatic pipeline to extract massive high-quality monolingual datasets from Common Crawl for a variety of languages. Our pipeline follows the data processing introduced in fastText (Mikolov et al., 2017; Grave et al., 2018), that deduplicates documents and identifies their language. We augment this pipeline with a filtering step to select documents that are close to high quality corpora like Wikipedia.