José Ángel González Barba

Mr. José Ángel González Barba

orcid

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
22 October 2021 in Applied Sciences
Verified
Journal Article
Open access
PDF file
VAVicent Ahuir
Vicent Ahuir
LHLluís-Felip Hurtado
Lluís-Felip Hurtado
JBJosé Ángel González Barba
José Ángel González Barba
ESEncarnación Segarra Soriano
Encarnación Segarra Soriano
Most of the models proposed in the literature for abstractive summarization are generally suitable for the English language but not for other languages. Multilingual models were introduced to address that language constraint, but despite their applicability being broader than that of the monolingual models, their performance is typically lower, especially for minority languages like Catalan. In this paper, we present a monolingual model for abstractive summarization of textual content in the Catalan language. The model is a Transformer encoder-decoder which is pretrained and fine-tuned specifically for the Catalan language using a corpus of newspaper articles. In the pretraining phase, we introduced several self-supervised tasks to specialize the model on the summarization task and to increase the abstractivity of the generated summaries. To study the performance of our proposal in languages with higher resources than Catalan, we replicate the model and the experimentation for the Spanish language. The usual evaluation metrics, not only the most used ROUGE measure but also other more semantic ones such as BertScore, do not allow to correctly evaluate the abstractivity of the generated summaries. In this work, we also present a new metric, called content reordering, to evaluate one of the most common characteristics of abstractive summaries, the rearrangement of the original content. We carried out an exhaustive experimentation to compare the performance of the monolingual models proposed in this work with two of the most widely used multilingual models in text summarization, mBART and mT5. The experimentation results support the quality of our monolingual models, especially considering that the multilingual models were pretrained with many more resources than those used in our models. Likewise, it is shown that the pretraining tasks helped to increase the degree of abstractivity of the generated summaries. To our knowledge, this is the first work that explores a monolingual approach for abstractive summarization both in Catalan and Spanish.

11 September 2023
Verified
Book Chapter
Closed access
PDF file
ASAreg Mikael Sarvazyan
Areg Mikael Sarvazyan
JBJosé Ángel González Barba
José Ángel González Barba
PRPaolo Rosso
Paolo Rosso
MFMarc Franco-Salvador
Marc Franco-Salvador

15 January 2024 in Applied Sciences
Verified
Journal Article
Open access
PDF file
VAVicent Ahuir
Vicent Ahuir
JBJosé Ángel González Barba
José Ángel González Barba
LHLluís-Felip Hurtado
Lluís-Felip Hurtado
ESEncarnación Segarra Soriano
Encarnación Segarra Soriano
Emotions are central to understanding contemporary journalism; however, they are overlooked in automatic news summarization. Actually, summaries are an entry point to the source article that could favor some emotions to captivate the reader. Nevertheless, the emotional content of summarization corpora and the emotional behavior of summarization models are still unexplored. In this work, we explore the usage of established methodologies to study the emotional content of summarization corpora and the emotional behavior of summarization models. Using these methodologies, we study the emotional content of two widely used summarization corpora: Cnn/Dailymail and Xsum, and the capabilities of three state-of-the-art transformer-based abstractive systems for eliciting emotions in the generated summaries: Bart, Pegasus, and T5. The main significant findings are as follows: (i) emotions are persistent in the two summarization corpora, (ii) summarizers approach moderately well the emotions of the reference summaries, and (iii) more than 75% of the emotions introduced by novel words in generated summaries are present in the reference ones. The combined use of these methodologies has allowed us to conduct a satisfactory study of the emotional content in news summarization.

22 May 2020 in Neural Processing Letters
Verified
Journal Article
Closed access
PDF file
RSRosario Sanchis-Font
Rosario Sanchis-Font
MCMaría José Castro
María José Castro
JBJosé Ángel González Barba
José Ángel González Barba
FPFerran Pla
Ferran Pla
LHLluís-Felip Hurtado
Lluís-Felip Hurtado

23 March 2019 in Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology
Verified
Journal Article
Closed access
PDF file
JBJosé Ángel González Barba
José Ángel González Barba
ESEncarnación Segarra Soriano
Encarnación Segarra Soriano
FGFernando García-Granada
Fernando García-Granada
ESEmilio Sanchis
Emilio Sanchis
LHLlu&Rsquo;Is-F. Hurtado
Llu&Rsquo;Is-F. Hurtado
In this paper, we present an extractive approach to document summarization based on Siamese Neural Networks. Specifically, we propose the use of Hierarchical Attention Networks to select the most relevant sentences of a text to make its summary. We train Siamese Neural Networks using document-summary pairs to determine whether the summary is appropriated for the document or not. By means of a sentence-level attention mechanism the most relevant sentences in the document can be identified. Hence, once the network is trained, it can be used to generate extractive summaries. The experimentation carried out using the CNN/DailyMail summarization corpus shows the adequacy of the proposal. In summary, we propose a novel end-to-end neural network to address extractive summarization as a binary classification problem which obtains promising results in-line with the state-of-the-art on the CNN/DailyMail corpus.

22 January 2023 in Applied Sciences
Verified
Journal Article
Open access
PDF file
JBJosé Ángel González Barba
José Ángel González Barba
ESEncarnación Segarra Soriano
Encarnación Segarra Soriano
FGFernando García-Granada
Fernando García-Granada
ESEmilio Sanchis
Emilio Sanchis
LHLluís-Felip Hurtado
Lluís-Felip Hurtado
In this work, a general theoretical framework for extractive summarization is proposed—the Attentional Extractive Summarization framework. Although abstractive approaches are generally used in text summarization today, extractive methods can be especially suitable for some applications, and they can help with other tasks such as Text Classification, Question Answering, and Information Extraction. The proposed approach is based on the interpretation of the attention mechanisms of hierarchical neural networks, which compute document-level representations of documents and summaries from sentence-level representations, which, in turn, are computed from word-level representations. The models proposed under this framework are able to automatically learn relationships among document and summary sentences, without requiring Oracle systems to compute the reference labels for each sentence before the training phase. These relationships are obtained as a result of a binary classification process, the goal of which is to distinguish correct summaries for documents. Two different systems, formalized under the proposed framework, were evaluated on the CNN/DailyMail and the NewsRoom corpora, which are some of the reference corpora in the most relevant works on text summarization. The results obtained during the evaluation support the adequacy of our proposal and suggest that there is still room for the improvement of our attentional framework.