Enrico De Santis

Prof. Enrico De Santis

orcid

Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 May 2025 in Applied Energy
Verified
Journal Article
Open access
AVAlessio Verdone
Alessio Verdone
Massimo PanellaMassimo Panella
Massimo Panella
Enrico De SantisEnrico De Santis
Enrico De Santis
Antonello RizziAntonello Rizzi
Antonello Rizzi

17 July 2020 in IEEE Access
Verified
Journal Article
Open access
Enrico De SantisEnrico De Santis
Enrico De Santis
AMAlessio Martino
Alessio Martino
Antonello RizziAntonello Rizzi
Antonello Rizzi
The year 2020 opened with a dramatic epidemic caused by a new species of coronavirus that soon has been declared a pandemic by the WHO due to the high number of deaths and the critical mass of worldwide hospitalized patients, of order of millions. The COVID-19 pandemic has forced the governments of hundreds of countries to apply several heavy restrictions in the citizens’ socio-economic life. Italy was one of the most affected countries with long-term restrictions, impacting the socio-economic tissue. During this lockdown period, people got informed mostly on Online Social Media, where a heated debate followed all main ongoing events. In this scenario, the following study presents an in-depth analysis of the main emergent topics discussed during the lockdown phase within the Italian Twitter community. The analysis has been conducted through a general purpose methodological framework, grounded on a biological metaphor and on a chain of NLP and graph analysis techniques, in charge of detecting and tracking emerging topics in Online Social Media, e.g. streams of Twitter data. A term-frequency analysis in subsequent time slots is pipelined with nutrition and energy metrics for computing hot terms by also exploiting the tweets quality information, such as the social influence of the users. Finally, a co-occurrence analysis is adopted for building a topic graph where emerging topics are suitably selected. We demonstrate via a careful parameter setting the effectiveness of the topic tracking system, tailored to the current Twitter standard API restrictions, in capturing the main sociopolitical events that occurred during this dramatic phase.

24 January 2024 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Open access
Enrico De SantisEnrico De Santis
Enrico De Santis
AMAlessio Martino
Alessio Martino
Antonello RizziAntonello Rizzi
Antonello Rizzi
The introduction of Transformer architectures – with the self-attention mechanism – in automatic Natural Language Generation (NLG) is a breakthrough in solving general task-oriented problems, such as the simple production of long text excerpts that resemble ones written by humans. While the performance of GPT-X architectures is there for all to see, many efforts are underway to penetrate the secrets of these black-boxes in terms of intelligent information processing whose output statistical distributions resemble that of natural language. In this work, through the complexity science framework, a comparative study of the stochastic processes underlying the texts produced by the English version of GPT-2 with respect to texts produced by human beings, notably novels in English and programming codes, is offered. The investigation, of a methodological nature, consists first of all of an analysis phase in which the Multifractal Detrended Fluctuation Analysis and the Recurrence Quantification Analysis – together with Zipf's law and approximate entropy – are adopted to characterize long-term correlations, regularities and recurrences in human and machine-produced texts. Results show several peculiarities and trends in terms of long-range correlations and recurrences in the last case. The synthesis phase, on the other hand, uses the complexity measures to build synthetic text descriptors – hence a suitable text embedding – which serve to constitute the features for feeding a machine learning system designed to operate feature selection through an evolutionary technique. Using multivariate analysis, it is then shown the grouping tendency of the three analyzed text types, allowing to place GTP-2 texts in between natural language texts and computer codes. Similarly, the classification task demonstrates that, given the high accuracy obtained in the automatic discrimination of text classes, the proposed set of complexity measures is highly informative. These interesting results allow us to add another piece to the theoretical understanding of the surprising results obtained by NLG systems based on deep learning and let us to improve the design of new informetrics or text mining systems for text classification, fake news detection, or even plagiarism detection.

12 July 2024 in IEEE Transactions on Emerging Topics in Computational Intelligence
Verified
Journal Article
Open access
Enrico De SantisEnrico De Santis
Enrico De Santis
AMAlessio Martino
Alessio Martino
FRFrancesca Ronci
Francesca Ronci
Antonello RizziAntonello Rizzi
Antonello Rizzi
One notable paradigm shift in Natural Language Processing has been the introduction of Transformers, revolutionizing language modeling as Convolutional Neural Networks did for Computer Vision. The power of Transformers, along with many other innovative features, also lies in the integration of word embedding techniques, traditionally used to represent words in a text and to build classification systems directly. This study delves into the comparison of text representation techniques for classifying users who generate medical topic posts on Facebook discussion groups. Short and noisy social media texts in Italian pose challenges for user categorization. The study employs two datasets, one for word embedding model estimation and another comprising discussions from users. The main objective is to achieve optimal user categorization through different pre-processing and embedding techniques, aiming at high generalization performance despite class imbalance. The paper has a dual purpose, i.e., to build an effective classifier, ensuring accurate information dissemination in medical discussions and combating fake news, and to explore also the representational capabilities of various LLMs, especially concerning BERT, Mistral and GPT-4. The latter is investigated using the in-context learning approach. Finally, data visualization tools are used to evaluate the semantic embeddings with respect to the achieved performance. This investigation, focusing on classification performance, compares the classic BERT and several hybrid versions (i.e., employing different training strategies and approximate Support Vector Machines in the classification layer) against LLMs and several Bag-of-Words based embedding (notably, one of the earliest approaches in text classification). This research offers insights into the latest developments in language modeling, advancing in the field of text representation and its practical application for user classification within medical discussions.

16 January 2025 in Renewable and Sustainable Energy Reviews
Verified
Journal Article
Open access
Enrico De SantisEnrico De Santis
Enrico De Santis
PVPennazzi Vanessa
Pennazzi Vanessa
LMLuzi Massimiliano
Luzi Massimiliano
RARizzi Antonello
Rizzi Antonello

16 February 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
Enrico De SantisEnrico De Santis
Enrico De Santis
GSGiovanni De Santis
Giovanni De Santis
Antonello RizziAntonello Rizzi
Antonello Rizzi
The study of languages’ structure and their organization in a set of well-defined relation schemes is a delicate matter. In the last decades, the convergence of traditional conflicting views by linguists is supported by an interdisciplinary approach that involves not only genetics or bio-archelogy but nowadays even the science of complexity. In light of this new and useful approach, this study proposes an in-depth analysis of the complexity underlying the morphological organization, in terms of multifractality and long-range correlations, of several modern and ancient texts pertaining to various linguistic strains (including ancient Greek, Arabic, Coptic, Neo-Latin and Germanic languages). The methodology is grounded on the mapping procedure between lexical categories belonging to text excerpts and time series, which is based on the rank of the frequency occurrence. Through the well-known MFDFA technique and a specific multifractal formalism, several multifractal indexes are then extracted for characterizing texts and the multifractal signature has been adopted for characterizing several language families, such as Indo-European, Semitic and Hamito-Semitic. The regularities and differences in the linguistic strains are assessed within a multivariate statistical framework and corroborated with a Machine Learning approach that is dedicated, in turn, to investigate the predictive power of the multifractal signature pertinent to text excerpts. The obtained results show a strong presence of persistence, i.e., memory, in the morphological structure of analyzed texts and we claim that this property has a role in characterizing the studied linguistic families. In fact, for example, the proposed analysis framework – grounded on complexity indexes – is able to easily distinguish ancient Greek texts from Arabic ones, as they belong to different language strains, i.e., indo-European and Semitic, respectively. The proposed approach has been proven effective and can be adopted for further comparative studies and for designing new informetrics for further advances in the fields of information retrieval and Artificial Intelligence.