Paula Viana

Prof. Paula Viana

School of Engineering, Polytechnic of Porto, 4200-072 Porto, Portugal
orcid

Research Focus & Metrics

Academic Career Length

34Years (1993-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 April 2014 in Multimedia Tools and Applications
Verified
Journal Article
Closed access
PDF file
MSMárcio Soares
Márcio Soares
Paula VianaPaula Viana
Paula Viana

22 April 2022 in IEEE Access
Verified
Journal Article
Open access
SSSerkan Sulun
Serkan Sulun
MDMatthew Davies
Matthew Davies
Paula VianaPaula Viana
Paula Viana
In this paper we present a new approach for the generation of multi-instrument symbolic music driven by musical emotion. The principal novelty of our approach centres on conditioning a state-of-the-art transformer based on continuous-valued valence and arousal labels. In addition, we provide a new large-scale dataset of symbolic music paired with emotion labels in terms of valence and arousal. We evaluate our approach in a quantitative manner in two ways, first by measuring its note prediction accuracy, and second via a regression task in the valence-arousal plane. Our results demonstrate that our proposed approaches outperform conditioning using control tokens which is representative of the current state of the art.

27 December 2023 in Sensors
Verified
Journal Article
Open access
PDF file
BPBruno Pereira
Bruno Pereira
Bruno CunhaBruno Cunha
Bruno Cunha
Paula VianaPaula Viana
Paula Viana
MLMaria Lopes
Maria Lopes
AMAna S. C. Melo
Ana S. C. Melo
Andreia S. P. S. P. SousaAndreia S. P. S. P. Sousa
Andreia S. P. S. P. Sousa
Shoulder rehabilitation is a process that requires physical therapy sessions to recover the mobility of the affected limbs. However, these sessions are often limited by the availability and cost of specialized technicians, as well as the patient’s travel to the session locations. This paper presents a novel smartphone-based approach using a pose estimation algorithm to evaluate the quality of the movements and provide feedback, allowing patients to perform autonomous recovery sessions. This paper reviews the state of the art in wearable devices and camera-based systems for human body detection and rehabilitation support and describes the system developed, which uses MediaPipe to extract the coordinates of 33 key points on the patient’s body and compares them with reference videos made by professional physiotherapists using cosine similarity and dynamic time warping. This paper also presents a clinical study that uses QTM, an optoelectronic system for motion capture, to validate the methods used by the smartphone application. The results show that there are statistically significant differences between the three methods for different exercises, highlighting the importance of selecting an appropriate method for specific exercises. This paper discusses the implications and limitations of the findings and suggests directions for future research.

23 February 2023 in Applied Sciences
Verified
Journal Article
Open access
PDF file
VGVânia Cristina da Silva Ribeiro Guimarães
Vânia Cristina da Silva Ribeiro Guimarães
JNJéssica Nascimento
Jéssica Nascimento
Paula VianaPaula Viana
Paula Viana
PCPedro Carvalho
Pedro Carvalho
When compared with traditional local shops where the customer has a personalised service, in large retail departments, the client has to make his purchase decisions independently, mostly supported by the information available in the package. Additionally, people are becoming more aware of the importance of the food ingredients and demanding about the type of products they buy and the information provided in the package, despite it often being hard to interpret. Big shops such as supermarkets have also introduced important challenges for the retailer due to the large number of different products in the store, heterogeneous affluence and the daily needs of item repositioning. In this scenario, the automatic detection and recognition of products on the shelves or off the shelves has gained increased interest as the application of these technologies may improve the shopping experience through self-assisted shopping apps and autonomous shopping, or even benefit stock management with real-time inventory, automatic shelf monitoring and product tracking. These solutions can also have an important impact on customers with visual impairments. Despite recent developments in computer vision, automatic grocery product recognition is still very challenging, with most works focusing on the detection or recognition of a small number of products, often under controlled conditions. This paper discusses the challenges related to this problem and presents a review of proposed methods for retail product label processing, with a special focus on assisted analysis for customer support, including for the visually impaired. Moreover, it details the public datasets used in this topic and identifies their limitations, and discusses future research directions of related fields.

25 July 2021 in Applied Sciences
Verified
Journal Article
Open access
PDF file
JAJoão Almeida
João Almeida
LVLuís Vilaça
Luís Vilaça
ITInês N. Teixeira
Inês N. Teixeira
Paula VianaPaula Viana
Paula Viana
Understanding how acting bridges the emotional bond between spectators and films is essential to depict how humans interact with this rapidly growing digital medium. In recent decades, the research community made promising progress in developing facial expression recognition (FER) methods. However, no emphasis has been put in cinematographic content, which is complex by nature due to the visual techniques used to convey the desired emotions. Our work represents a step towards emotion identification in cinema through facial expressions’ analysis. We presented a comprehensive overview of the most relevant datasets used for FER, highlighting problems caused by their heterogeneity and to the inexistence of a universal model of emotions. Built upon this understanding, we evaluated these datasets with a standard image classification models to analyze the feasibility of using facial expressions to determine the emotional charge of a film. To cope with the problem of lack of datasets for the scope under analysis, we demonstrated the feasibility of using a generic dataset for the training process and propose a new way to look at emotions by creating clusters of emotions based on the evidence obtained in the experiments.

11 July 2025 in ACM Computing Surveys
Verified
Journal Article
Open access
LVLuís Vilaça
Luís Vilaça
YYYi Yu
Yi Yu
Paula VianaPaula Viana
Paula Viana
Audio-visual correlation learning aims at capturing and understanding natural phenomena between audio and visual data. The rapid growth of dl propelled the development of proposals that process audio-visual data and can be observed in the number of proposals in the past years. Thus encouraging the development of a comprehensive survey. Besides analyzing the models used in this context, we also discuss some tasks of definition and paradigm applied in AI multimedia. In addition, we investigate objective functions frequently used and discuss how audio-visual data is exploited in the optimization process, i.e., the different methodologies for representing knowledge in the audio-visual domain. In fact, we focus on how human-understandable mechanisms, i.e., structured knowledge that reflects comprehensible knowledge, can guide the learning process. Most importantly, we provide a summarization of the recent progress of ()avcl and discuss the future research directions.