Tiago Soares da Costa

Prof. Dr. Tiago Soares da Costa

Institute for Systems and Computer Engineering of Porto, Porto, Portugal
orcid

Research Focus & Metrics

Academic Career Length

18Years (2009-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
8 October 2025 in Journal of Imaging
Verified
Journal Article
Open access
PDF file
ARAntonio Gouveia Ribeiro
Antonio Gouveia Ribeiro
LVLuís Vilaça
Luís Vilaça
CCCarlos Costa
Carlos Costa
Tiago Soares da CostaTiago Soares da Costa
Tiago Soares da Costa
PCPedro Carvalho
Pedro Carvalho
Quality control represents a critical function in industrial environments, ensuring that manufactured products meet strict standards and remain free from defects. In highly regulated sectors such as the pharmaceutical industry, traditional manual inspection methods remain widely used. However, these are time-consuming and prone to human error, and they lack the reliability required for large-scale operations, highlighting the urgent need for automated solutions. This is crucial for industrial applications, where environments evolve and new defect types can arise unpredictably. This work proposes an automated visual defect detection system specifically designed for pharmaceutical bottles, with potential applicability in other manufacturing domains. Various methods were integrated to create robust tools capable of real-world deployment. A key strategy is the use of incremental learning, which enables machine learning models to incorporate new, unseen data without full retraining, thus enabling adaptation to new defects as they appear, allowing models to handle rare cases while maintaining stability and performance. The proposed solution incorporates a multi-view inspection setup to capture images from multiple angles, enhancing accuracy and robustness. Evaluations in real-world industrial conditions demonstrated high defect detection rates, confirming the effectiveness of the proposed approach.

10 March 2022 in Journal of Imaging
Verified
Journal Article
Open access
PDF file
Paula VianaPaula Viana
Paula Viana
MAMaria Teresa Andrade
Maria Teresa Andrade
PCPedro Carvalho
Pedro Carvalho
LVLuís Vilaça
Luís Vilaça
ITInês N. Teixeira
Inês N. Teixeira
PJPieter Jonker
Pieter Jonker
Applying machine learning (ML), and especially deep learning, to understand visual content is becoming common practice in many application areas. However, little attention has been given to its use within the multimedia creative domain. It is true that ML is already popular for content creation, but the progress achieved so far addresses essentially textual content or the identification and selection of specific types of content. A wealth of possibilities are yet to be explored by bringing the use of ML into the multimedia creative process, allowing the knowledge inferred by the former to influence automatically how new multimedia content is created. The work presented in this article provides contributions in three distinct ways towards this goal: firstly, it proposes a methodology to re-train popular neural network models in identifying new thematic concepts in static visual content and attaching meaningful annotations to the detected regions of interest; secondly, it presents varied visual digital effects and corresponding tools that can be automatically called upon to apply such effects in a previously analyzed photo; thirdly, it defines a complete automated creative workflow, from the acquisition of a photograph and corresponding contextual data, through the ML region-based annotation, to the automatic application of digital effects and generation of a semantically aware multimedia story driven by the previously derived situational and visual contextual data. Additionally, it presents a variant of this automated workflow by offering to the user the possibility of manipulating the automatic annotations in an assisted manner. The final aim is to transform a static digital photo into a short video clip, taking into account the information acquired. The final result strongly contrasts with current standard approaches of creating random movements, by implementing an intelligent content- and context-aware video.

1 July 2019 in Electronics Letters
Verified
Journal Article
Open access
PDF file
Tiago Soares da CostaTiago Soares da Costa
Tiago Soares da Costa
MAM.T. Andrade
M.T. Andrade
Paula VianaPaula Viana
Paula Viana
This Letter discusses the benefits of introducing Machine Learning techniques in multi‐view streaming applications. Widespread use of machine learning techniques has contributed to significant gains in numerous scientific and industry fields. Nonetheless, these have not yet been specifically applied to adaptive interactive multimedia streaming systems where, typically, the encoding bit rate is adapted based on resources availability, targeting the efficient use of network resources whilst offering the best possible user quality of experience (QoE). Intrinsic user data could be coupled with such existing quality adaptation mechanisms to derive better results, driven also by the preferences of the user. Head‐tracking data, captured from camera feeds available at the user side, is an example of such data to which Recurrent Attention Models could be applied to accurately predict the focus of attention of users within videos frames. Information obtained from such models could be used to assist a preemptive buffering approach of specific viewing angles, contributing to the joint goal of maximising QoE. Based on these assumptions, a research line is presented, focusing on obtaining better QoE in an already existing multi‐view streaming system

20 October 2023 in Data in Brief
Verified
Journal Article
Open access
Tiago Soares da CostaTiago Soares da Costa
Tiago Soares da Costa
MAMaria Teresa Andrade
Maria Teresa Andrade
Paula VianaPaula Viana
Paula Viana
NSNuno Castro Silva
Nuno Castro Silva
The Data2MV dataset contains gaze fixation data obtained through experimental procedures from a total of 45 participants using an Intel RealSense F200 camera module and seven different video playlists. Each of the playlists had an approximate duration of 20 minutes and was viewed at least 17 times, with raw tracking data being recorded with a 0.05 second interval. The Data2MV dataset encompasses a total of 1.000.845 gaze fixations, gathered across a total of 128 experiments. It is also composed of 68.393 image frames, extracted from each of the 6 videos selected for these experiments, and an equal quantity of saliency maps, generated from aggregate fixation data. Software tools to obtain saliency maps and generate complementary plots are also provided as an open-source software package. The Data2MV dataset was publicly released to the research community on Mendeley Data and constitutes an important contribution to reduce the current scarcity of such data, particularly in immersive, multi-view streaming scenarios.

1 June 2017
Verified
Conference Paper
Open access
CAC. Abreu
C. Abreu
DRD. Rua
D. Rua
Tiago Soares da CostaTiago Soares da Costa
Tiago Soares da Costa
PMP. Machado
P. Machado
Joao Pecas-LopesJoao Pecas-Lopes
Joao Pecas-Lopes
MHM. Heleno
M. Heleno
This paper describes an energy management system that is being developed in the AnyPLACE project to support new energy services, like demand response, in residential buildings. In the project end-user interfaces are designed and implemented to allow the input of preferences regarding the flexible use of shiftable and thermal appliances. Monitoring and self-learning algorithm are used to allow additional information to be collected and an automation platform is available for the management and control of appliances. An energy management algorithm is presented that processes end-user preferences and devices characteristics to produce an optimal dispatch considering demand response incentives. Results show the successful implementation of an optimized energy scheduling.

7 June 2023
Verified
Conference Paper
Open access
Tiago Soares da CostaTiago Soares da Costa
Tiago Soares da Costa
MAMaria Teresa Andrade
Maria Teresa Andrade
Paula VianaPaula Viana
Paula Viana
NSNuno Castro Silva
Nuno Castro Silva
Immersive video applications impose unpractical bandwidth requirements for best-effort networks. With Multi-View (MV) streaming, these can be minimized by resorting to view prediction techniques. SmoothMV is a multi-view system that uses a non-intrusive head tracking mechanism to detect the viewer's interest and select appropriate views. By coupling Neural Networks (NNs) to anticipate the viewer's interest, a reduction of view-switching latency is likely to be obtained. The objective of this paper is twofold: 1) Present a solution for acquisition of gaze data from users when viewing MV content; 2) Describe a dataset, collected with a large-scale testbed, capable of being used to train NNs to predict the user's viewing interest. Tracking data from head movements was obtained from 45 participants using an Intel Realsense F200 camera, with 7 video playlists, each being viewed a minimum of 17 times. This dataset is publicly available to the research community and constitutes an important contribution to reducing the current scarcity of such data. Tools to obtain saliency/heat maps and generate complementary plots are also provided as an open-source software package.