Hichem Sahli

Hichem Sahli

Auto-generated profile, based on publicly available information

Hichem Sahli

Department of Electronics and Informatics, Vrije Universiteit Brussel, Brussels, Belgium

Research Focus & Metrics

Academic Career Length

24Years (2003-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2021 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
HCHaifeng Chen
Haifeng Chen
Dongmei JiangDongmei Jiang
Dongmei Jiang
HSHichem Sahli
Hichem Sahli
Multi-modal continuous affect recognition is becoming an increasingly attractive research topic in affective computing. Previous works mainly focus on modeling the temporal dependency within a sensor modality. To improve system performance most of them adopt early or late fusion in multi-modal continuous affect recognition. However, early fusion suffers from the curse of dimensionality, and late fusion ignores the complementarity and redundancy between multiple streams from different modalities. In this paper, we first introduce the transformer encoder with a self-attention mechanism to temporal dependencies affective state time series and propose a Convolutional Neural Network-Transformer Encoder (CNN-TE) framework for single modality affect recognition. To effectively consider the complementarity and redundancy between multiple streams from different modalities we propose a Transformer Encoder with Multi-modal Multi-head Attention (TEMMA) module designed to progressively refine the inter-modality interactions and intra-modality temporal dependencies simultaneously. We propose a CNN-TEMMA framework for multi-modal affect recognition, which consists of (i)~a 1D CNN based input embedding sub-network to extract local temporal features via causal convolution; (ii)~a TEMMA sub-network to model the multi-modal interactions and temporal dynamics with spatial and temporal attention, to learn high-level representations for each modality; (iii)~an inference sub-network with fully connected layers to estimate the affective state, using as inputs the learned multi-modal representations. The whole framework is trained in an end-to-end fashion. We demonstrate the effectiveness of our proposed framework on the AVEC2016 dataset. Our experimental results show that the proposed CNN-TEMMA improves emotion prediction performance compared to state-of-art models. Our approach obtains remarkable improvements on both arousal and valence in terms of concordance correlation coefficient (CCC) reaching 0.872 for arousal and 0.714 for valence.

22 October 2018 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
LHLang He
Lang He
Dongmei JiangDongmei Jiang
Dongmei Jiang
HSHichem Sahli
Hichem Sahli
Depression causes mood disorder with noticeable problems in day-to-day activities. Current methods of assessing depression depend almost entirely on clinical interviews or questionnaires. They lack systematic and efficient ways of incorporating behavioral observations that are strong indicators of psychological disorder. To help clinicians effectively and efficiently diagnose depression severity, automated systems, using objective and quantifiable data for depression assessment, are being developed. This paper presents a framework towards estimating a clinical depression-specific score, namely the Beck Depression Inventory (BDI) score, based on the analysis of facial expressions features. To extract facial dynamic features, we propose a novel dynamic feature descriptor denoted as Median Robust Local Binary Patterns from Three Orthogonal Planes (MRLBP-TOP), which can capture both microstructure and macrostructure of facial appearance and dynamics. To aggregate the MRLBP-TOP over an image sequence, we propose a variant to the Fisher Vector (FV) encoding scheme, denoted as Dirichlet Process Fisher Vector (DPFV). DPFV adopts Dirichlet process Gaussian mixture models (DPGMM) to automatically learn the number of GMM mixtures and model parameters. Experimental results on the AVEC2013 and AVEC2014 depression databases have demonstrated the effectiveness of the proposed method.

14 September 2018 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
LYLe Yang
Le Yang
Dongmei JiangDongmei Jiang
Dongmei Jiang
HSHichem Sahli
Hichem Sahli
At present, although great progress has been made in automatic depression assessment, most of the recent works only concern the audio and video paralinguistic information, rather than the linguistic information from the spoken content. In this work, we argue that beside developing good audio and video features, to build reliable depression detection systems, text-based content features are also of importance to analyse depression-related textual indicators. Furthermore, to improve the performance of automatic depression assessment systems, powerful models, capable of modelling the characteristics of depression embedded in the audio, visual and text descriptors, are also required. This paper proposes new text and video features and hybridizes deep and shallow models for depression estimation and classification from audio, video and text descriptors. The proposed hybrid framework consists of three main parts: 1) A Deep Convolutional Neural Network (DCNN) and Deep Neural Network (DNN) based audio-visual multi-modal depression recognition model for estimating the Patient Health Questionnaire depression scale (PHQ-8); 2) A Paragraph Vector (PV) and Support Vector Machine (SVM) based model for inferring the physical and mental conditions of the individual from the transcripts of the interview; 3) A Random Forest (RF) model for depression classification from the estimated PHQ-8 score and the inferred conditions of the individual. In the PV-SVM model, PV embedding is used to obtain fixed-length feature vectors from transcripts of the answers to the questions associated with psychoanalytic aspects of depression, which are subsequently fed into the SVM classifiers for detecting the presence/absence of the considered psychoanalytic symptoms. To our best knowledge, this approach is the first attempt to apply PV for depression analysis. Besides, we propose a new visual descriptor - Histogram of Displacement Range (HDR) to characterize the displacement and velocity of the facial landmarks in the video segment. Experiments have been carried out on the Audio Visual Emotion Challenge (AVEC2016) depression dataset, they demonstrate that: 1) The proposed hybrid framework effectively improves the accuracies of both depression estimation and depression classification, with an average F1 measure up to 0.746, which is higher than the best result (0.724) of the depression sub-challenge of AVEC2016. 2) HDR obtains better depression recognition performance than Bag-of-Words (BoW) and Motion History Histogram (MHH) features.

21 September 2021 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
RFRuoyu Feng
Ruoyu Feng
EGEddy De Greef
Eddy De Greef
MRMaxim Rykunov
Maxim Rykunov
HSHichem Sahli
Hichem Sahli
SPSofie Pollin
Sofie Pollin
ABAndre Bourdoux
Andre Bourdoux
Multipath is a challenging problem for radar-based localization systems, especially in indoor scenarios. Multipath is caused by the bounces from static objects like walls and furniture in the room creating false alarms (``ghosts'') in target detections. Although solutions for the multipath effect have been proposed for a range of radar sensing problems, the specific case of multipath recognition and mitigation for a colocated multiple-input-multiple-output (MIMO) radar remains unsolved. For MIMO radar, the different direction-of-arrival (DoA) and direction-of-departure (DoD) angles inhibit the use of beamforming with a virtual array for localizing the first-order ghosts. Additionally, the prior knowledge of the multipath geometry model (room layout and boundary) is not always accessible. Classical ray tracing methods to resolve multipath are hence, not practical. In this work, we exploit a linear relationship between the target and multipath ghosts in the range-Doppler map to propose a Hough-transform-based multipath recognition solution. The algorithm does not require prior multipath geometry information and applies to the various indoor environments for an MIMO radar. Simulation and measurement results demonstrate the effectiveness of the proposed algorithm.

10 February 2022 in IEEE Access
Verified
Journal Article
Open access
HKHabib-Ur-Rehman Khalid
Habib-Ur-Rehman Khalid
AGAli Gorji
Ali Gorji
ABAndre Bourdoux
Andre Bourdoux
SPSofie Pollin
Sofie Pollin
HSHichem Sahli
Hichem Sahli
In this paper, we propose a Multi-View Convolutional Neural Network and Long Short-Term Memory (CNN-LSTM) network which fuses multiple “views” of the time-range-Doppler radar data-cube for human activity recognition. It adopts the structure of convolutional neural networks to extract optimal frame based features from the time-range, time-Doppler and range-Doppler projections of the radar data-cube. The CNN models are trained using an unsupervised Convolutional Auto-Encoder (CAE) topology. Afterwards, the pre-trained parameters of the encoder are fine-tuned to extract intermediate frame based representations, which are subsequently aggregated via LSTM networks for sequence classification. The temporal correlation among the views is explicitly learned by sharing the LSTM network weights across different views. Moreover, we propose range and Doppler energy dispersion and temporal difference based features as an input to the CNN-LSTM models. Furthermore, we investigate the use of target tracking features as an auxiliary side information. The proposed model is trained on datasets collected in both cluttered and uncluttered environments. For validation, an independent test dataset, with unseen participants, in a cluttered environment was collected. Fusion with auxiliary features improves the generalization by 5%, yielding an overall Macro F1-score of 74.7%.

23 August 2016 in PLOS Computational Biology
Verified
Journal Article
Open access
PDF file
AMAlioscha-Perez Mitchel
Alioscha-Perez Mitchel
CBCarine Benadiba
Carine Benadiba
KGKatty Goossens
Katty Goossens
SKSandor Kasas
Sandor Kasas
GDGiovanni Dietler
Giovanni Dietler
HSHichem Sahli
Hichem Sahli
The cytoskeleton is a highly dynamical protein network that plays a central role in numerous cellular physiological processes, and is traditionally divided into three components according to its chemical composition, i.e. actin, tubulin and intermediate filament cytoskeletons. Understanding the cytoskeleton dynamics is of prime importance to unveil mechanisms involved in cell adaptation to any stress type. Fluorescence imaging of cytoskeleton structures allows analyzing the impact of mechanical stimulation in the cytoskeleton, but it also imposes additional challenges in the image processing stage, such as the presence of imaging-related artifacts and heavy blurring introduced by (high-throughput) automated scans. However, although there exists a considerable number of image-based analytical tools to address the image processing and analysis, most of them are unfit to cope with the aforementioned challenges. Filamentous structures in images can be considered as a piecewise composition of quasi-straight segments (at least in some finer or coarser scale). Based on this observation, we propose a three-steps actin filaments extraction methodology: (i) first the input image is decomposed into a ‘cartoon’ part corresponding to the filament structures in the image, and a noise/texture part, (ii) on the ‘cartoon’ image, we apply a multi-scale line detector coupled with a (iii) quasi-straight filaments merging algorithm for fiber extraction. The proposed robust actin filaments image analysis framework allows extracting individual filaments in the presence of noise, artifacts and heavy blurring. Moreover, it provides numerous parameters such as filaments orientation, position and length, useful for further analysis. Cell image decomposition is relatively under-exploited in biological images processing, and our study shows the benefits it provides when addressing such tasks. Experimental validation was conducted using publicly available datasets, and in osteoblasts grown in two different conditions: static (control) and fluid shear stress. The proposed methodology exhibited higher sensitivity values and similar accuracy compared to state-of-the-art methods. We propose a novel actin filaments cytoskeleton analysis framework that allows extracting quasi-straight individual fibers in a robust manner, and provides their respective position, orientation, and length as output. The proposed framework is defined as a three-steps processing sequence, that can explicitly cope with high-throughput imaging related issues, such as noise/artifacts presence and heavy blurring, and can similarly process artifacts-free and well-focused images.