Ximi Hoque

Ximi Hoque

Auto-generated profile, based on publicly available information

Ximi Hoque

Indian Institute of Technology Ropar, Ropar, India

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
9 October 2023
Verified
Conference Paper
Open access
MSMonisha Singh
Monisha Singh
XHXimi Hoque
Ximi Hoque
DZDonghuo Zeng
Donghuo Zeng
YWYanan Wang
Yanan Wang
KIKazushi Ikeda
Kazushi Ikeda
ADAbhinav Dhall
Abhinav Dhall
The degree of concentration, enthusiasm, optimism, and passion displayed by individual(s) while interacting with a machine is referred to as ‘user engagement’. Engagement comprises of behavioral, cognitive, and affect related cues [17]. To create engagement prediction systems that can work in real-world conditions, it is quintessential to learn from rich, diverse datasets. To this end, a large scale multi-faceted engagement in the wild dataset EngageNet is proposed. 31 hours duration data of 127 participants representing different illumination conditions are recorded. Thorough experiments are performed exploring the applicability of different features, action units, eye gaze, head pose, and MARLIN. Data from user interactions (question-answer) are analyzed to understand the relationship between effective learning and user engagement. To further validate the rich nature of the dataset, evaluation is also performed on the EngageWild dataset. The experiments show the usefulness of the proposed dataset. The code, models, and dataset link are publicly available at https://github.com/engagenet/engagenet_baselines.

26 October 2023
Verified
Conference Paper
Open access
XHXimi Hoque
Ximi Hoque
AMAdamay Mann
Adamay Mann
GSGulshan Sharma
Gulshan Sharma
ADAbhinav Dhall
Abhinav Dhall
This paper presents a framework for generating appropriate facial expressions for a listener engaged in a dyadic conversation. The ability to produce contextually suitable facial gestures in response to user interactions may enhance the user experience for avatars and social robots interaction. We propose a Transformer and Siamese architecture-based approach for generating appropriate facial expressions. Positive and negative Speaker-Listener pairs are created, applying a contrastive loss to facilitate learning. Furthermore, an ensemble of reconstruction quality sensitive loss functions is added to the network for learning discriminative features. The listener's facial reactions are represented with a combination of the 3D Morphable Model's coefficients and affect-related attributes (facial action units). The inputs to the network are pre-trained Transformer-based feature MARLIN and affect-related features. Experimental analysis demonstrate the effectiveness of the proposed method across various metrics in the form of an increase in performance compared to a variational auto-encoder-based baseline.

2 December 2024
Verified
Book Chapter
Closed access
PDF file
MSMonisha Singh
Monisha Singh
GSGulshan Sharma
Gulshan Sharma
XHXimi Hoque
Ximi Hoque
ADAbhinav Dhall
Abhinav Dhall