Paul Hungler

Paul Hungler

Auto-generated profile, based on publicly available information

Paul Hungler

Ingenuity Labs Research Institute, Queens University, Kingston, ON, Canada

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 January 2024 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Closed access
PAPrithila Angkan
Prithila Angkan
BBBehnam Behinaein
Behnam Behinaein
ZMZunayed Mahmud
Zunayed Mahmud
ABAnubhav Bhatti
Anubhav Bhatti
DRDirk Rodenburg
Dirk Rodenburg
AEAli Etemad
Ali Etemad
Through this paper, we introduce a novel driver cognitive load assessment dataset, CL-Drive, which contains Electroencephalogram (EEG) signals along with other physiological signals such as Electrocardiography (ECG) and Electrodermal Activity (EDA) as well as eye tracking data. The data was collected from 21 subjects while driving in an immersive vehicle simulator, in various driving conditions, to induce different levels of cognitive load in the subjects. The tasks consisted of 9 complexity levels for 3 minutes each. Each driver reported their subjective cognitive load every 10 seconds throughout the experiment. The dataset contains the subjective cognitive load recorded as ground truth. In this paper, we also provide benchmark classification results for different machine learning and deep learning models for both binary and ternary label distributions. We followed 2 evaluation criteria namely 10-fold and leave-one-subject-out (LOSO). We have trained our models on both hand-crafted features as well as on raw data. We make our dataset public to contribute to the field.

1 October 2019 in Sensors
Verified
Journal Article
Open access
PDF file
KRKyle Ross
Kyle Ross
PSPritam Sarkar
Pritam Sarkar
DRDirk Rodenburg
Dirk Rodenburg
ARAaron Ruberto
Aaron Ruberto
PHPaul Hungler
Paul Hungler
AEAli Etemad
Ali Etemad
Simulation-based training has been proven to be a highly effective pedagogical strategy. However, misalignment between the participant’s level of expertise and the difficulty of the simulation has been shown to have significant negative impact on learning outcomes. To ensure that learning outcomes are achieved, we propose a novel framework for adaptive simulation with the goal of identifying the level of expertise of the learner, and dynamically modulating the simulation complexity to match the learner’s capability. To facilitate the development of this framework, we investigate the classification of expertise using biological signals monitored through wearable sensors. Trauma simulations were developed in which electrocardiogram (ECG) and galvanic skin response (GSR) signals of both novice and expert trauma responders were collected. These signals were then utilized to classify the responders’ expertise, successive to feature extraction and selection, using a number of machine learning methods. The results show the feasibility of utilizing these bio-signals for multimodal expertise classification to be used in adaptive simulation applications.

31 July 2024 in ACM Transactions on Computing for Healthcare
Verified
Journal Article
Open access
ABAnubhav Bhatti
Anubhav Bhatti
BBBehnam Behinaein
Behnam Behinaein
PHPaul Hungler
Paul Hungler
AEAli Etemad
Ali Etemad
We propose cross-modal attentive connections, a new dynamic and effective technique for multimodal representation learning from wearable data. Our solution can be integrated into any stage of the pipeline, i.e., after any convolutional layer or block, to create intermediate connections between individual streams responsible for processing each modality. Additionally, our method benefits from two properties. First, it can share information uni-directionally (from one modality to the other) or bi-directionally. Second, it can be integrated into multiple stages at the same time to further allow network gradients to be exchanged in several touch points. We perform extensive experiments on three public multimodal wearable datasets, WESAD, SWELL-KW, and CASE, and demonstrate that our method can effectively regulate and share information between different modalities to learn better representations. Our experiments further demonstrate that once integrated into simple CNN-based multimodal solutions (2, 3, or 4 modalities), our method can result in superior or competitive performance to state-of-the-art and outperform a variety of baseline uni-modal and classical multimodal methods.


27 March 2025 in IEEE Transactions on Cognitive and Developmental Systems
Verified
Journal Article
Closed access
ABAnubhav Bhatti
Anubhav Bhatti
PAPrithila Angkan
Prithila Angkan
BBBehnam Behinaein
Behnam Behinaein
ZMZunayed Mahmud
Zunayed Mahmud
DRDirk Rodenburg
Dirk Rodenburg
PHPaul Hungler
Paul Hungler
We present a novel multimodal dataset for Cognitive Load Assessment in REal-time (CLARE). The dataset contains physiological and Gaze data from 24 participants with self-reported cognitive load scores as ground-truth labels. The dataset includes four modalities: Electrocardiography (ECG), Electrodermal Activity (EDA), Electroencephalogram (EEG), and Gaze tracking. Each participant completed four nine-minute sessions using the MATB-II software, a computer-based mental workload task. The sessions were divided into one-minute segments of varying complexity to induce different levels of cognitive load. During the experiment, participants reported their cognitive load every 10 seconds. For the dataset, we also provide benchmark binary classification results with machine learning and deep learning models on two different evaluation schemes, namely, 10-fold and leave-one-subject-out (LOSO) cross-validation. Benchmark results show that for 10-fold evaluation, the Transformer based deep learning model achieves the best classification performance with ECG, EDA, and Gaze. In contrast, for LOSO, the best performance is achieved by the deep learning model with ECG, EDA, and EEG.

15 February 2024 in IEEE Transactions on Artificial Intelligence
Verified
Journal Article
Closed access
ZMZunayed Mahmud
Zunayed Mahmud
PHPaul Hungler
Paul Hungler
AEAli Etemad
Ali Etemad
We propose a novel neural pipeline, MSGazeNet, that learns gaze representations by taking advantage of the eye anatomy information through a multistream framework. Our proposed solution comprises two components, first a network for isolating anatomical eye regions, and a second network for multistream gaze estimation. The eye region isolation is performed with a U-Net style network which we train using a synthetic dataset that contains eye region masks for the visible eyeball and the iris region. The synthetic dataset used in this stage is procured using the UnityEyes simulator, and consists of 80,000 eye images. Successive to training, the eye region isolation network is then transferred to the real domain for generating masks for the real-world eye images. In order to successfully make the transfer, we exploit domain randomization in the training process, which allows for the synthetic images to benefit from a larger variance with the help of augmentations that resemble artifacts. The generated eye region masks along with the raw eye images are then used together as a multistream input to our gaze estimation network, which consists of wide residual blocks. The output embeddings from these encoders are fused in the channel dimension before feeding into the gaze regression layers. We evaluate our framework on three gaze estimation datasets and achieve strong performances. Our method surpasses the state-of-the-art by 7.57% and 1.85% on two datasets, and obtains competitive results on the other. We also study the robustness of our method with respect to the noise in the data and demonstrate that our model is less sensitive to noisy data. Lastly, we perform a variety of experiments including ablation studies to evaluate the contribution of different components and design choices in our solution.