Abhinav Dhall

Abhinav Dhall

Auto-generated profile, based on publicly available information

Abhinav Dhall

Monash University, Melbourne, Australia

Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
14 October 2021 in IEEE Transactions on Instrumentation and Measurement
Verified
Journal Article
Closed access
PHPraful Hambarde
Praful Hambarde
SMSubrahmanyam Murala
Subrahmanyam Murala
ADAbhinav Dhall
Abhinav Dhall
Due to the unavailability of large-scale underwater depth image datasets and ill-posed problems, underwater single-image depth prediction is a challenging task. An unambiguous depth prediction for single underwater image is an essential part of applications like underwater robotics, marine engineering, and so on. This article presents an end-to-end underwater generative adversarial network (UW-GAN) for depth estimation from an underwater single image. Initially, a coarse-level depth map is estimated using the underwater coarse-level generative network (UWC-Net). Then, a fine-level depth map is computed using the underwater fine-level network (UWF-Net) which takes input as the concatenation of the estimated coarse-level depth map and the input image. The proposed UWF-Net composes of spatial and channel-wise squeeze and excitation block for fine-level depth estimation. Also, we propose a synthetic underwater image generation approach for large-scale database. The proposed network is tested on real-world and synthetic underwater datasets for its performance analysis. We also perform a complete evaluation of the proposed UW-GAN on underwater images having different color domination, contrast, and lighting conditions. Presented UW-GAN framework is also investigated for underwater single-image enhancement. Extensive result analysis proves the superiority of proposed UW-GAN over the state-of-the-art (SoTA) hand-crafted, and learning-based approaches for underwater single-image depth estimation (USIDE) and enhancement.

15 November 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
SGShreya Ghosh
Shreya Ghosh
ADAbhinav Dhall
Abhinav Dhall
MHMunawar Hayat
Munawar Hayat
JKJarrod Knibbe
Jarrod Knibbe
QJQiang Ji
Qiang Ji
Eye gaze analysis is an important research problem in the field of Computer Vision and Human-Computer Interaction. Even with notable progress in the last 10 years, automatic gaze analysis still remains challenging due to the uniqueness of eye appearance, eye-head interplay, occlusion, image quality, and illumination conditions. There are several open questions, including what are the important cues to interpret gaze direction in an unconstrained environment without prior knowledge and how to encode them in real-time. We review the progress across a range of gaze analysis tasks and applications to elucidate these fundamental questions, identify effective methods in gaze analysis, and provide possible future directions. We analyze recent gaze estimation and segmentation methods, especially in the unsupervised and weakly supervised domain, based on their advantages and reported evaluation metrics. Our analysis shows that the development of a robust and generic gaze analysis method still needs to address real-world challenges such as unconstrained setup and learning with less supervision. We conclude by discussing future research directions for designing a real-world gaze analysis system that can propagate to other domains including Computer Vision, Augmented Reality (AR), Virtual Reality (VR), and Human Computer Interaction (HCI).

28 October 2024
Verified
Conference Paper
Open access
ZCZhixi Cai
Zhixi Cai
SGShreya Ghosh
Shreya Ghosh
AAAman Pankaj Adatia
Aman Pankaj Adatia
MHMunawar Hayat
Munawar Hayat
ADAbhinav Dhall
Abhinav Dhall
KSKalin Stefanov
Kalin Stefanov
The detection and localization of highly realistic deepfake audio-visual content are challenging even for the most advanced state-of-the-art methods. While most of the research efforts in this domain are focused on detecting high-quality deepfake images and videos, only a few works address the problem of the localization of small segments of audio-visual manipulations embedded in real videos. In this research, we emulate the process of such content generation and propose the AV-Deepfake1M dataset. The dataset contains content-driven (i) video manipulations, (ii) audio manipulations, and (iii) audio-visual manipulations for more than 2K subjects resulting in a total of more than 1M videos. The paper provides a thorough description of the proposed data generation pipeline accompanied by a rigorous analysis of the quality of the generated data. The comprehensive benchmark of the proposed dataset utilizing state-of-the-art deepfake detection and localization methods indicates a significant drop in performance compared to previous datasets. The proposed dataset will play a vital role in building the next-generation deepfake localization methods. The dataset and associated code are available at https://github.com/ControlNet/AV-Deepfake1M.

9 October 2023
Verified
Conference Paper
Open access
MSMonisha Singh
Monisha Singh
XHXimi Hoque
Ximi Hoque
DZDonghuo Zeng
Donghuo Zeng
YWYanan Wang
Yanan Wang
KIKazushi Ikeda
Kazushi Ikeda
ADAbhinav Dhall
Abhinav Dhall
The degree of concentration, enthusiasm, optimism, and passion displayed by individual(s) while interacting with a machine is referred to as ‘user engagement’. Engagement comprises of behavioral, cognitive, and affect related cues [17]. To create engagement prediction systems that can work in real-world conditions, it is quintessential to learn from rich, diverse datasets. To this end, a large scale multi-faceted engagement in the wild dataset EngageNet is proposed. 31 hours duration data of 127 participants representing different illumination conditions are recorded. Thorough experiments are performed exploring the applicability of different features, action units, eye gaze, head pose, and MARLIN. Data from user interactions (question-answer) are analyzed to understand the relationship between effective learning and user engagement. To further validate the rich nature of the dataset, evaluation is also performed on the EngageWild dataset. The experiments show the usefulness of the proposed dataset. The code, models, and dataset link are publicly available at https://github.com/engagenet/engagenet_baselines.


11 August 2021 in IEEE Transactions on Affective Computing
Verified
Journal Article
Closed access
GSGarima Sharma
Garima Sharma
ADAbhinav Dhall
Abhinav Dhall
JCJianfei Cai
Jianfei Cai
Affective computing has progressed well due to methods, which can identify a person's posed and spontaneous perceived emotions with high accuracy. This paper focuses on group-level affect analysis on videos, which is one of the first few multimodal group-level affect analysis studies. There are many challenges on video-based group-level affect analysis as most of the work is focused on either a single persons affect recognition or image-based group affect analysis. To address this, first, we present an audio-visual perceived group affect dataset - Video level Group AFfect (VGAF). VGAF is a large-scale dataset consisting of 4,183 group videos. \textcolor{red}{The videos are collected from YouTube with large variations in the keywords for collecting data across different genders, group sizes, group settings, illuminations and poses}. The variety within the dataset will help the study of group emotion perception of emotions in a real environment. The data is manually annotated for three group emotion classes - positive, neutral, and negative. Further, a fusion based audio-visual method is proposed to set a benchmark performance on the proposed dataset. The experimental results show the effectiveness of holistic, facial and speech features for group-level affect analysis. \textcolor{red}{Baseline code, dataset, and pretrained models are available at [LINK]