Rahul Jain

Mr. Rahul Jain

orcid

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 October 2023
Verified
Conference Paper
Open access
RJRahul Jain
Rahul Jain
JSJingyu Shi
Jingyu Shi
RDRunlin Duan
Runlin Duan
ZZZhengzhe Zhu
Zhengzhe Zhu
XQXun Qian
Xun Qian
KRKarthik Ramani
Karthik Ramani
Utilizing everyday objects as tangible proxies for Augmented Reality (AR) provides users with haptic feedback while interacting with virtual objects. Yet, existing methods focus on the attributes of the objects, constraining the possible proxies and yielding inconsistency in user experience. Therefore, we propose Ubi-TOUCH, an AR system that assists users in seeking a wider range of tangible proxies for AR applications based on the hand-object interaction (HOI) they desire. Given the target interaction with a virtual object, the system scans the users’ vicinity and recommends object proxies with similar interactions. Upon user selection, the system simultaneously tracks and maps users’ physical HOI to the virtual HOI, adaptively optimizing object 6 DoF and the hand gesture to provide consistency between the interactions. We showcase promising use cases of Ubi-TOUCH, such as remote tutorials, AR gaming, and Smart Home control. Finally, we evaluate the performance and usability of Ubi-TOUCH with a user study.

11 October 2024
Verified
Conference Paper
Open access
DMDizhi Ma
Dizhi Ma
XHXiyun Hu
Xiyun Hu
JSJingyu Shi
Jingyu Shi
MPMayank Patel
Mayank Patel
RJRahul Jain
Rahul Jain
KRKarthik Ramani
Karthik Ramani
Table tennis stroke training is a critical aspect of player development. We designed a new augmented reality (AR) system, avaTTAR, for table tennis stroke training. The system provides both “on-body” (first-person view) and “detached” (third-person view) visual cues, enabling users to visualize target strokes and correct their attempts effectively with this dual perspectives setup. By employing a combination of pose estimation algorithms and IMU sensors, avaTTAR captures and reconstructs the 3D body pose and paddle orientation of users during practice, allowing real-time comparison with expert strokes. Through a user study, we affirm avaTTAR ’s capacity to amplify player experience and training results.



13 November 2023 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
AUAsim Unmesh
Asim Unmesh
RJRahul Jain
Rahul Jain
JSJingyu Shi
Jingyu Shi
VMV. K. Chaithanya Manam
V. K. Chaithanya Manam
HCHyung-Gun Chi
Hyung-Gun Chi
KRKarthik Ramani
Karthik Ramani
Dynamic environments in factories, surgical robotics, and warehouses increasingly involve humans, machines, robots, and various other objects such as tools, fixtures, conveyors, and assemblies. In these environments, numerous interactions occur not just between humans and objects but also between objects themselves. However, current scene-graph datasets predominantly focus on human-object interactions (HOI) and overlook object-object interactions (OOIs) despite the necessity of OOIs in effectively representing dynamic environments. This oversight creates a significant gap in the coverage of interactive elements in dynamic scenes. We address this gap by proposing, to the best of our knowledge, the first dataset* annotating for OOI categories in dynamic scenes. To model OOIs, we establish a classification taxonomy for spatio-temporal interactions. We use our taxonomy to annotate OOIs in video clips of dynamic scenes. Then, we introduce a spatio-temporal OOI classification task which aims to identify interaction categories between two given objects in a video clip. Further, we benchmark our dataset for the spatio-temporal OOI classification task by adopting state-of-the-art approaches from related areas of Human-Object Interaction Classification, Visual Relationship Classification, and Scene-Graph Generation. Additionally, we utilize our dataset to examine the effectiveness of OOI and HOI-based features in the context of Action Recognition. Notably, our experimental results show that OOI-based features outperform HOI-based features for the task of Action Recognition.

24 February 2025 in IEEE Transactions on Visualization and Computer Graphics
Verified
Journal Article
Closed access
RJRahul Jain
Rahul Jain
JSJingyu Shi
Jingyu Shi
ABAndrew Benton
Andrew Benton
MRMoiz Rasheed
Moiz Rasheed
HDHyungjun Doh
Hyungjun Doh
KRKarthik Ramani
Karthik Ramani
Mixed Reality (MR) is gaining prominence in manual task skill learning due to its in-situ, embodied, and immersive experience. To teach manual tasks, current methodologies break the task into hierarchies (tasks into subtasks) and visualize not only the current subtasks but also the future ones that are causally related. We investigate the impact of visualizing causality within an MR framework on manual task skill learning. We conducted a user study with 48 participants, experimenting with how presenting tasks in hierarchical causality levels (no causality, event-level, interaction-level, and gesture-level causality) affects user comprehension and performance in a complex assembly task. The research finds that displaying all causality levels enhances user understanding and task execution, with a compromise of learning time. Based on the results, we further provide design recommendations and in-depth discussions for future manual task learning systems.