Gaurav Jain

Gaurav Jain

Auto-generated profile, based on publicly available information

Gaurav Jain

Columbia University, New York, New York, USA

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
28 February 2020 in IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control
Verified
Journal Article
Closed access
NANavchetan Awasthi
Navchetan Awasthi
GJGaurav Jain
Gaurav Jain
SKSandeep Kumar Kalva
Sandeep Kumar Kalva
MPManojit Pramanik
Manojit Pramanik
PYPhaneendra K. Yalavarthy
Phaneendra K. Yalavarthy
Photoacoustic tomography (PAT) is a non-invasive imaging modality combining the benefits of optical contrast at ultrasonic resolution. Analytical reconstruction algorithms for photoacoustic signals require large number of data points for accurate image reconstruction. However, in practical scenarios, data is collected using limited number of transducers along with data being often corrupted with noise resulting in only qualitative images. Further, the collected boundary data is band-limited due to limited bandwidth of the transducer making the photoacoustic imaging with limited data being qualitative. In this work, a deep neural network based model with loss function being scaled root-mean-squared-error was proposed for super-resolution, denoising as well as bandwidth enhancement of the photoacoustic signals collected at the boundary of the domain. The proposed network has been compared with traditional as well as other popular deep learning methods in numerical as well as experimental cases and is shown to improve the collected boundary data in turn providing superior quality reconstructed photoacoustic image. The improvement obtained in the Pearson Correlation, Structural Similarity Index Metric and Root Mean Square Error was as high as 35.62%, 33.81% and 41.07% respectively for phantom cases and Signal to Noise Ratio improvement in the reconstructed photoacoustic images was as high as 11.65 dB for in-vivo cases as compared to reconstructed image obtained using original limited bandwidth data. Code is available at https://sites.google.com/site/sercmig/home/dnnpat.

14 April 2023 in Proceedings of the ACM on Human-Computer Interaction
Verified
Journal Article
Open access
GJGaurav Jain
Gaurav Jain
YTYuanyang Teng
Yuanyang Teng
DCDong Heon Cho
Dong Heon Cho
YXYunhao Xing
Yunhao Xing
MAMaryam Aziz
Maryam Aziz
BSBrian A. Smith
Brian A. Smith
Navigation assistance systems (NASs) aim to help visually impaired people (VIPs) navigate unfamiliar environments. Most of today's NASs support VIPs via turn-by-turn navigation, but a growing body of work highlights the importance of exploration as well. It is unclear, however, how NASs should be designed to help VIPs explore unfamiliar environments. In this paper, we perform a qualitative study to understand VIPs' information needs and challenges with respect to exploring unfamiliar environments to inform the design of NASs that support exploration. Our findings reveal the types of spatial information that VIPs need as well as factors that affect VIPs' information preferences. We also discover specific challenges that VIPs face that future NASs can address, such as orientation and mobility education and collaborating effectively with others. We present design implications for NASs that support exploration, and we identify specific research opportunities and discuss open socio-technical challenges for making such NASs possible. We conclude by reflecting on our study procedure to inform future approaches in research on ethical considerations that may be adopted while interacting with the broader VIP community.

11 October 2024
Verified
Conference Paper
Open access
GJGaurav Jain
Gaurav Jain
BHBasel Hindi
Basel Hindi
ZZZihao Zhang
Zihao Zhang
KSKoushik Srinivasula
Koushik Srinivasula
MXMingyu Xie
Mingyu Xie
BSBrian A. Smith
Brian A. Smith
Blind and low-vision (BLV) people rely on GPS-based systems for outdoor navigation. GPS’s inaccuracy, however, causes them to veer off track, run into obstacles, and struggle to reach precise destinations. While prior work has made precise navigation possible indoors via hardware installations, enabling this outdoors remains a challenge. Interestingly, many outdoor environments are already instrumented with hardware such as street cameras. In this work, we explore the idea of repurposing existing street cameras for outdoor navigation. Our community-driven approach considers both technical and sociotechnical concerns through engagements with various stakeholders: BLV users, residents, business owners, and Community Board leadership. The resulting system, StreetNav, processes a camera’s video feed using computer vision and gives BLV pedestrians real-time navigation assistance. Our evaluations show that StreetNav guides users more precisely than GPS, but its technical performance is sensitive to environmental occlusions and distance from the camera. We discuss future implications for deploying such systems at scale.

29 October 2023
Verified
Conference Paper
Open access
GJGaurav Jain
Gaurav Jain
BHBasel Hindi
Basel Hindi
CCConnor Courtien
Connor Courtien
XXXin Yi Therese Xu
Xin Yi Therese Xu
CWConrad Wyrick
Conrad Wyrick
BSBrian A. Smith
Brian A. Smith
Blind and low-vision (BLV) people face challenges watching sports due to the lack of accessibility of sports broadcasts. Currently, BLV people rely on descriptions from TV commentators, radio announcers, or their friends to understand the game. These descriptions, however, do not allow BLV viewers to visualize the action by themselves. We present Front Row, a system that automatically generates an immersive audio representation of sports broadcasts, specifically tennis, allowing BLV viewers to more directly perceive what is happening in the game. Front Row first recognizes gameplay from the video feed using computer vision, then renders players’ positions and shots via spatialized (3D) audio cues. User evaluations with 12 BLV participants show that Front Row gives BLV viewers a more accurate understanding of the game compared to TV and radio, enabling viewers to form their own opinions on players’ moods and strategies. We discuss future implications of Front Row and illustrate several applications, including a Front Row plug-in for video streaming platforms to enable BLV people to visualize the action in sports videos across the Web.

19 April 2023
Verified
Conference Paper
Open access
GJGaurav Jain
Gaurav Jain
BHBasel Hindi
Basel Hindi
CCConnor Courtien
Connor Courtien
CWConrad Wyrick
Conrad Wyrick
XXXin Yi Therese Xu
Xin Yi Therese Xu
BSBrian A. Smith
Brian A. Smith

9 September 2020 in IEEE Transactions on Cognitive and Developmental Systems
Verified
Journal Article
Closed access
GJGaurav Jain
Gaurav Jain
SCShivang Chopra
Shivang Chopra
SCSuransh Chopra
Suransh Chopra
APAnil Singh Parihar
Anil Singh Parihar
Abstract– For the past few decades, machines have replaced humans in several disciplines. However, machine cognition still lags behind the human capabilities. We address the machines’ ability to recognize human drawn sketches in this work. Visual representations such as sketches have long been a medium of communication for humans. For artificially intelligent systems to effectively immerse in interactive environments, it is required that machines understand such notations. The abstract nature and varied artistic styling of these sketches make automatic recognition of drawings more challenging than other areas of image classification. In this paper, we use sketches represented as a sequence of strokes, i.e., as vector images, to effectively capture the long-term temporal dependencies in hand-drawn sketches. The proposed approach combines the self-attention capabilities of Transformers while effectively utilizing the long-term temporal dependencies through Temporal Convolution Networks (TCN) for sketch recognition. The confidence scores obtained from the two techniques are combined using triangular-norm (T-norm). Attention heat-maps are plotted to isolate the discriminating parts of a sketch that contribute to sketch classification. The extensive quantitative and qualitative evaluation confirms that the proposed network performs favorably against state-of-the-art techniques.