Shivam Agarwal

Shivam Agarwal

Auto-generated profile, based on publicly available information

Shivam Agarwal

University of Illinois at Urbana-Champaign, Urbana, IL, USA

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 May 2024
Verified
Conference Paper
Open access
SKSeongKu Kang
SeongKu Kang
SAShivam Agarwal
Shivam Agarwal
BJBowen Jin
Bowen Jin
DLDongha Lee
Dongha Lee
HYHwanjo Yu
Hwanjo Yu
JHJiawei Han
Jiawei Han
Document retrieval has greatly benefited from the advancements of large-scale pre-trained language models (PLMs). However, their effectiveness is often limited in theme-specific applications for specialized areas or industries, due to unique terminologies, incomplete contexts of user queries, and specialized search intents. To capture the theme-specific information and improve retrieval, we propose to use a corpus topical taxonomy, which outlines the latent topic structure of the corpus while reflecting user-interested aspects. We introduce ToTER (Topical Taxonomy Enhanced Retrieval) framework, which identifies the central topics of queries and documents with the guidance of the taxonomy, and exploits their topical relatedness to supplement missing contexts. As a plug-and-play framework, ToTER can be flexibly employed to enhance various PLM-based retrievers. Through extensive quantitative, ablative, and exploratory experiments on two real-world datasets, we ascertain the benefits of using topical taxonomy for retrieval in theme-specific applications and demonstrate the effectiveness of ToTER.

18 July 2023
Verified
Conference Paper
Open access
PCParth Chhabra
Parth Chhabra
ANAtula Tejaswi Neerkaje
Atula Tejaswi Neerkaje
SAShivam Agarwal
Shivam Agarwal
RSRamit Sawhney
Ramit Sawhney
MTMegh Thakkar
Megh Thakkar
SCSudheer Chava
Sudheer Chava
Mixup is an efficient data augmentation technique, which improves generalization by interpolating random examples. While numerous approaches have been developed for Mixup in the Euclidean and in the hyperbolic space, they do not fully use the intrinsic properties of the examples, i.e., they manually set the geometry (Euclidean or hyperbolic) based on the overall dataset, which may be sub-optimal since each example may require a different geometry. We propose DynaMix, a framework that automatically selects an example-specific geometry and performs Mixup between the different geometries to improve training dynamics and generalization. Through extensive experiments in image and text modalities we show that DynaMix outperforms state-of-the-art methods over six downstream applications. We find that DynaMix is more useful in low-resource and semi-supervised settings likely because it displays a probabilistic view of the geometry.