David Kim

David Kim

Auto-generated profile, based on publicly available information

David Kim

Google, Zurich, Switzerland

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
11 October 2024
Verified
Conference Paper
Open access
MDMustafa Doga Dogan
Mustafa Doga Dogan
EGEric J Gonzalez
Eric J Gonzalez
KAKaran Ahuja
Karan Ahuja
RDRuofei Du
Ruofei Du
ACAndrea Colaço
Andrea Colaço
DKDavid Kim
David Kim
Seamless integration of physical objects as interactive digital entities remains a challenge for spatial computing. This paper explores Augmented Object Intelligence (AOI) in the context of XR, an interaction paradigm that aims to blur the lines between digital and physical by equipping real-world objects with the ability to interact as if they were digital, where every object has the potential to serve as a portal to digital functionalities. Our approach utilizes real-time object segmentation and classification, combined with the power of Multimodal Large Language Models (MLLMs), to facilitate these interactions without the need for object pre-registration. We implement the AOI concept in the form of XR-Objects, an open-source prototype system that provides a platform for users to engage with their physical environment in contextually relevant ways using object-based context menus. This system enables analog objects to not only convey information but also to initiate digital actions, such as querying for details or executing tasks. Our contributions are threefold: (1) we define the AOI concept and detail its advantages over traditional AI assistants, (2) detail the XR-Objects system’s open-source design and implementation, and (3) show its versatility through various use cases and a user study.

11 May 2024
Verified
Conference Paper
Open access
XLXingyu Bruce Liu
Xingyu Bruce Liu
JLJiahao Nick Li
Jiahao Nick Li
DKDavid Kim
David Kim
XCXiang 'Anthony' Chen
Xiang 'Anthony' Chen
RDRuofei Du
Ruofei Du
Situationally Induced Impairments and Disabilities (SIIDs) can significantly hinder user experience in contexts such as poor lighting, noise, and multi-tasking. While prior research has introduced algorithms and systems to address these impairments, they predominantly cater to specific tasks or environments and fail to accommodate the diverse and dynamic nature of SIIDs. We introduce Human I/O, a unified approach to detecting a wide range of SIIDs by gauging the availability of human input/output channels. Leveraging egocentric vision, multimodal sensing and reasoning with large language models, Human I/O achieves a 0.22 mean absolute error and a 82% accuracy in availability prediction across 60 in-the-wild egocentric video recordings in 32 different scenarios. Furthermore, while the core focus of our work is on the detection of SIIDs rather than the creation of adaptive user interfaces, we showcase the efficacy of our prototype via a user study with 10 participants. Findings suggest that Human I/O significantly reduces effort and improves user experience in the presence of SIIDs, paving the way for more adaptive and accessible interactive systems in the future.


27 September 2025
Verified
Conference Paper
Open access
GLGeonsun Lee
Geonsun Lee
MXMin Xia
Min Xia
NNNels Numan
Nels Numan
XQXun Qian
Xun Qian
DLDavid Li
David Li
RDRuofei Du
Ruofei Du

25 April 2025
Verified
Conference Paper
Open access
ZZZhongyi Zhou
Zhongyi Zhou
JJJing Jin
Jing Jin
VPVrushank Phadnis
Vrushank Phadnis
XYXiuxiu Yuan
Xiuxiu Yuan
JJJun Jiang
Jun Jiang
RDRuofei Du
Ruofei Du