Lee Kang-Won

Dr. Lee Kang-Won

orcid

Research Focus & Metrics

Academic Career Length

6Years (2021-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
13 May 2024
Verified
Conference Paper
Open access
YYYing Yuan
Ying Yuan
HCHaichuan Che
Haichuan Che
YQYuzhe Qin
Yuzhe Qin
BHBinghao Huang
Binghao Huang
ZYZhao-Heng Yin
Zhao-Heng Yin
XWXiaolong Wang
Xiaolong Wang
Executing contact-rich manipulation tasks necessitates the fusion of tactile and visual feedback. However, the distinct nature of these modalities poses significant challenges. In this paper, we introduce a system that leverages visual and tactile sensory inputs to enable dexterous in-hand manipulation. Specifically, we propose Robot Synesthesia, a novel point cloudbased tactile representation inspired by human tactile-visual synesthesia. This approach allows for the simultaneous and seamless integration of both sensory inputs, offering richer spatial information and facilitating better reasoning about robot actions. Comprehensive ablations are performed on how the integration of vision and touch can improve reinforcement learning and Sim2Real performance. Our project page is available at https://yingyuan0414.github.io/visuotactile/.

9 August 2022 in Expert Systems with Applications
Verified
Journal Article
Closed access
DKDae-Kwan Ko
Dae-Kwan Ko
LKLee Kang-Won
Lee Kang-Won
DLDong Han Lee
Dong Han Lee
SLSoo-Chul Lim
Soo-Chul Lim

11 October 2024 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
LKLee Kang-Won
Lee Kang-Won
YQYuzhe Qin
Yuzhe Qin
XWXiaolong Wang
Xiaolong Wang
SLSoo-Chul Lim
Soo-Chul Lim
The sense of touch is an essential ability for skillfully performing a variety of tasks, providing the capacity to search and manipulate objects without relying on visual information. In this paper, we introduce a multi-finger robot system designed to manipulate objects using the sense of touch, without relying on vision. For tasks that mimic daily life, the robot uses its sense of touch to manipulate randomly placed objects in dark. The objective of this study is to enable robots to perform blind manipulation by using tactile sensation to compensate for the information gap caused by the absence of vision, given the presence of prior information. Training the policy through reinforcement learning in simulation and transferring the trained policy to the real environment, we demonstrate that blind manipulation can be applied to robots without vision. In addition, the experiments showcase the importance of tactile sensing in the blind manipulation tasks. Our project page is available at https://lee-kangwon.github.io/dextouch/

7 July 2021 in IEEE Robotics and Automation Letters
Verified
Journal Article
Closed access
LKLee Kang-Won
Lee Kang-Won
DKDae-Kwan Ko
Dae-Kwan Ko
SLSoo-Chul Lim
Soo-Chul Lim
In this study, a vision-based high sampling rate interaction force estimation method is proposed for teleoperation systems that uses master position and orientation information without using physical sensors such as force/torque (F/T) or tactile sensors. The proposed method uses red-green-blue (RGB) images, six-axis robot pose and motor current data, gripper position and current data, as well as master position and orientation information as inputs without requiring force sensors. To estimate the interaction forces, a deep neural network composed of densely connected convolutional network (DenseNet) and long short-term memory (LSTM) is proposed. The database was created by operators using grip and picking motions to interact with 10 objects over a teleoperation system. In addition, we compared the proposed method with different deep learning networks that used different sets of inputs. The results show that the proposed model can estimate 1 kHz interaction force based on 60 Hz images and 1 kHz master inputs. Moreover, the results indicate that the master position and orientation information are useful in estimating the interaction force at a high sampling rate through the result of the change in the network input.

31 March 2022 in IEEE Sensors Journal
Verified
Journal Article
Closed access
LKLee Kang-Won
Lee Kang-Won
SKSeung-Chan Kim
Seung-Chan Kim
SLSoo-Chul Lim
Soo-Chul Lim
Sensing performance of capacitive touch sensor is significantly degraded in electronically harsh environments, for example, underwater. In particular, a capacitive touch sensor used in a general mobile phone cannot recognize a touch in the underwater. Based on the observation that contact between two physical bodies (e.g., fingertip and display screen) induces object motion, although tiny, we propose a novel touch interface system that learns multivariate sequential signals to recognize the touched position while underwater. To that end, we first collected multivariate sensor data utilizing a commercial robot arm system to obtain sufficient amount of touch data in the underwater condition. Then, we trained deep neural network models using the collected data along with predefined touch regions in a supervised fashion. The experimental results obtained demonstrated higher recognition performances with overall accuracy of 96.74%. We conclude this paper by discussing the issues and highlighting future research directions.

6 August 2024 in IEEE Transactions on Intelligent Transportation Systems
Verified
Journal Article
Closed access
LKLee Kang-Won
Lee Kang-Won
DKDae-Kwan Ko
Dae-Kwan Ko
YKYong-Jun Kim
Yong-Jun Kim
JRJee-Hwan Ryu
Jee-Hwan Ryu
SLSoo-Chul Lim
Soo-Chul Lim
Teledriving could serve as a practical solution for handling unforeseen situations in autonomous driving. However, the latency of transmission networks remains a prominent concern. Despite advancements like 5G networks, delays in remote driving scenes cannot be entirely eradicated, potentially leading to unwanted incidents. While a few attempts have been made to address this issue by predicting the future driving scenes, these efforts have been restricted in their ability to accurately foresee clear and relevant driving scenarios. This study presents a method to predict a latency-free future driving scene. Unlike prior approaches, our method incorporates the command signal of a remote driver into the prediction network, as well as the past driving video frames and vehicle status. As a result, we can accurately predict relevant and clear latency-free future driving scenes. A combination of convolutional long short-term memory (ConvLSTM) and generative adversarial networks (GAN) was utilized in a deep neural network to predict the future driving scenes based on latency. The dataset was gathered from on-road teledriving experiments, with a maximum vehicle speed of 53 km/h and a driving route length of approximately 1.3 km. The dataset used to train the deep neural network was gathered from on-road teledriving experiments. The proposed method can estimate the future driving scene for up to 0.5 s, surpassing the performance of both baseline video prediction methods and a method that does not utilize the input command of the driver.