Eun-Seok Ryu

Prof. Eun-Seok Ryu

orcid

Research Focus & Metrics

Academic Career Length

15Years (2012-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
26 September 2022 in IEEE Access
Verified
Journal Article
Open access
GMGhulam Mujtaba
Ghulam Mujtaba
AMAdeel Malik
Adeel Malik
EREun-Seok Ryu
Eun-Seok Ryu
This paper proposes a novel lightweight thumbnail container-based summarization (LTC-SUM) framework for full feature-length videos. This framework generates a personalized keyshot summary for concurrent users by using the computational resource of the end-user device. State-of-the-art methods that acquire and process entire video data to generate video summaries are highly computationally intensive. In this regard, the proposed LTC-SUM method uses lightweight thumbnails to handle the complex process of detecting events. This significantly reduces computational complexity and improves communication and storage efficiency by resolving computational and privacy bottlenecks in resource-constrained end-user devices. These improvements were achieved by designing a lightweight 2D CNN model to extract features from thumbnails, which helped select and retrieve only a handful of specific segments. Extensive quantitative experiments on a set of full 18 feature-length videos (approximately 32.9 h in duration) showed that the proposed method is significantly computationally efficient than state-of-the-art methods on the same end-user device configurations. Joint qualitative assessments of the results of 56 participants showed that participants gave higher ratings to the summaries generated using the proposed method. To the best of our knowledge, this is the first attempt in designing a fully client-driven personalized keyshot video summarization framework using thumbnail containers for feature-length videos. Our code and trained models are publicly available at https://github.com/iamgmujtaba/LTC-SUM .

24 May 2023 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
SLSoonbin Lee
Soonbin Lee
JJJongBeom Jeong
JongBeom Jeong
EREun-Seok Ryu
Eun-Seok Ryu
Implicit neural representations (INRs) for various data types have gained popularity in the field of deep learning owing to their effectiveness. However, previous studies on INRs have only focused on recovering original representations. This paper investigated an image compression model based on INRs using a model compression technique for entropy-constrained neural networks. Specifically, the proposed model trains a multilayer perceptron (MLP) to overfit a single image and then uses its weights to optimize its compressed representation using additive uniform noise. Accordingly, the proposed model efficiently minimizes the size of the model weight in an end-to-end manner. This training optimization process is fairly desirable for adjusting the rate of distortion for image compression. In contrast to other model compression techniques, the proposed model is implemented without additional training process or memory cost. By introducing entropy loss, this paper demonstrated that the proposed model can be used to preserve high image quality while maintaining smaller model size. The experimental results demonstrated that the proposed model achieved comparable performance to conventional image compression models without incurring high storage costs.

29 October 2018 in IEEE Access
Verified
Journal Article
Open access
TTuan Le
Tuan Le
DNDien Van Nguyen
Dien Van Nguyen
EREun-Seok Ryu
Eun-Seok Ryu
Compared to previous video streaming technologies, 360 video streaming is an emerging technology in commercial platforms that promises greater immersive video service. The use of 360 video streaming requires larger bandwidth and rapid responsiveness to users. Additionally, mobile virtual-reality (VR) devices locally process video decoding, post-processing, and rendering. However, its performance is insufficient to stream high-resolution videos such as 4K-8K. Therefore, we propose an adaptive computing offloading scheme using millimeter wave (mmWave) communication. This offloading scheme helps mobile device sharing video decoding tasks to a powerful GPU-based PC. It allows the mobile VR device enhancing the capability of playing high-resolution videos. The mmWave 802.11ad wireless technology promises the use of high-bandwidth wireless communication to improve the capacity of multimedia systems. However, the current researches on video transmission over 802.11ad mmWave are specifically focused on supporting the outdoor environment. Furthermore, synchronization is an essential issue for ensuring the quality of service (QoS) of 360 video transmission. Thus, the proposed scheme concentrate on two parts: (1) 360 video streaming in an indoor environment, and offloading mechanism using mmWave 802.11ad 60 GHz wireless communication to offload video coding tasks; (2) adaptive video synchronization mechanisms, and high-efficiency video coding (HEVC) using scalable HEVC (SHVC) extension for 360 videos with equirectangular projection. The experiments prove that the proposed scheme provides high performance 360 video streaming in QoS-sensitive video streaming applications.

20 September 2019 in IEEE Access
Verified
Journal Article
Open access
JJJongBeom Jeong
JongBeom Jeong
SLSoonbin Lee
Soonbin Lee
DJDongmin Jang
Dongmin Jang
EREun-Seok Ryu
Eun-Seok Ryu
Immersive video streaming has become very popular. To increase the quality of experience (QoE) with immersive media, user movement adaptive video streaming, three degrees of freedom plus (3DoF+), has emerged and is expected to meet this growing demand. Satisfying the limit of the bandwidth, providing high-quality immersive experience is challenging because 3DoF+ system requires high resolution, multi-view video transmission. This paper proposes a stride based 3DoF+ 360 video streaming system and introduces two main ideas: (i) a multi-view video redundancy removal method using view synthesis, (ii) a multi-view video residual packing method. The proposed multi-view video compression method removes redundancy between videos and packs them into one video, and it exhibits a BD-rate saving of 36.0%in maximum compared to the results of the high-efficiency video coding reference model. In addition, the proposed system requires fewer number of decoders for the clients, and it decreases the burden for immersive video streaming.

18 September 2018 in Sensors
Verified
Journal Article
Open access
PDF file
JJJongBeom Jeong
JongBeom Jeong
DJDongmin Jang
Dongmin Jang
JSJangwoo Son
Jangwoo Son
EREun-Seok Ryu
Eun-Seok Ryu
Recently, with the increasing demand for virtual reality (VR), experiencing immersive contents with VR has become easier. However, a tremendous amount of calculation and bandwidth is required when processing 360 videos. Moreover, additional information such as the depth of the video is required to enjoy stereoscopic 360 contents. Therefore, this paper proposes an efficient method of streaming high-quality 360 videos. To reduce the bandwidth when streaming and synthesizing the 3DoF+ 360 videos, which supports limited movements of the user, a proper down-sampling ratio and quantization parameter are offered from the analysis of the graph between bitrate and peak signal-to-noise ratio. High-efficiency video coding (HEVC) is used to encode and decode the 360 videos, and the view synthesizer produces the video of intermediate view, providing the user with an immersive experience.

1 April 2020 in ETRI Journal
Verified
Journal Article
Open access
PDF file
WNWoongsoo Na
Woongsoo Na
NDNhu-Ngoc Dao
Nhu-Ngoc Dao
JKJoongheon Kim
Joongheon Kim
EREun-Seok Ryu
Eun-Seok Ryu
Sungrae ChoSungrae Cho
Sungrae Cho
Numerous wearable technology companies have recently developed several head‐mounted display (HMD) products for virtual reality (VR) services. 5G wireless networks aim at providing high‐quality 3D multimedia services such as VR, augmented reality, and mixed reality. In this study, we examine the application of millimeter‐wave (mmWave) technology to realize low‐latency wireless communication between an HMD and its content server. However, the propagation characteristics of mmWave present several challenges such as the deafness, blockage, and beam alignment problems, and interference among content servers. In this study, we focus on an environment that provides VR services in the mmWave band and introduce existing techniques for addressing such challenges. In addition, we employ a commercialized IEEE 802.11ad VR dongle to measure the actual data rate of an mmWave VR application and identify the degree to which the performance deteriorates when the above problems occur. Finally, we verify the feasibility of the proposed solutions through a simulation of several VR scenarios in the mmWave band.