Hyunseok Ko

Prof. Hyunseok Ko


Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
29 December 2021 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
DLDae Yeol Lee
Dae Yeol Lee
SPSomdyuti Paul
Somdyuti Paul
CBChristos G. Bampis
Christos G. Bampis
HKHyunseok Ko
Hyunseok Ko
JKJongho Kim
Jongho Kim
ABAlan C. Bovik
Alan C. Bovik
Video dimensions are continuously increasing to provide more realistic and immersive experiences to global streaming and social media viewers. However, increments in video parameters such as spatial resolution and frame rate are inevitably associated with larger data volumes. Transmitting increasingly voluminous videos through limited bandwidth networks in a perceptually optimal way is a current challenge affecting billions of viewers. One recent practice adopted by video service providers is space-time resolution adaptation in conjunction with video compression. Consequently, it is important to understand how different levels of space-time subsampling and compression affect the perceptual quality of videos. Towards making progress in this direction, we constructed a large new resource, called the ETRI-LIVE Space-Time Subsampled Video Quality (ETRI-LIVE STSVQ) database, containing 437 videos generated by applying various levels of combined space-time subsampling and video compression on 15 diverse video contents. We also conducted a large-scale human study on the new dataset, collecting about 15,000 subjective judgments of video quality. We provide a rate-distortion analysis of the collected subjective scores, enabling us to investigate the perceptual impact of space-time subsampling at different bit rates. We also evaluated and compare the performance of leading video quality models on the new database. The new ETRI-LIVE STSVQ database is being made freely available at ( https://live.ece.utexas.edu/research/ETRI-LIVE_STSVQ/index.html ).

16 April 2020 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
HKHyunseok Ko
Hyunseok Ko
DLDae Yeol Lee
Dae Yeol Lee
SCSeunghyun Cho
Seunghyun Cho
ABAlan C. Bovik
Alan C. Bovik
In recent years, deep neural networks have been utilized in a wide variety of applications including image generation. In particular, generative adversarial networks (GANs) are able to produce highly realistic pictures as part of tasks such as image compression. As with standard compression, it is desirable to be able to automatically assess the perceptual quality of generative images to monitor and control the encode process. However, existing image quality algorithms are ineffective on GAN generated content, especially on textured regions and at high compressions. Here we propose a new “naturalness”-based image quality predictor for generative images. Our new GAN picture quality predictor is built using a multi-stage parallel boosting system based on structural similarity features and measurements of statistical similarity. To enable model development and testing, we also constructed a subjective GAN image quality database containing (distorted) GAN images and collected human opinions of them. Our experimental results indicate that our proposed GAN IQA model delivers superior quality predictions on the generative image datasets, as well as on traditional image quality datasets.

28 May 2021 in IEEE Access
Verified
Journal Article
Open access
HKHyunseok Ko
Hyunseok Ko
HKHui Yong Kim
Hui Yong Kim
With the aid of rapid development in optical and display devices, Holography has become an emerging technology to represent 3D objects providing the most natural and realistic depth illusion to the users. To reproduce a light field of objects, a hologram records the interference patterns between the object and reference wavefields. Especially for computer-generated holograms, they contain vast amount of data and must be efficiently compressed for storage or transmission. Although several coding solutions, including standardized compression tools and their variations, have been tried in the literature, the coding efficiency is not satisfactory because holograms have completely different unique properties from those observed in natural images, whereas the legacy coding solutions are optimized for the latter. In this work, we propose a deep-learning based image compression network for phase-only holograms. The proposed network is trained in an end-to-end manner with the help of data augmentation technique and aims at minimizing the entropy of the input hologram. In comprehensive experiments, we demonstrate that our compression network shows the state-of-the-art coding performance that even surpasses the latest compression standard Versatile Video Coding by up to 39% in terms of BD-rate gain. Furthermore, we provide in-depth analysis for experimental results in both holographic and numerical reconstruction domains, such as individual performances of the test codecs, a performance comparison with different objective image fidelity metrics, and subjective quality evaluation results.

27 February 2023 in Optics Express
Verified
Journal Article
Closed access
KOKwan-Jung Oh
Kwan-Jung Oh
HBHyunmin Ban
Hyunmin Ban
SCSeungmi Choi
Seungmi Choi
HKHyunseok Ko
Hyunseok Ko
HKHui Yong Kim
Hui Yong Kim
Compressing digital holograms have growing attention nowadays due to their huge amount of original data sizes. Although many progresses have been reported for full-complex holograms, the coding performance for phase-only holograms (POHs) has been quite limited so far. In this paper, we present a very efficient compression method for POHs. It extends the conventional video coding standard HEVC (High Efficiency Video Coding) in such a way that the standard can be able to compress not only the natural images but also the phase images effectively. First, we suggest a proper way to calculate differences, distances and clipped values for phase signals by considering the inherent periodicity of phases. Then, some of the HEVC encoding and decoding processes are modified accordingly. The experimental results show that the proposed extension significantly outperforms the original HEVC for POH video sequences; specifically, average BD-rate reductions of 63.3% and 65.5% are achieved in phase domain and numerical reconstruction domain, respectively. It is worth mentioning that the modified encoding & decoding processes are very minimal and also applicable to the VVC (Versatile Video Coding), which is a successor of the HEVC.

7 June 2021 in Journal of the Optical Society of America A
Verified
Journal Article
Closed access
PDF file
DLDae Yeol Lee
Dae Yeol Lee
HKHyunseok Ko
Hyunseok Ko
JKJongho Kim
Jongho Kim
ABAlan C. Bovik
Alan C. Bovik
It is well known that natural images possess statistical regularities that can be captured by bandpass decomposition and divisive normalization processes that approximate early neural processing in the human visual system. We expand on these studies and present new findings on the properties of space-time natural statistics that are inherent in motion pictures. Our model relies on the concept of temporal bandpass (e.g., lag) filtering in lateral geniculate nucleus (LGN) and area V1, which is similar to smoothed frame differencing of video frames. Specifically, we model the statistics of the differences between adjacent or neighboring video frames that have been slightly spatially displaced relative to one another. We find that when these space-time differences are further subjected to locally pooled divisive normalization, statistical regularities (or lack thereof) arise that depend on the local motion trajectory. We find that bandpass and divisively normalized frame differences that are displaced along the motion direction exhibit stronger statistical regularities than for other displacements. Conversely, the direction-dependent regularities of displaced frame differences can be used to estimate the image motion (optical flow) by finding the space-time displacement paths that best preserve statistical regularity.

16 May 2022 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
DLDae Yeol Lee
Dae Yeol Lee
JKJongho Kim
Jongho Kim
HKHyunseok Ko
Hyunseok Ko
ABAlan C. Bovik
Alan C. Bovik
Being able to accurately predict the visual quality of videos subjected to various combinations of dimension reduction protocols is of high interest to the streaming video industry, given rapid increases in frame resolutions and frame rates. In this direction, we have developed a video quality predictor that is sensitive to spatial, temporal, or space-time subsampling combined with compression. Our predictor is based on new models of space-time natural video statistics (NVS). Specifically, we model the statistics of divisively normalized difference between neighboring frames that are relatively displaced. In an extensive empirical study, we found that those paths of space-time displaced frame differences that provide maximal regularity against our NVS model generally align best with motion trajectories. Motivated by this, we built a new video quality prediction engine that extracts NVS features that represent how space-time directional regularities are disturbed by space-time distortions. Based on parametric models of these regularities, we compute features that are used to train a regressor that can accurately predict perceptual quality. As a stringent test of the new model, we apply it to the difficult problem of predicting the quality of videos subjected not only to compression, but also to downsampling in space and/or time. We show that the new quality model achieves state-of-the-art (SOTA) prediction performance on the new ETRI-LIVE Space-Time Subsampled Video Quality (STSVQ) and also on the AVT-VQDB-UHD-1 database.