Zhongpai Gao

Zhongpai Gao

Auto-generated profile, based on publicly available information

Zhongpai Gao

United Imaging Intelligence

Research Focus & Metrics

Academic Career Length

9Years (2018-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
14 December 2020 in IEEE Transactions on Cybernetics
Verified
Journal Article
Closed access
JJJun Jia
Jun Jia
ZGZhongpai Gao
Zhongpai Gao
KCKang Chen
Kang Chen
MHMenghan Hu
Menghan Hu
XMXiongkuo Min
Xiongkuo Min
XYXiaokang Yang
Xiaokang Yang
In the era of multimedia and Internet, the quick response (QR) code helps people obtain information from offline to online quickly. However, the QR code is often limited in many scenarios because of its random and dull appearance. Therefore, this article proposes a novel approach to embed hyperlinks into common images, making the hyperlinks invisible for human eyes but detectable for mobile devices equipped with a camera. Our approach is an end-to-end neural network with an encoder to hide messages and a decoder to extract messages. To maintain the hidden message resilient to cameras, we build a distortion network between the encoder and the decoder to augment the encoded images. The distortion network uses differentiable 3-D rendering operations, which can simulate the distortion introduced by camera imaging in both printing and display scenarios. To maintain the visual attraction of the image with hyperlinks, a loss function conforming to the human visual system (HVS) is used to supervise the training of the encoder. Experimental results show that the proposed approach outperforms the previous work on both robustness and quality. Based on the proposed approach, many applications become possible, for example, ``image hyperlinks'' for advertisement on TV, website, or poster, and ``invisible watermark'' for copyright protection on digital resources or product packagings.

24 June 2020 in IEEE Sensors Journal
Verified
Journal Article
Closed access
ZJZheng Jiang
Zheng Jiang
MHMenghan Hu
Menghan Hu
ZGZhongpai Gao
Zhongpai Gao
LFLei Fan
Lei Fan
RDRanran Dai
Ranran Dai
YLYong Lu
Yong Lu
Coronavirus Disease 2019 (COVID-19) caused by severe acute respiratory syndrome coronaviruses 2 (SARS-CoV-2) has become a serious global pandemic in the past few months and caused huge loss to human society worldwide. For such a large-scale pandemic, early detection and isolation of potential virus carriers is essential to curb the spread of the pandemic. Recent studies have shown that one important feature of COVID-19 is the abnormal respiratory status caused by viral infections. During the pandemic, many people tend to wear masks to reduce the risk of getting sick. Therefore, in this paper, we propose a portable non-contact method to screen the health conditions of people wearing masks through analysis of the respiratory characteristics from RGB-infrared sensors. We first accomplish a respiratory data capture technique for people wearing masks by using face recognition. Then, a bidirectional GRU neural network with an attention mechanism is applied to the respiratory data to obtain the health screening result. The results of validation experiments show that our model can identify the health status of respiratory with 83.69% accuracy, 90.23% sensitivity and 76.31% specificity on the real-world dataset. This work demonstrates that the proposed RGB-infrared sensors on portable device can be used as a pre-scan method for respiratory infections, which provides a theoretical basis to encourage controlled clinical trials and thus helps fight the current COVID-19 pandemic. The demo videos of the proposed system are available at: https://doi.org/10.6084/m9.figshare.12028032.

13 September 2018 in IEEE Access
Verified
Journal Article
Open access
YWYan Wang
Yan Wang
GZGuangtao Zhai
Guangtao Zhai
SZShaoqian Zhou
Shaoqian Zhou
SCSichao Chen
Sichao Chen
XMXiongkuo Min
Xiongkuo Min
MHMenghan Hu
Menghan Hu
More than 80% sensory information our brains receive come from the eyes. Eye fatigue and associated eye diseases become increasingly severe as digital devices progress in the last decade. Visual behaviors are controlled by different parts of muscles in human vision system. One can relax and protect his eyes timely if he knows when and how fatigued his eyes are. However, people usually have no sensation when the muscles suffer from fatigue. Thus, subjective assessments of eye fatigue are inaccurate. Objective assessments are more reliable. Some of the previous objective eye fatigue assessment methods depended on complex and expensive equipment, such as EEG, which made the user feel obtrusive. Some other methods depended on eye tracker. However, they didn't provide a widely accepted definition of eye fatigue. Moreover, most of the existing methods can only tell whether the fatigue occurs but cannot provide the fatigue level. In this paper, we provide a novel definition of eye fatigue based on seven optometry metrics. An unobtrusive eye tracker is used to do the assessment. Two real-time eye fatigue assessment models are proposed based on eye movement data and eye blink data, respectively. As a result, both of our models can provide an accurate eye fatigue level to users.

8 October 2018 in PLOS ONE
Verified
Journal Article
Open access
PDF file
ZGZhongpai Gao
Zhongpai Gao
AHAlex D. Hwang
Alex D. Hwang
GZGuangtao Zhai
Guangtao Zhai
EPEli Peli
Eli Peli
Motion in a distorted virtual 3D space may cause visually induced motion sickness. Geometric distortions in stereoscopic 3D can result from mismatches among image capture, display, and viewing parameters. Three pairs of potential mismatches are considered, including 1) camera separation vs. eye separation, 2) camera field of view (FOV) vs. screen FOV, and 3) camera convergence distance (i.e., distance from the cameras to the point where the convergence axes intersect) vs. screen distance from the observer. The effect of the viewer’s head positions (i.e., head lateral offset from the screen center) is also considered. The geometric model is expressed as a function of camera convergence distance, the ratios of the three parameter-pairs, and the offset of the head position. We analyze the impacts of these five variables separately and their interactions on geometric distortions. This model facilitates insights into the various distortions and leads to methods whereby the user can minimize geometric distortions caused by some parameter-pair mismatches through adjusting of other parameter pairs. For example, in postproduction, viewers can correct for a mismatch between camera separation and eye separation by adjusting their distance from the real screen and changing the effective camera convergence distance.

6 August 2019 in IEEE Internet of Things Journal
Verified
Journal Article
Closed access
JJJun Jia
Jun Jia
GZGuangtao Zhai
Guangtao Zhai
JZJiahe Zhang
Jiahe Zhang
ZGZhongpai Gao
Zhongpai Gao
ZZZehao Zhu
Zehao Zhu
GGGuodong Guo
Guodong Guo
This paper presents a novel method for efficient barcodes detection in real and complicated environments using a Convolutional Neural Network (CNN)-based model. The method is developed as a preprocess-module of existing decoders to enhance decoding rates. Our method is trained as an end-to-end model to determine accurate locations of four barcode vertexes. Our method consists of four modules: base net module, region proposals generator, classification and regression module, and distortion removal module. The feature of barcodes extracted from the base net is fed to the next module. Region proposals are generated and selected as Region of Interest (ROI). Then the ROI are forward propagated to the classification and regression module to determine the positions and shapes of the barcodes. Finally, the distortion removal module is used to remove the geometric distortion according to regression parameters acquired from the previous step. The accurate position and distorted barcodes shape can be determined and corrected by our method. We validate our method on a challenging large-scale dataset in experiments. Compared with previous methods, our method provides an end-to-end solution to determine accurate locations of barcode vertexes, which shows an excellent performance on detection accuracy. In addition, our method can enhance decoding rate through distortion removal.

14 November 2022 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
JJJun Jia
Jun Jia
ZGZhongpai Gao
Zhongpai Gao
DZDandan Zhu
Dandan Zhu
XMXiongkuo Min
Xiongkuo Min
MHMenghan Hu
Menghan Hu
GZGuangtao Zhai
Guangtao Zhai
Imagine an interesting situation when watching a movie, we can scan the screen using our smartphones to get some extra information about this movie such as the cast, the release date, the movie's homepage, etc. Our prospect is a world where each video contains invisible information that can be delivered to us through mobile devices with cameras. This paper proposes the first deep learning-based information hiding method for videos to achieve information transmission from screens to cameras. Compared with hiding information in single images, the methods for videos need to maintain visual quality in both spatial and temporal domains. Furthermore, the training of video models builds on a large video dataset, which needs much more computational resources than training models for images. To reduce the computational complexity, we propose to simulate data on-the-fly to generate simulated sequences from single images. Then, we use the simulated data to train a spatio-temporal generator that hides information in videos while maintaining visual quality. During training, a temporal loss function based on the simulated data is exploited to ensure the temporal consistency of generated videos. After embedding, we use a decoder to recover the hidden information. To simulate the imaging pipeline from screens to cameras in the real world, we insert a distortion network between the generator and decoder. The distortion network is based on differentiable 3D rendering to cover possible distortions introduced in the procedure of camera imaging. Experimental results show that the hidden information in videos can be extracted by cameras without impacting the visual quality. Our work can be applied to many fields, such as advertisement, entertainment, and education.