Jun Qi

Jun Qi

Auto-generated profile, based on publicly available information

Jun Qi

School of Electrical and Computer Engineering Georgia Institute of Technology 30332 Atlanta GA USA

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 July 2020 in IEEE Access
Verified
Journal Article
Open access
Samuel Yen-Chi ChenSamuel Yen-Chi Chen
Samuel Yen-Chi Chen
CYChao-Han Huck Yang
Chao-Han Huck Yang
JQJun Qi
Jun Qi
PCPin-Yu Chen
Pin-Yu Chen
XMXiaoli Ma
Xiaoli Ma
HGHsi-Sheng Goan
Hsi-Sheng Goan
The state-of-the-art machine learning approaches are based on classical von Neumann computing architectures and have been widely used in many industrial and academic domains. With the recent development of quantum computing, researchers and tech-giants have attempted new quantum circuits for machine learning tasks. However, the existing quantum computing platforms are hard to simulate classical deep learning models or problems because of the intractability of deep quantum circuits. Thus, it is necessary to design feasible quantum algorithms for quantum machine learning for noisy intermediate scale quantum (NISQ) devices. This work explores variational quantum circuits for deep reinforcement learning. Specifically, we reshape classical deep reinforcement learning algorithms like experience replay and target network into a representation of variational quantum circuits. Moreover, we use a quantum information encoding scheme to reduce the number of model parameters compared to classical neural networks. To the best of our knowledge, this work is the first proof-of-principle demonstration of variational quantum circuits to approximate the deep Q-value function for decision-making and policy-selection reinforcement learning with experience replay and target network. Besides, our variational quantum circuits can be deployed in many near-term NISQ machines.

14 August 2020 in IEEE Signal Processing Letters
Verified
Journal Article
Closed access
JQJun Qi
Jun Qi
JDJun Du
Jun Du
SSSabato Marco Siniscalchi
Sabato Marco Siniscalchi
XMXiaoli Ma
Xiaoli Ma
CLChin-Hui Lee
Chin-Hui Lee
In this paper, we exploit the properties of mean absolute error (MAE) as a loss function for the deep neural network (DNN) based vector-to-vector regression. The goal of this work is two-fold: (i) presenting performance bounds of MAE, and (ii) demonstrating new properties of MAE that make it more appropriate than mean squared error (MSE) as a loss function for DNN based vector-to-vector regression. First, we show that a generalized upper-bound for DNN-based vector-to-vector regression can be ensured by leveraging the known Lipschitz continuity property of MAE. Next, we derive a new generalized upper bound in the presence of additive noise. Finally, in contrast to conventional MSE commonly adopted to approximate Gaussian errors for regression, we show that MAE can be interpreted as an error modeled by Laplacian distribution. Speech enhancement experiments are conducted to corroborate our proposed theorems and validate the performance advantages of MAE over MSE for DNN based regression.

9 January 2023 in npj Quantum Information
Verified
Journal Article
Open access
PDF file
JQJun Qi
Jun Qi
CYChao-Han Huck Yang
Chao-Han Huck Yang
PCPin-Yu Chen
Pin-Yu Chen
MHMin-Hsiu Hsieh
Min-Hsiu Hsieh
The noisy intermediate-scale quantum devices enable the implementation of the variational quantum circuit (VQC) for quantum neural networks (QNN). Although the VQC-based QNN has succeeded in many machine learning tasks, the representation and generalization powers of VQC still require further investigation, particularly when the dimensionality of classical inputs is concerned. In this work, we first put forth an end-to-end QNN, TTN-VQC, which consists of a quantum tensor network based on a tensor-train network (TTN) for dimensionality reduction and a VQC for functional regression. Then, we aim at the error performance analysis for the TTN-VQC in terms of representation and generalization powers. We also characterize the optimization properties of TTN-VQC by leveraging the Polyak-Lojasiewicz condition. Moreover, we conduct the experiments of functional regression on a handwritten digit classification dataset to justify our theoretical analysis.

21 December 2023 in Physica Scripta
Verified
Journal Article
Open access
PDF file
JQJun Qi
Jun Qi
CYChao-Han Huck Yang
Chao-Han Huck Yang
PCPin-Yu Chen
Pin-Yu Chen
This work focuses on investigating an end-to-end learning approach for quantum neural networks (QNN) on noisy intermediate-scale quantum devices. The proposed model combines a quantum tensor network (QTN) with a variational quantum circuit (VQC), resulting in a QTN-VQC architecture. This architecture integrates a QTN with a horizontal or vertical structure related to the implementation of quantum circuits for a tensor-train network. The study provides theoretical insights into the quantum advantages of the end-to-end learning pipeline based on QTN-VQC from two perspectives. The first perspective refers to the theoretical understanding of QTN-VQC with upper bounds on the empirical error, examining its learnability and generalization powers; The second perspective focuses on using the QTN-VQC architecture to alleviate the Barren Plateau problem in the training stage. Our experimental simulation on CPU/GPUs is performed on a handwritten digit classification dataset to corroborate our proposed methods in this work.

7 May 2020 in IEEE Transactions on Signal Processing
Verified
Journal Article
Closed access
JQJun Qi
Jun Qi
JDJun Du
Jun Du
SSSabato Marco Siniscalchi
Sabato Marco Siniscalchi
XMXiaoli Ma
Xiaoli Ma
CLChin-Hui Lee
Chin-Hui Lee
In this paper, we show that, in vector-to-vector regression utilizing deep neural networks (DNNs), a generalized loss of mean absolute error (MAE) between the predicted and expected feature vectors is upper bounded by the sum of an approximation error, an estimation error, and an optimization error. Leveraging upon error decomposition techniques in statistical learning theory and non-convex optimization theory, we derive upper bounds for each of the three aforementioned errors and impose necessary constraints on DNN models. Moreover, we assess our theoretical results through a set of image de-noising and speech enhancement experiments. Our proposed upper bounds of the MAE for DNN based vector-to-vector regression are corroborated by the experimental results and the upper bounds are valid with and without the “over-parametrization” condition.

19 August 2019 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
JQJun Qi
Jun Qi
JDJun Du
Jun Du
SSSabato Marco Siniscalchi
Sabato Marco Siniscalchi
CLChin-Hui Lee
Chin-Hui Lee
This paper focuses on a theoretical analysis of deep neural network (DNN) based functional approximation. Leveraging upon two classical theorems on universal approximation, an artificial neural network (ANN) with a single hidden layer of neurons is used. With modified ReLU and Sigmoid activation functions, we first generalize the related concepts to vector-to-vector regression. Then, we show that the width of the hidden layer of ANN is numerically related to the approximation of the regression function. Furthermore, we increase the number of hidden layers and show that the depth of the ANN-based regression function can enhance its expressive power. We illustrate this representation with recently-emerged DNN based speech enhancement. We first compare the expressive power by varying ANN structures and then test its related regression performance under different noisy conditions in various noise types and signal-to-noise-ratio levels. Experimental results verify our theoretical prediction that an ANN of a broader hidden layer and a deeper architecture can jointly ensure a closer approximation of the vector-to-vector regression functions in terms of the Euclidean distance between the log power spectra of noisy and expected clean speech. Moreover, a DNN with a broader width at the top hidden layer can improve the regression performance than those with a narrower width at the top hidden layers.