Huaqing Sun

Huaqing Sun

Auto-generated profile, based on publicly available information

Huaqing Sun

School of Electronic Science and Engineering, Nanjing University, Nanjing, China

Research Focus & Metrics

Academic Career Length

8Years (2019-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
19 September 2019 in IEEE Transactions on Circuits and Systems I: Regular Papers
Verified
Journal Article
Closed access
HSHuaqing Sun
Huaqing Sun
YLYuanyong Luo
Yuanyong Luo
YHYajun Ha
Yajun Ha
YSYinghuan Shi
Yinghuan Shi
Yang GaoYang Gao
Yang Gao
HPHongbin Pan
Hongbin Pan
Transcendental functions are commonly used in many fields such as nonlinear functions of artificial neural networks (ANNs). Due to nonlinearity of these functions, hardware implementation of the functions faces many challenges. Some methods cannot control the approximation accuracy beforehand, or they cannot approximate target functions accurately and efficiently. Other methods can only approximate a particular function without generality. A universal piecewise linear (PWL) approximation method is proposed to solve the problems existing in the above methods. In this paper, a general piecewise linear (PWL) approximation method with controllable maximum absolute error for transcend-ental functions is proposed. The method has the self-adaptive capability to choose the smallest number of segments under the constraint of a controllable maximum absolute error. Therefore, it requires fewer segments and incurs less hardware overhead. Moreover, it can approximate any transcendental functions and does not rely on any properties of the target function. Comparing our work with other methods used in three transcendental functions, including the sigmoid, hyperbolic tangent, and logarithmic function, our method improves the approximation accuracy by 4.5 times, 2.1 times, and 1.3 times, respectively; in addition, our method is more efficient and it reduces the circuit area by 49.9%, 22.4%, and 28.5%, respectively.

2 June 2020 in IEEE Transactions on Circuits and Systems II: Express Briefs
Verified
Journal Article
Closed access
ZQZidi Qin
Zidi Qin
YQYuou Qiu
Yuou Qiu
HSHuaqing Sun
Huaqing Sun
Zhonghai LuZhonghai Lu
Zhonghai Lu
ZWZhongfeng Wang
Zhongfeng Wang
HPHongbin Pan
Hongbin Pan
In this brief, a novel approximation method and its optimized hardware implementation are proposed for the sigmoid function used in Deep Neural Networks (DNNs). Based on piecewise approximation and truncated Taylor series expansion, the proposed method achieves very good approximation with low complexity while exploiting data representation with powers of two. In addition, by analyzing gradients of the sigmoid function, a small trick is introduced to improve the approximation precision. Furthermore, to reduce the hardware complexity and shorten the critical path, sampled values of the function are generated with simple logical-mapping. It is shown that the proposed approximation schemes can be implemented with purely combinational logic and the sigmoid function can be computed in one clock cycle. The experimental results demonstrate that the mean absolute errors are at the order of 1 × 10 -3 . Compared with prior arts, the new design can obtain significant improvement in critical path with comparable performance.