Haitian Jiang

Haitian Jiang

Auto-generated profile, based on publicly available information

Haitian Jiang

Zhejiang University

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
20 January 2023 in ACM Transactions on Design Automation of Electronic Systems
Verified
Journal Article
Open access
KHKai HUANG
Kai HUANG
BLBowen Li
Bowen Li
DXDongliang Xiong
Dongliang Xiong
HJHaitian Jiang
Haitian Jiang
XJXiaowen Jiang
Xiaowen Jiang
ZLZhili Liu
Zhili Liu
Deep Neural Networks (DNNs) have achieved remarkable success in various Artificial Intelligence applications. Quantization is a critical step in DNNs compression and acceleration for deployment. To further boost DNN execution efficiency, many works explore to leverage the input-dependent redundancy with dynamic quantization for different regions. However, the sensitive regions in the feature map are irregularly distributed, which restricts the real speed up for existing accelerators. To this end, we propose an algorithm-architecture co-design, named Structured Dynamic Precision (SDP). Specifically, we propose a quantization scheme in which the high-order bit part and the low-order bit part of data can be masked independently. And a fixed number of term parts are dynamically selected for computation based on the importance of each term in the group. We also present a hardware design to enable the algorithm efficiently with small overheads, whose inference time mainly scales with the precision proportionally. Evaluation experiments on extensive networks demonstrate that compared to the state-of-the-art dynamic quantization accelerator DRQ, our SDP can achieve 29% performance gain and 51% energy reduction for the same level of model accuracy.

1 October 2023
Verified
Conference Paper
Closed access
LMLiyuan Ma
Liyuan Ma
TGTingwei Gao
Tingwei Gao
HJHaitian Jiang
Haitian Jiang
HSHaibin Shen
Haibin Shen
KHKejie Huang
Kejie Huang
Human pose transfer aims to synthesis a new image of the source person in a target pose. Among the various existing methods, attention and flow have emerged as two of the most popular and effective approaches. Attention excels at preserving the semantic structure of the source image, which is more reflected in the low-frequency domain. Contrastively, flow is better at retaining fine-grained texture details in the high-frequency domain. To leverage the advantages of both attention and flow simultaneously, this paper proposes Wavelet-aware Image-based Pose Transfer (WaveIPT) as a novel approach to fuse the attention and flow in the wavelet domain. To improve the fusion effect and avoid interference from irrelevant information across different frequencies, WaveIPT first applies Intra-scale Local Correlation (ILC) to adaptively fuse attention and flow in the same scale according to their strengths in low and high-frequency domains. Subsequently, WaveIPT employs Inter-scale Feature Interaction (IFI) to explore inter-scale frequency features, facilitating effective information transfer across different scales. Furthermore, we introduce Progressive Flow Regularization (PFR), an effective method that alleviates the challenges of flow estimation under large pose differences. The experiments on the DeepFashion dataset demonstrate that WaveIPT achieves a new state-of-the-art in terms of both FID and LPIPS, with improvements of 4.97% and 3.89%, respectively.

29 September 2023 in IEEE Transactions on Image Processing
Verified
Journal Article
Closed access
HJHaitian Jiang
Haitian Jiang
DXDongliang Xiong
Dongliang Xiong
XJXiaowen Jiang
Xiaowen Jiang
LDLi Ding
Li Ding
LCLiang Chen
Liang Chen
KHKai HUANG
Kai HUANG
Halftoning aims to reproduce a continuous-tone image with pixels whose intensities are constrained to two discrete levels. This technique has been deployed on every printer, and the majority of them adopt fast methods (e.g., ordered dithering, error diffusion) that fail to render structural details, which determine halftone’s quality. Other prior methods of pursuing visual pleasure by searching for the optimal halftone solution, on the contrary, suffer from their high computational cost. In this paper, we propose a fast and structure-aware halftoning method via a data-driven approach. Specifically, we formulate halftoning as a reinforcement learning problem, in which each binary pixel’s value is regarded as an action chosen by a virtual agent with a shared fully convolutional neural network (CNN) policy. In the offline phase, an effective gradient estimator is utilized to train the agents in producing high-quality halftones in one action step. Then, halftones can be generated online by one fast CNN inference. Besides, we propose a novel anisotropy suppressing loss function, which brings the desirable blue-noise property. Finally, we find that optimizing SSIM could result in holes in flat areas, which can be avoided by weighting the metric with the contone’s contrast map. Experiments show that our framework can effectively train a light-weight CNN, which is 15x faster than previous structure-aware methods, to generate blue-noise halftones with satisfactory visual quality. We also present a prototype of deep multitoning to demonstrate the extensibility of our method.

16 October 2022
Verified
Conference Paper
Open access
HJHaitian Jiang
Haitian Jiang
DXDongliang Xiong
Dongliang Xiong
XJXiaowen Jiang
Xiaowen Jiang
AYAiguo Yin
Aiguo Yin
LDLi Ding
Li Ding
KHKai HUANG
Kai HUANG
Deep neural networks have recently succeeded in digital halftoning using vanilla convolutional layers with high parallelism. However, existing deep methods fail to generate halftones with a satisfying blue-noise property and require complex training schemes. In this paper, we propose a halftoning method based on multi-agent deep reinforcement learning, called HALFTONERS, which learns a shared policy to generate high-quality halftone images. Specifically, we view the decision of each binary pixel value as an action of a virtual agent, whose policy is trained by a low-variance policy gradient. Moreover, the blue-noise property is achieved by a novel anisotropy suppressing loss function. Experiments show that our halftoning method produces high-quality halftones while staying relatively fast.


1 January 2020
Verified
Book Chapter
Closed access
PDF file
DXDongliang Xiong
Dongliang Xiong
KHKai HUANG
Kai HUANG
HJHaitian Jiang
Haitian Jiang
BLBowen Li
Bowen Li
SCSiang Chen
Siang Chen
XJXiaowen Jiang
Xiaowen Jiang