Deying Kong

Deying Kong

Auto-generated profile, based on publicly available information

Deying Kong

University of California Irvine

Research Focus & Metrics

Academic Career Length

7Years (2020-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
3 November 2022
Verified
Book Chapter
Closed access
PDF file
HMHaoyu Ma
Haoyu Ma
ZWZhe Wang
Zhe Wang
YCYifei Chen
Yifei Chen
DKDeying Kong
Deying Kong
LCLiangjian Chen
Liangjian Chen
XXXiaohui Xie
Xiaohui Xie

27 June 2024 in Medical Image Analysis
Verified
Journal Article
Open access
SSShanlin Sun
Shanlin Sun
KHKun Han
Kun Han
CYChenyu You
Chenyu You
HTHao Tang
Hao Tang
DKDeying Kong
Deying Kong
XXXiaohui Xie
Xiaohui Xie
Image registration is an essential step in many medical image analysis tasks. Traditional methods for image registration are primarily optimization-driven, finding the optimal deformations that maximize the similarity between two images. Recent learning-based methods, trained to directly predict transformations between two images, run much faster, but suffer from performance deficiencies due to domain shift. Here we present a new neural network based image registration framework, called NIR (Neural Image Registration), which is based on optimization but utilizes deep neural networks to model deformations between image pairs. NIR represents the transformation between two images with a continuous function implemented via neural fields, receiving a 3D coordinate as input and outputting the corresponding deformation vector. NIR provides two ways of generating deformation field: directly output a displacement vector field for general deformable registration, or output a velocity vector field and integrate the velocity field to derive the deformation field for diffeomorphic image registration. The optimal registration is discovered by updating the parameters of the neural field via stochastic mini-batch gradient descent. We describe several design choices that facilitate model optimization, including coordinate encoding, sinusoidal activation, coordinate sampling, and intensity sampling. NIR is evaluated on two 3D MR brain scan datasets, demonstrating highly competitive performance in terms of both registration accuracy and regularity. Compared to traditional optimization-based methods, our approach achieves better results in shorter computation times. In addition, our methods exhibit performance on a cross-dataset registration task, compared to the pre-trained learning-based methods.

3 November 2022
Verified
Book Chapter
Closed access
PDF file
DKDeying Kong
Deying Kong
LZLinguang Zhang
Linguang Zhang
LCLiangjian Chen
Liangjian Chen
HMHaoyu Ma
Haoyu Ma
XYXiangyi Yan
Xiangyi Yan
XXXiaohui Xie
Xiaohui Xie

9 December 2021 in arXiv
Verified
Preprint
Open access
PDF file
HMHaoyu Ma
Haoyu Ma
CJChen Liang Jian
Chen Liang Jian
DKDeying Kong
Deying Kong
ZWZhe Wang
Zhe Wang
XLXingwei Liu
Xingwei Liu
XXXiaohui Xie
Xiaohui Xie
Estimating the 2D human poses in each view is typically the first step in calibrated multi-view 3D pose estimation. But the performance of 2D pose detectors suffers from challenging situations such as occlusions and oblique viewing angles. To address these challenges, previous works derive point-to-point correspondences between different views from epipolar geometry and utilize the correspondences to merge prediction heatmaps or feature representations. Instead of post-prediction merge/calibration, here we introduce a transformer framework for multi-view 3D pose estimation, aiming at directly improving individual 2D predictors by integrating information from different views. Inspired by previous multi-modal transformers, we design a unified transformer architecture, named TransFusion, to fuse cues from both current views and neighboring views. Moreover, we propose the concept of epipolar field to encode 3D positional information into the transformer model. The 3D position encoding guided by the epipolar field provides an efficient way of encoding correspondences between pixels of different views. Experiments on Human 3.6M and Ski-Pose show that our method is more efficient and has consistent improvements compared to other fusion methods. Specifically, we achieve 25.8 mm MPJPE on Human 3.6M with only 5M parameters on 256 x 256 resolution.

28 April 2023 in arXiv
Verified
Preprint
Open access
PDF file
DKDeying Kong
Deying Kong
YCYifei Chen
Yifei Chen
HMHaoyu Ma
Haoyu Ma
XYXiangyi Yan
Xiangyi Yan
XXXiaohui Xie
Xiaohui Xie
In this paper, we propose a new architecture called Adaptive Graphical Model Network (AGMN) to tackle the task of 2D hand pose estimation from a monocular RGB image. The AGMN consists of two branches of deep convolutional neural networks for calculating unary and pairwise potential functions, followed by a graphical model inference module for integrating unary and pairwise potentials. Unlike existing architectures proposed to combine DCNNs with graphical models, our AGMN is novel in that the parameters of its graphical model are conditioned on and fully adaptive to individual input images. Experiments show that our approach outperforms the state-of-the-art method used in 2D hand keypoints estimation by a notable margin on two public datasets. Code can be found at https://github.com/deyingk/agmn.

21 March 2022 in arXiv
Verified
Preprint
Open access
PDF file
SSShanlin Sun
Shanlin Sun
KHKun Han
Kun Han
DKDeying Kong
Deying Kong
HTHao Tang
Hao Tang
XYXiangyi Yan
Xiangyi Yan
XXXiaohui Xie
Xiaohui Xie
Deep Implicit Functions (DIFs) represent 3D geometry with continuous signed distance functions learned through deep neural nets. Recently DIFs-based methods have been proposed to handle shape reconstruction and dense point correspondences simultaneously, capturing semantic relationships across shapes of the same class by learning a DIFs-modeled shape template. These methods provide great flexibility and accuracy in reconstructing 3D shapes and inferring correspondences. However, the point correspondences built from these methods do not intrinsically preserve the topology of the shapes, unlike mesh-based template matching methods. This limits their applications on 3D geometries where underlying topological structures exist and matter, such as anatomical structures in medical images. In this paper, we propose a new model called Neural Diffeomorphic Flow (NDF) to learn deep implicit shape templates, representing shapes as conditional diffeomorphic deformations of templates, intrinsically preserving shape topologies. The diffeomorphic deformation is realized by an auto-decoder consisting of Neural Ordinary Differential Equation (NODE) blocks that progressively map shapes to implicit templates. We conduct extensive experiments on several medical image organ segmentation datasets to evaluate the effectiveness of NDF on reconstructing and aligning shapes. NDF achieves consistently state-of-the-art organ shape reconstruction and registration results in both accuracy and quality. The source code is publicly available at https://github.com/Siwensun/Neural_Diffeomorphic_Flow--NDF.