Tianrun Chen

Tianrun Chen

orcid

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
5 June 2025 in Science
Verified
Journal Article
Closed access
XXXin Xu
Xin Xu
XZXiuming Zhang
Xiuming Zhang
YZYiyang Zou
Yiyang Zou
TCTianrun Chen
Tianrun Chen
JZJingfang Zhan
Jingfang Zhan
BGBaojing Gu
Baojing Gu
Carbon and nitrogen are central elements in global biogeochemical cycles. To effectively manage carbon and nitrogen in China, we developed a comprehensive model for quantifying their fluxes, investigating their interplay across 16 human and natural subsystems. Between 1980 and 2020, nitrogen losses in China increased 2.3-fold and carbon emissions surged 6.5-fold. Integrated carbon and nitrogen management holds the potential for a 74% reduction in nitrogen losses to air and water and a 91% decrease in carbon emissions to the atmosphere by 2060. Compared with separate control of carbon or nitrogen, integrated management delivers an additional reduction of 1.8 million tons of nitrogen and 26.5 million tons of carbon by 2060, bringing out a 37% decrease in unit abatement cost and a net societal benefit of 1384 billion USD.

13 July 2024
Verified
Conference Paper
Open access
SZShangzhan Zhang
Shangzhan Zhang
SPSida Peng
Sida Peng
TXTao Xu
Tao Xu
YYYuanbo Yang
Yuanbo Yang
TCTianrun Chen
Tianrun Chen
XZXiaowei Zhou
Xiaowei Zhou
This paper aims to generate materials for 3D meshes from text descriptions. Unlike existing methods that synthesize texture maps, we propose to generate segment-wise procedural material graphs as the appearance representation, which supports high-quality rendering and provides substantial flexibility in editing. Instead of relying on extensive paired data, i.e., 3D meshes with material graphs and corresponding text descriptions, to train a material graph generative model, we propose to leverage the pre-trained 2D diffusion model as a bridge to connect the text and material graphs. Specifically, our approach decomposes a shape into a set of segments and designs a segment-controlled diffusion model to synthesize 2D images that are aligned with mesh parts. Based on generated images, we initialize parameters of material graphs and fine-tune them through the differentiable rendering module to produce materials in accordance with the textual description. Extensive experiments demonstrate the superior performance of our framework in photorealism, resolution, and editability over existing methods.

25 October 2023 in IEEE Transactions on Multimedia
Verified
Journal Article
Closed access
TCTianrun Chen
Tianrun Chen
CDChaotao Ding
Chaotao Ding
LZLanyun Zhu
Lanyun Zhu
YZYing Zang
Ying Zang
YLYiyi Liao
Yiyi Liao
LSLingyun Sun
Lingyun Sun
The emerging trend of AR/VR places great demands on 3D content. However, most existing software requires expertise and is difficult for novice users to use. In this paper, we aim to create sketch-based modeling tools for user-friendly 3D modeling. We introduce Reality3DSketch with a novel application of an immersive 3D modeling experience, in which a user can capture the surrounding scene using a monocular RGB camera and can draw a single sketch of an object in the real-time reconstructed 3D scene. A 3D object is generated and placed in the desired location, enabled by our novel neural network with the input of a single sketch. Our neural network can predict the pose of a drawing and can turn a single sketch into a 3D model with view and structural awareness, which addresses the challenge of sparse sketch input and view ambiguity. We conducted extensive experiments synthetic and real-world datasets and achieved state-of-the-art (SOTA) results in both sketch view estimation and 3D modeling performance. According to our user study, our method of performing 3D modeling in a scene is $>$ 5x faster than conventional methods. Users are also more satisfied with the generated 3D model than the results of existing methods.

1 January 2024 in Frontiers of Information Technology & Electronic Engineering
Verified
Journal Article
Closed access
PDF file
TCTianrun Chen
Tianrun Chen
RCRunlong Cao
Runlong Cao
ZLZejian Li
Zejian Li
YZYing Zang
Ying Zang
LSLingyun Sun
Lingyun Sun
The rise of artificial intelligence generated content (AIGC) has been remarkable in the language and image fields, but artificial intelligence (AI) generat

26 May 2025 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Verified
Journal Article
Closed access
LZLanyun Zhu
Lanyun Zhu
TCTianrun Chen
Tianrun Chen
DJDeyi Ji
Deyi Ji
PXPeng Xu
Peng Xu
JYJieping Ye
Jieping Ye
JLJared Liu
Jared Liu
Despite the rapid advancements in few-shot segmentation (FSS), most of existing methods in this domain are hampered by their reliance on the limited and biased information from only a small number of labeled samples. This limitation inherently restricts their capability to achieve sufficiently high levels of performance. To address this issue, this paper proposes a pioneering framework named LLaFS++, which, for the first time, applies large language models (LLMs) into FSS and achieves notable success. LLaFS++ leverages the extensive prior knowledge embedded by LLMs to guide the segmentation process, effectively compensating for the limited information contained in the few-shot labeled samples and thereby achieving superior results. To enhance the effectiveness of the text-based LLMs in FSS scenarios, we present several innovative and task-specific designs within the LLaFS++ framework. Specifically, we introduce an input instruction that allows the LLM to directly produce segmentation results represented as polygons, and propose a region-attribute corresponding table to simulate the human visual system and provide multi-modal guidance. We also synthesize pseudo samples and use curriculum learning for pretraining to augment data and achieve better optimization, and propose a novel inference method to mitigate potential oversegmentation hallucinations caused by the regional guidance information. Incorporating these designs, LLaFS++ constitutes an effective framework that achieves state-of-the-art results on multiple datasets including PASCAL-$5^{i}$, COCO-$20^{i}$, and FSS-1000. Our superior performance showcases the remarkable potential of applying LLMs to process few-shot vision tasks.

9 August 2024 in Preprints.org
Verified
Preprint
Open access
PDF file
TCTianrun Chen
Tianrun Chen
ALAnkang Lu
Ankang Lu
LZLanyun Zhu
Lanyun Zhu
CDChaotao Ding
Chaotao Ding
CYChunan Yu
Chunan Yu
YZYing Zang
Ying Zang
The advent of large models, also known as foundation models, has significantly transformed the AI research landscape, with models like Segment Anything (SAM) achieving notable success in diverse image segmentation scenarios. Despite its advancements, SAM encountered limitations in handling some complex low-level segmentation tasks like camouflaged object and medical imaging. In response, in 2023, we introduced SAM-Adapter, which demonstrated improved performance on these challenging tasks. Now, with the release of Segment Anything 2 (SAM2)—a successor with enhanced architecture and a larger training corpus—we reassess these challenges. This paper introduces SAM2-Adapter, the first adapter designed to overcome the persistent limitations observed in SAM2 and achieve new state-of-the-art (SOTA) results in specific downstream tasks including medical image segmentation, camouflaged (concealed) object detection, and shadow detection. SAM2-Adapter builds on the SAM-Adapter's strengths, offering enhanced generalizability and composability for diverse applications. We present extensive experimental results demonstrating SAM2-Adapter's effectiveness. We show the potential and encourage the research community to leverage the SAM2 model with our SAM2-Adapter for achieving superior segmentation outcomes. Code, pre-trained models, and data processing protocols are available at http://tianrun-chen.github.io/SAM-Adaptor/.