Tao Feng

Dr. Tao Feng


Research Focus & Metrics

Academic Career Length

3Years (2024-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 January 2024
Verified
Conference Paper
Open access
PDF file
TFTao Feng
Tao Feng
YLYicheng Li
Yicheng Li
LCLi Chenglin
Li Chenglin
HCHao Chen
Hao Chen
FYFei Yu
Fei Yu
YZYin Zhang
Yin Zhang
Tao Feng, Yicheng Li, Li Chenglin, Hao Chen, Fei Yu, Yin Zhang. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.

17 December 2025 in Computers
Verified
Journal Article
Open access
PDF file
HCHuanyu Cheng
Huanyu Cheng
LSLinjiang Shang
Linjiang Shang
XCXikang Chen
Xikang Chen
TFTao Feng
Tao Feng
YZYin Zhang
Yin Zhang
Building high-quality multimodal instruction datasets is often time-consuming and costly. Recent studies have shown that a small amount of carefully selected high-quality data can be more effective for improving LVLM performance than large volumes of low-quality data. Based on these observations, we propose an error-guided multimodal sample selection framework with hallucination suppression for LVLM fine-tuning. First, semantic embeddings of queries are clustered to form balanced subsets that preserve task diversity. A visual contrastive decoding module is then used to reduce hallucinations and expose genuinely difficult examples. For closed-ended tasks, such as object detection, we estimate sample value using prediction accuracy; for open-ended question answering, we use the perplexity of generated responses as a difficulty signal. Within each cluster, high-error or high-perplexity samples are preferentially selected to construct a compact yet informative training set. Experiments on the InsPLAD detection benchmark and the PowerQA visual question answering dataset show that our method consistently outperforms random sampling under the same data budget, achieving higher F1, cosine similarity, BLEU (Bilingual Evaluation Understudy), and GPT-4o-based evaluation scores. This demonstrates that hallucination-aware, uncertainty-driven data selection can improve LVLM robustness and data efficiency.

14 October 2024 in arXiv
Verified
Preprint
Open access
PDF file
CLChenglin Li
Chenglin Li
QCQianglong Chen
Qianglong Chen
ZLZhi Li
Zhi Li
TFTao Feng
Tao Feng
YLYicheng Li
Yicheng Li
YZYin Zhang
Yin Zhang
Instruction tuning is a crucial technique for aligning language models with humans' actual goals in the real world. Extensive research has highlighted the quality of instruction data is essential for the success of this alignment. However, creating high-quality data manually is labor-intensive and time-consuming, which leads researchers to explore using LLMs to synthesize data. Recent studies have focused on using a stronger LLM to iteratively enhance existing instruction data, showing promising results. Nevertheless, previous work often lacks control over the evolution direction, resulting in high uncertainty in the data synthesis process and low-quality instructions. In this paper, we introduce a general and scalable framework, IDEA-MCTS (Instruction Data Enhancement using Monte Carlo Tree Search), a scalable framework for efficiently synthesizing instructions. With tree search and evaluation models, it can efficiently guide each instruction to evolve into a high-quality form, aiding in instruction fine-tuning. Experimental results show that IDEA-MCTS significantly enhances the seed instruction data, raising the average evaluation scores of quality, diversity, and complexity from 2.19 to 3.81. Furthermore, in open-domain benchmarks, experimental results show that IDEA-MCTS improves the accuracy of real-world instruction-following skills in LLMs by an average of 5\% in low-resource settings.