Huadong Wang

Huadong Wang

Auto-generated profile, based on publicly available information

Huadong Wang

Dept. of Comp. Sci. & Tech Institute for AI Tsinghua University Beijing China

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
24 December 2024 in ACM Computing Surveys
Verified
Journal Article
Open access
YQYujia Qin
Yujia Qin
SHShengding Hu
Shengding Hu
YLYankai Lin
Yankai Lin
WCWeize Chen
Weize Chen
NDNing Ding
Ning Ding
MSMaosong Sun
Maosong Sun
Humans possess an extraordinary ability to create and utilize tools. With the advent of foundation models, artificial intelligence systems have the potential to be equally adept in tool use as humans. This paradigm, which is dubbed as tool learning with foundation models , combines the strengths of tools and foundation models to achieve enhanced accuracy, efficiency, and automation in problem-solving. This article presents a systematic investigation and comprehensive review of tool learning. We first introduce the background of tool learning, including its cognitive origins, the paradigm shift of foundation models, and the complementary roles of tools and models. Then we recapitulate existing tool learning research and formulate a general framework: starting from understanding the user instruction, models should learn to decompose a complex task into several subtasks, dynamically adjust their plan through reasoning, and effectively conquer each sub-task by selecting appropriate tools. We also discuss how to train models for improved tool-use capabilities and facilitate generalization in tool learning. Finally, we discuss several open problems that require further investigation, such as ensuring trustworthy tool use, enabling tool creation with foundation models, and addressing personalization challenges. Overall, we hope this article could inspire future research in integrating tools with foundation models.

14 June 2023 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
SLShang Liu
Shang Liu
HWHuadong Wang
Huadong Wang
YHYuan Hu
Yuan Hu
MZMengting Zhang
Mengting Zhang
YZYixuan Zhu
Yixuan Zhu
FWFan Wang
Fan Wang
With the advancement of geo-systems and the increased availability of satellite data, a plethora of Land-Use and Land-Cover (LULC) products have been developed. The existing LULC products primarily relied on time-series imagery to classify land by pixel-based classifiers, allowing for local analysis and accurate boundary detection. However, the advent of deep learning has shifted towards the use of patch-based CNN models for generating land cover maps. In this paper, (1) we create a training dataset for China using a voting strategy based on three off-the-shelf available LULC products, avoiding the labor-intensive manual annotation. (2) We design a novel CNN-based model for LULC task, called Multi-modal Fine-grained Dual Network (dubbed as Dual-Net), which takes dual-date images to generate final maps, and reduces the need for gap-free temporal sequences or separate cloud detection. To leverage the correlation between location, date, and category, we embed multi-modal information (dates and geo-locations) to the model. Further, by incorporating low-level constraints and using pseudo-label refinement, we continually improve the performance and achieve more refined segmentation. (3) Due to the lack of a suitable validation dataset for China, we create a new validation dataset called China Sentinel2 Validation Dataset (CSVD) by manually annotating 733 finely labeled images of 1024 × 1024 pixels of China-specific Sentinel2 data. (4) Extensive experiments demonstrate that our model outperforms existing LULC products and produces more fine-grained segmentation results comparable to other patch-based products. Finally, we release annual LULC maps for China in 2020-2022 and also make our model accessible online for real-time results export.

23 January 2024 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
JLJiabin Liu
Jiabin Liu
HWHuadong Wang
Huadong Wang
HHHanyuan Hang
Hanyuan Hang
SMShumin Ma
Shumin Ma
XSXin Shen
Xin Shen
YSYong Shi
Yong Shi
Anomaly detection, the task of differentiating abnormal data points from normal ones, presents a significant challenge in the realm of machine learning. Numerous strategies have been proposed to tackle this task, with classification-based methods, specifically those utilizing a self-supervised approach via random affine transformations (RATs), demonstrating remarkable performance on both image and non-image data. However, these methods encounter a notable bottleneck, the overlap of constructed labeled datasets across categories, which hampers the subsequent classifiers’ ability to detect anomalies. Consequently, the creation of an effective data distribution becomes the pivotal factor for success. In this article, we introduce a model called “self-supervised forest (sForest)”, which leverages the random Fourier transform (RFT) and random orthogonal rotations to craft a controlled data distribution. Our model utilizes the RFT to map input data into a new feature space. With this transformed data, we create a self-labeled training dataset using random orthogonal rotations. We theoretically prove that the data distribution formulated by our methodology is more stable compared to one derived from RATs. We then use the self-labeled dataset in a random forest (RF) classifier to distinguish between normal and anomalous data points. Comprehensive experiments conducted on both real and artificial datasets illustrate that sForest outperforms other anomaly detection methods, including distance-based, kernel-based, forest-based, and network-based benchmarks.

30 August 2022 in IEEE/ACM Transactions on Audio, Speech, and Language Processing
Verified
Journal Article
Closed access
HWHuadong Wang
Huadong Wang
XSXin Shen
Xin Shen
MTMei Tu
Mei Tu
YZYimeng Zhuang
Yimeng Zhuang
ZLZhiyuan Liu
Zhiyuan Liu
Recently, the attention mechanism boosts the performance of many neural network models in Natural Language Processing (NLP). Among the various attention mechanisms, Multi-Head Attention (MHA) is a powerful and popular variant. MHA helps the model to attend to different feature subspaces independently which is an essential component of Transformer. Despite its success, we conjecture that the different heads of the existing MHA may not collaborate properly. To validate this assumption and further improve the performance of Transformer, we study the collaboration problem for MHA in this paper. First, we propose the Single-Layer Collaboration (SLC) mechanism to help each attention head improve its attention distribution based on the feedback of other heads. Furthermore, we extend SLC to the cross-layer Multi-Head Dense Collaboration (MHDC) mechanism. MHDC helps each MHA layer learn the attention distributions considering the knowledge from the other MHA layers. Both SLC and MHDC are implemented as lightweight modules with very few additional parameters. When equipped with these modules, our new framework, i.e., Collaborative TransFormer ( CollFormer ), significantly outperforms the vanilla Transformer on a range of NLP tasks, including machine translation, sentence semantic relatedness, natural language inference, sentence classification, and reading comprehension. Besides, we also carry out extensive quantitative experiments to analyze the properties of the MHDC in different settings. The experimental results validate the effectiveness and universality of MHDC as well as CollFormer .

18 July 2018 in Journal of Medical Internet Research
Verified
Journal Article
Open access
YSYong Shi
Yong Shi
PLPeijia Li
Peijia Li
XYXiaodan Yu
Xiaodan Yu
HWHuadong Wang
Huadong Wang
LNLingfeng Niu
Lingfeng Niu
Journal of Medical Internet Research - International Scientific Journal for Medical Research, Information and Communication on the Internet #Preprint #PeerReviewMe: Warning: This is a unreviewed preprint. Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn. Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period. Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author). Background: Doctor performance evaluation (DPE) is an important task in mHealth, which aims to evaluate the overall quality of online diagnosis and patient outcomes so that high customer satisfaction and loyalty can be attained. However in reality most customers trend not to give ratings to doctors’ performance. Therefore it is imperative to develop a model to make DPE automatically. When making auto-evaluation of doctors’ performance, we expect to rate the doctors’ performance into a score label that is as close as possible to the true one. Objective: This study aims to do DPE automatically from online textual consultation contents between doctors and customers by a novel machine learning method. Methods: We propose a solution that models DPE as an ordinal regression problem. In doing so, a combined support vector machine and ordinal partitioning model (called SVMOP for short), along with an innovative prediction function is developed to capture the ordering labels hidden in preferences over DPE. Specifically, when conducting the feature engineering, in addition to the basic text features, eight handcrafted features extracted from over 70,000 medical entries, are added and then further boosted by Gradient Boosting Decision Tree. Results: Real data sets from one of the largest mobile doctor-patient communication platforms in China are used in our study. In according with the statistics, 64% of data on mHealth platforms lack the evaluation labels from customers. Experimental results reveal that our approach can well support doctor performance evaluation automatically. Specifically, compared with other auto-evaluation models, SVMOP improves mean absolute error (MAE) by 0.1, mean square error (MSE) by 0.5, pairwise accuracy (PAcc) by 5%; the handcrafted features that we suggest, improve MAE by 0.1, MSE by 0.2, PAcc by 3%. After boosting, the performance can be further improved. Furthermore, based on SVMOP, we could also mine some predictive features such as useful polite expressions and sentiment words, which can be further applied to guide the development of mHealth platforms. Conclusions: It is the first time to model the problem of doctor performance evaluation as an ordinal regression problem. Experiments show that the performance of our proposed model with revised prediction function is better than many other machine learning methods on MAE, MSE as well as PAcc. In summary, with this model the mHealth platform could not only make an auto-evaluation of doctors’ performance online but also mine the most effective features, which could guide the promotion of doctors’ performance and the development of mHealth platforms.

21 February 2022 in IEEE Transactions on Neural Networks and Learning Systems
Verified
Journal Article
Closed access
JLJiabin Liu
Jiabin Liu
Bo WangBo Wang
Bo Wang
HHHanyuan Hang
Hanyuan Hang
HWHuadong Wang
Huadong Wang
ZQZhiquan Qi
Zhiquan Qi
YSYong Shi
Yong Shi
Learning from label proportions (LLP) is a widespread and important learning paradigm: only the bag-level proportional information of the grouped training instances is available for the classification task, instead of the instance-level labels in the fully supervised scenario. As a result, LLP is a typical weakly supervised learning protocol and commonly exists in privacy protection circumstances due to the sensitivity in label information for real-world applications. In general, it is less laborious and more efficient to collect label proportions as the bag-level supervised information than the instance-level one. However, the hint for learning the discriminative feature representation is also limited as a less informative signal directly associated with the labels is provided, thus deteriorating the performance of the final instance-level classifier. In this article, delving into the label proportions, we bypass this weak supervision by leveraging generative adversarial networks (GANs) to derive an effective algorithm LLP-GAN. Endowed with an end-to-end structure, LLP-GAN performs approximation in the light of an adversarial learning mechanism without imposing restricted assumptions on distribution. Accordingly, the final instance-level classifier can be directly induced upon the discriminator with minor modification. Under mild assumptions, we give the explicit generative representation and prove the global optimality for LLP-GAN. In addition, compared with existing methods, our work empowers LLP solvers with desirable scalability inheriting from deep models. Extensive experiments on benchmark datasets and a real-world application demonstrate the vivid advantages of the proposed approach.