12 June 2019 in IEEE Transactions on Pattern Analysis and Machine Intelligence
In this paper, we study weakly supervised learning where a large amount of label information is not accessible. This includes incomplete supervision such as semi-supervised learning and domain adaptation; inexact supervision, such as multi-instance learning and inaccurate supervision, such as label noise learning. Unlike supervised learning, weakly supervised learning, however, may sometimes even degenerate performance. Such deficiency definitely hinders the deployment of weakly supervised learning to real applications. For this reason, it is desired to study safe weakly supervised learning. In this paper we present a generic ensemble learning scheme to derive the safe prediction. We consider optimizing the worst-case performance gain which leads to a maximin optimization. Our resultant formulation brings multiple advantages. Firstly, for many commonly used convex loss functions in classification and regression tasks, our formulation is guaranteed to derive a safe prediction under a mild condition. Secondly, prior knowledge related to the weight of the base weakly supervised learners can be flexibly embedded. Thirdly, our formulation can be globally and efficiently addressed. Finally, it is in an intuitive geometric interpretation. Extensive experiments on multiple weakly supervised learning tasks clearly demonstrate the effectiveness of our proposal algorithms.
12 December 2017 in Machine Learning
21 December 2023 in IEEE Transactions on Visualization and Computer Graphics
Label quality issues, such as noisy labels and imbalanced class distributions, have negative effects on model performance. Automatic reweighting methods identify problematic samples with label quality issues by recognizing their negative effects on validation samples and assigning lower weights to them. However, these methods fail to achieve satisfactory performance when the validation samples are of low quality. To tackle this, we develop Reweighter, a visual analysis tool for sample reweighting. The reweighting relationships between validation samples and training samples are modeled as a bipartite graph. Based on this graph, a validation sample improvement method is developed to improve the quality of validation samples. Since the automatic improvement may not always be perfect, a co-cluster-based bipartite graph visualization is developed to illustrate the reweighting relationships and support the interactive adjustments to validation samples and reweighting results. The adjustments are converted into the constraints of the validation sample improvement method to further improve validation samples. We demonstrate the effectiveness of Reweighter in improving reweighting results through quantitative evaluation and two case studies.
7 February 2021 in Science China Information Sciences
31 October 2022 in Machine Learning
27 October 2022 in Machine Learning