31 October 2023 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Rule-based models, e.g., decision trees, are widely used in scenarios demanding high model interpretability for their transparent inner structures and good model expressivity. However, rule-based models are hard to optimize, especially on large data sets, due to their discrete parameters and structures. Ensemble methods and fuzzy/soft rules are commonly used to improve performance, but they sacrifice the model interpretability. To obtain both good scalability and interpretability, we propose a new classifier, named Rule-based Representation Learner (RRL), that automatically learns interpretable non-fuzzy rules for data representation and classification. To train the non-differentiable RRL effectively, we project it to a continuous space and propose a novel training method, called Gradient Grafting, that can directly optimize the discrete model using gradient descent. A novel design of logical activation functions is also devised to increase the scalability of RRL and enable it to discretize the continuous features end-to-end. Exhaustive experiments on ten small and four large data sets show that RRL outperforms the competitive interpretable approaches and can be easily adjusted to obtain a trade-off between classification accuracy and model complexity for different scenarios.
12 September 2022 in IEEE Transactions on Neural Networks and Learning Systems
Numerous electronic health records (EHRs) offer valuable opportunities for understanding patients’ health status at different stages, namely health progression. Extracting the health progression patterns allows researchers to perform accurate predictive analysis of patient outcomes. However, most existing works on this task suffer from the following two limitations: 1) the diverse dependencies among heterogeneous medical entities are overlooked, which leads to the one-sided modeling of patients’ status and 2) the extraction granularity of patient’s health progression patterns is coarse, limiting the model’s ability to accurately infer the patient’s future status. To address these challenges, a pretrained Health progression network via heterogeneous medical information fusion, HealthNet, is proposed in this article. Specifically, a global heterogeneous graph in HealthNet is built to integrate heterogeneous medical entities and the dependencies among them. In addition, the proposed health progression network is designed to model hierarchical medical event sequences. By this method, the fine-grained health progression patterns of patients’ health can be captured. The experimental results on real disease datasets demonstrate that HealthNet outperforms the state-of-the-art models for both diagnosis prediction task and mortality prediction task.
30 November 2022 in Journal of Computer Science and Technology