In the paper, we revisit the problem of class prior probability estimation with positive and unlabelled data gathered in a single-sample scenario. The task is important as it is known that in positive unlabelled setting, a classifier can be successfully learned if the class prior is available. We show that without additional assumptions, class prior probability is not identifiable and thus the existing non-parametric estimators are necessarily biased in general if extra assumptions are not imposed. The magnitude of their bias is also investigated. The problem becomes identifiable when the probabilistic structure satisfies mild semi-parametric assumptions. Consequently, we propose a method based on a logistic fit and a concave minorization of its (non-concave) log-likelihood. The experiments conducted on artificial and benchmark datasets as well as on a large clinical database MIMIC indicate that the estimation errors for the proposed method are usually lower than for its competitors and that it is robust against departures from logistic settings.
We consider a nonparametric Generative Tree Model and discuss a problem of selecting active predictors for the response in such scenario. We investigated two popular information-based selection criteria: Conditional Infomax Feature Extraction (CIFE) and Joint Mutual information (JMI), which are both derived as approximations of Conditional Mutual Information (CMI) criterion. We show that both criteria CIFE and JMI may exhibit different behavior from CMI, resulting in different orders in which predictors are chosen in variable selection process. Explicit formulae for CMI and its two approximations in the generative tree model are obtained. As a byproduct, we establish expressions for an entropy of a multivariate gaussian mixture and its mutual information with mixing distribution.
Pneumonia is the leading cause of death from infectious disease worldwide. The diagnosis and treatment of patients with pneumonia lag behind other major conditions, relying on syndromic definitions that lack molecular resolution and ignore underlying endotypes. We sought to test the hypothesis that dynamic pathogen-specific host responses in the alveolar space represent distinct pneumonia endotypes linked to different clinical features and outcomes. We prospectively enrolled a cohort of 690 patients (including immunocompromised patients) with known or suspected pneumonia receiving mechanical ventilation in whom the etiology of pneumonia was determined by gold-standard analysis of distal lung fluid obtained by bronchoalveolar lavage (BAL) combined with clinical adjudication. From these patients, we analyzed 792 BAL fluid samples, including 310 serial samples, using flow cytometry (482 patients) and single-cell RNA-sequencing (170 patients; 263 samples, complemented by 9 healthy controls and 25 post-COVID-19 patients, yielding ~2.4 million single cells across 28 cell types), and extracted daily clinical data from the electronic health record (>15,000 patient-days). We used machine learning models to identify pathogen-specific host responses in the transcriptome of alveolar immune cells that were associated with changes in alveolar cell abundance and clinical features. Our results suggest that therapeutic strategies for pneumonia should be individualized to specific host-pathogen interactions.