Motivation: Microbiota data suffers from technical noise (reflected as excess of zeros in the count matrix) and the curse of dimensionality. This complicates downstream data analysis and compromises the scientific discovery’s reliability. Data sparsity makes it difficult to obtain a well-cluster structure and distorts the abundance distributions. Currently, there is a rised need to develop new algorithms with improved capacities to reduce noise and recover missing information. Results: We present mb-PHENIX, an open-source algorithm developed in Python, that recovers taxa abundances from the noisy and sparse microbiota data. Our method deals with sparsity in the count matrix (in 16S microbiota and shotgun studies) by applying imputation via diffusion onto the supervised Uniform Manifold Approximation Projection (sUMAP) space. Our hybrid machine learning approach allows the user to denoise microbiota data. Thus, the differential abundance of microbes is more accurate among study groups, where abundance analysis fails. Availability: The mb-PHENIX algorithm is available at https://github.com/resendislab/mb-PHENIX . An easy-to-use implementation is available on Google Colab (see GitHub) Contact: Oresendis@inmegen.gob.mx Supplementary information: Supplementary data are available at Bioinformatics online.
Single-cell transcriptomics (scRNA-seq) is becoming a technology that is transforming biological discovery in many fields of medicine. Despite its impact in many areas, scRNASeq is technologically and experimentally limited by the inefficient transcript capture and the high rise of noise sources. For that reason, imputation methods were designed to denoise and recover missing values. Many imputation methods (e.g., neighbor averaging or graph diffusion) rely on k nearest neighbor graph construction derived from a mathematical space as a low-dimensional manifold. Nevertheless, the construction of mathematical spaces could be misleading the representation of densities of the distinct cell phenotypes due to the negative effects of the curse of dimensionality. In this work, we demonstrated that the imputation of data through diffusion approach on PCA space favor over-smoothing when increases the dimension of PCA and the diffusion parameters, such k-NN ( k-nearest neighbors ) and t (value of the exponentiation of the Markov matrix) parameters. In this case, the diffusion on PCA space distorts the cell neighborhood captured in the Markovian matrix creating an artifact by connecting densities of distinct cell phenotypes, even though these are not related phenotypically. In this situation, over-smoothing of data is due to the fact of shared information among spurious cell neighbors. Therefore, it can not account for more information on the variability (from principal components) or nearest neighbors for a well construction of a cell-neighborhood. To solve above mentioned issues, we propose a new approach called sc-PHENIX( s
ingle
c
ell-
PHE
notype recovery by
N
on-linear
I
mputation of gene e
X
pression
) which uses PCA-UMAP initialization for revealing new insights into the recovered gene expression that are masked by diffusion on PCA space. sc-PHENIX is an open free algorithm whose code and some examples are shown at https://github.com/resendislab/sc-PHENIX .