Most of the modeling performed in the area of systems biology aims at achieving a quantitative description of the intracellular pathways within a "typical cell". However, in many biologically important situations even clonal cell populations can show a heterogeneous response. These situations require study of cell-to-cell variability and the development of models for heterogeneous cell populations.

Machine learning has become a powerful tool for systems biologists, from diagnosing cancer to optimizing kinetic models and predicting the state, growth dynamics, or type of a cell. Potential predictions from complex biological data sets obtained by “omics” experiments seem endless, but are often not the main objective of biological research. Often we want to understand the molecular mechanisms of a disease to develop new therapies, or we need to justify a crucial decision that is derived from a prediction. In order to gain such knowledge from data, machine learning models need to be extended. A recent trend to achieve this is to design “interpretable” models. However, the notions around interpretability are sometimes ambiguous, and a universal recipe for building well-interpretable models is missing. With this work, we want to familiarize systems biologists with the concept of model interpretability in machine learning. We consider data sets, data preparation, machine learning methods, and software tools relevant to omics research in systems biology. Finally, we try to answer the question: “What is interpretability?” We introduce views from the interpretable machine learning community and propose a scheme for categorizing studies on omics data. We then apply these tools to review and categorize recent studies where predictive machine learning models have been constructed from non-sequential omics data.

Cellular communication via intracellular signalling pathways is crucial. Expression and activation of signalling proteins is heterogenous between isogenic cells of the same cell-type. However, mechanisms evolved to enable sufficient communication and to ensure cellular functions. We use information theory to clarify mechanisms facilitating IL-6-induced JAK/STAT signalling despite cell-to-cell variability. We show that different mechanisms enabling robustness against variability complement each other. Early STAT3 activation is robust as long as cytokine concentrations are low. Robustness at high cytokine concentrations is ensured by high STAT3 expression or serine phosphorylation. Later the feedback-inhibitor SOCS3 increases robustness. Channel Capacity of JAK/STAT signalling is limited by cell-to-cell variability in STAT3 expression and is affected by the same mechanisms governing robustness. Increasing STAT3 amount increases Channel Capacity and robustness, whereas increasing STAT3 tyrosine phosphorylation reduces robustness but increases Channel Capacity. In summary, we elucidate mechanisms preventing dysregulated signalling by enabling reliable JAK/STAT signalling despite cell-to-cell heterogeneity.

Cellular signaling networks have evolved an astonishing ability to function reliably and with high fidelity in uncertain environments. A crucial prerequisite for the high precision exhibited by many signaling circuits is their ability to keep the concentrations of active signaling compounds within tightly defined bounds, despite strong stochastic fluctuations in copy numbers and other detrimental influences. Based on a simple mathematical formalism, we identify topological organizing principles that facilitate such robust control of intracellular concentrations in the face of multifarious perturbations. Our framework allows us to judge whether a multiple-input-multiple-output reaction network is robust against large perturbations of network parameters and enables the predictive design of perfectly robust synthetic network architectures. Utilizing the Escherichia coli chemotaxis pathway as a hallmark example, we provide experimental evidence that our framework indeed allows us to unravel the topological organization of robust signaling. We demonstrate that the specific organization of the pathway allows the system to maintain global concentration robustness of the diffusible response regulator CheY with respect to several dominant perturbations. Our framework provides a counterpoint to the hypothesis that cellular function relies on an extensive machinery to fine-tune or control intracellular parameters. Rather, we suggest that for a large class of perturbations, there exists an appropriate topology that renders the network output invariant to the respective perturbations. Cellular signaling networks have to function reliably and with high fidelity in an uncertain environment. In this paper, we investigate the topological principles to achieve such robust signal processing in living cells. Specifically, we identify the topological organizing principles that enable a signaling network to keep the stationary intracellular concentrations of certain molecules, such as active signaling compounds, within tightly defined bounds – despite conditions of uncertainty and in the face of multiple perturbations. We demonstrate that an appropriate topological organization renders the output of the pathway invariant against a large class of possible detrimental fluctuations, such as changes in energy states or total protein concentrations. Furthermore, we show that the topological requirements for robust signal processing can be formalized in terms of a linear vector space, denoted as invariant perturbation space, that predicts the robustness properties of the network. Constructing this invariant perturbation space for the Escherichia coli chemotaxis pathway reveals that the pathway is indeed invariant with respect to most dominant perturbations that would otherwise significantly hamper information transmission. Our framework provides a counterpoint to the hypothesis that cellular function relies on an extensive machinery to fine-tune or control intracellular parameters.

Background: Cell-to-cell heterogeneity is an inherent feature of multicellular organisms and is central in all physiological and pathophysiological processes including cellular signal transduction. The cytokine IL-6 is an essential mediator of pro- and anti-inflammatory processes. Dysregulated IL-6-induced intracellular JAK/STAT signalling is associated with severe inflammatory and proliferative diseases. Under physiological conditions JAK/STAT signalling is rigorously controlled and timely orchestrated by regulatory mechanisms such as expression of the feedback-inhibitor SOCS3 and activation of the protein-tyrosine phosphatase SHP2 (PTPN11). Interestingly, the function of negative regulators seems not to be restricted to controlling the strength and timely orchestration of IL-6-induced STAT3 activation. Exemplarily, SOCS3 increases robustness of late IL-6-induced STAT3 activation against heterogenous STAT3 expression and reduces the amount of information transferred through JAK/STAT signalling. Methods: Here we use multiplexed single-cell analyses and information theoretic approaches to clarify whether also SHP2 contributes to robustness of STAT3 activation and whether SHP2 affects the amount of information transferred through IL-6-induced JAK/STAT signalling. Results: SHP2 increases robustness of both basal, cytokine-independent STAT3 activation and early IL-6-induced STAT3 activation against differential STAT3 expression. However, SHP2 does not affect robustness of late IL-6-induced STAT3 activation. In contrast to SOCS3, SHP2 increases the amount of information transferred through IL-6-induced JAK/STAT signalling, probably by reducing cytokine-independent STAT3 activation and thereby increasing sensitivity of the cells. These effects are independent of SHP2-dependent MAPK activation. Conclusion: In summary, the results of this study extend our knowledge of the functions of SHP2 in IL-6-induced JAK/STAT signalling. SHP2 is not only a repressor of basal and cytokine-induced STAT3 activity, but also ensures robustness and transmission of information. Plain English summary Cells within a multicellular organism communicate with each other to exchange information about the environment. Communication between cells is facilitated by soluble molecules that transmit information from one cell to the other. Cytokines such as interleukin-6 are important soluble mediators that are secreted when an organism is faced with infections or inflammation. Secreted cytokines bind to receptors within the membrane of their target cells. This binding induces activation of an intracellular cascade of reactions called signal transduction, which leads to cellular responses. An important example of intracellular signal transduction is JAK/STAT signalling. In healthy organisms signalling is controlled and timed by regulatory mechanisms, whose activation results in a controlled shutdown of signalling pathways. Interestingly, not all cells within an organism are identical. They differ in the amount of proteins involved in signal transduction, such as STAT3. These differences shape cellular communication and responses to intracellular signalling. Here, we show that an important negative regulatory protein called SHP2 (or PTPN11) is not only responsible for shutting down signalling, but also for steering signalling in heterogeneous cell populations. SHP2 increases robustness of STAT3 activation against variable STAT3 amounts in individual cells. Additionally, it increases the amount of information transferred through JAK/STAT signalling by increasing the dynamic range of pathway activation in heterogeneous cell populations. This is an amazing new function of negative regulatory proteins that contributes to communication in heterogeneous multicellular organisms in health and disease.