Non-contact visual monitoring of vital signs in neonatology has been demonstrated by several recent studies in ideal scenarios where the baby is calm and there is no medical or parental intervention. Similar to contact monitoring methods (e.g., ECG, pulse oximeter) the camera-based solutions suffer from motion artifacts. Therefore, during care and the infants’ active periods, calculated values typically differ largely from the real ones. In this way, our main contribution to existing remote camera-based techniques is to detect and classify such situations with a high level of confidence. Our algorithms can not only evaluate quiet periods, but can also provide continuous monitoring. Altogether, our proposed algorithms can measure pulse rate, breathing rate, and to recognize situations such as medical intervention or very active subjects using only a single camera, while the system does not exceed the computational capabilities of average CPU-GPU-based hardware. The performance of the algorithms was evaluated on our database collected at the I^st Dept. of Neonatology of Pediatrics, Dept of Obstetrics and Gynecology, Semmelweis University, Budapest, Hungary.

Non-coordinated physical activity may lead to hypoglycemia, which is a dangerous condition for diabetic people. Decision support systems related to type 1 diabetes mellitus (T1DM) still lack the capability of automated therapy modification by recognizing and categorizing the physical activity. Further, this desired adaptive therapy should be achieved without increasing the administrative load, which is already high for the diabetic community. These requirements can be satisfied by using artificial intelligence-based solutions, signals collected by wearable devices, and relying on the already available data sources, such as continuous glucose monitoring systems. In this work, we focus on the detection of physical activity by using a continuous glucose monitoring system and a wearable sensor providing the heart rate—the latter is accessible even in the cheapest wearables. Our results show that the detection of physical activity is possible based on these data sources, even if only low-complexity artificial intelligence models are deployed. In general, our models achieved approximately 90% accuracy in the detection of physical activity.

One challenging aspect of therapy optimization and application of control algorithms in the field of tumor growth modeling is the limited number of measurable physiological signals—state variables—and the knowledge of model parameters. A possible solution to provide such information is the application of observer or state estimator. One of the most widely applied estimators for nonlinear problems is the extended Kalman filter (EKF). In this study, a moving horizon estimation (MHE)-based observer is developed and compared to an optimized EKF. The observers utilize a third-order tumor growth model. The performance of the observers is tested on measurements gathered from a laboratory mice trial using chemotherapeutic drug. The proposed MHE is designed to be suitable for closed-loop applications and yields simultaneous state and parameter estimation.

The objective evaluation of an infant’s activity and sleep pattern is critical in improving the comfort of the babies and ensuring the proper amount of quality sleep. The predefined behavioral states of an infant describe their consciousness and arousal level. The different states are characterized by different movements, body tone, eye movements and breath patterns. To recognize and adapt to these states is an essential part of development-friendly caring. It affects the neonate’s sleep, influencing their brain development, while improving the bonding between mother and baby, and feeding is more successful during the state of quiet awakened. It can be a more difficult task to determine the level of arousal in premature neonates. In preterm clinics, the general practice is continuous observation, requiring the attention of the hospital staff. To create an automated, more objective system, helping the hospital staff and the parents, we developed a multi-RNN (multi-recurrent neural network) network-based solution to solve this classification problem, which works on a time-series-like feature set, extracted from cameras’ video feeds. The set is composed of video actigraphy features, video-based respiration signal and additional descriptors. We separate infant caring from undisturbed presence based on our previous ensemble network solution. The network was trained and evaluated using our database of 402 h of footage, collected at the Neonatal Intensive Care Unit, Dept. of Neonatology of Pediatrics, Dept. of Obstetrics and Gynecology, Semmelweis University, Budapest, Hungary, with all-day recordings of 10 babies.

We introduce a novel system for automatic assessment of newborn and preterm infant behavior—including activity levels, behavioral states, and sleep–wake cycles—in clinical settings for streamlining care and minimizing healthcare professionals’ workload. While vital signs are routinely monitored, the previously mentioned assessments require labor-intensive direct observation. Research so far has already introduced non- and minimally invasive solutions. However, we developed a system that automatizes the preceding evaluations in a non-contact way using deep learning algorithms. In this work, we provide a Gated Recurrent Unit (GRU)-stack-based solution that works on a dynamic feature set generated by computer vision methods from the cameras’ video feed and patient monitor to classify the activity phases of infants adapted from the NIDCAP (Newborn Individualized Developmental Care Program) scale. We also show how pulse rate variability (PRV) data could improve the performance of the classification. The network was trained and evaluated on our own database of 108 h collected at the Neonatal Intensive Care Unit, Dept. of Neonatology of Pediatrics, Semmelweis University, Budapest, Hungary.

Like many physiological systems, the various mathematical models describing the glucose-insulin system can only have non-negative inputs. Thus, the control method — often model predictive control in artificial pancreas systems—must provide a non-negative control signal. Existing solutions include saturation and constrained optimization. In this paper, we propose a dynamic extension of the patient model as a way of ensuring the positivity of the control signal, a method previously applied in tumor growth control. We evaluate the controller in a closed-loop simulation and compare the results with a controller using saturation. Our simulations show that control performance with the extended model can reach or exceed the performance achieved with saturation.