Background and Aims Endoscopic disease activity scoring in ulcerative colitis (UC) is useful in clinical practice but infrequently done. It is required in clinical trials, where it is expensive and slow because human central readers (CR) are needed. A machine learning algorithm (MLA) automating the process could elevate clinical care and facilitate clinical research. Prior work using single-institution databases and endoscopic still images has been promising. Methods 795 full-length endoscopy videos (FLEV) were prospectively collected from a phase 2 trial of mirikizumab with 249 patients from 14 countries, totaling 19.5 million image frames. Expert CRs assigned each FLEV one endoscopic Mayo score (eMS) and one UC endoscopic index of severity (UCEIS) score. Initially, video data were cleaned, and abnormality features extracted using convolutional neural networks. Subsequently, a recurrent neural network (RNN) was trained on the features to predict eMS and UCEIS from individual full-length endoscopy videos. Results The primary metric to assess the performance of the RNN model was quadratic weighted kappa (QWK) comparing the agreement of the machine-read endoscopy score with the human central reader score. QWK progressively penalizes disagreements that exceed one level. The model’s agreement metric was excellent with QWK of 0.844 (95% CI, 0.787-0.901) for eMS and 0.855 (95% CI, 0.80-0.91) for UCEIS. Conclusion We found that a deep learning algorithm can be trained to predict levels of ulcerative colitis severity from full-length endoscopy videos. Our data set was prospectively collected in a multinational clinical trial, videos rather than still images were used, UCEIS and eMS were reported, and MLA performance metrics met or exceeded those previously published for UC severity scores.
26 December 2018 in Journal of Chemical Information and Modeling
Nocturnal scratching substantially impairs the quality of life in individuals with skin conditions such as atopic dermatitis (AD). Current clinical measurements of scratch rely on patient-reported outcomes (PROs) on itch over the last 24 h. Such measurements lack objectivity and sensitivity. Digital health technologies (DHTs), such as wearable sensors, have been widely used to capture behaviors in clinical and real-world settings. In this work, we develop and validate a machine learning algorithm using wrist-wearing actigraphy that could objectively quantify nocturnal scratching events, therefore facilitating accurate assessment of disease progression, treatment effectiveness, and overall quality of life in AD patients. A total of seven subjects were enrolled in a study to generate data overnight in an inpatient setting. Several machine learning models were developed, and their performance was compared. Results demonstrated that the best-performing model achieved the F1 score of 0.45 on the test set, accompanied by a precision of 0.44 and a recall of 0.46. Upon satisfactory performance with an expanded subject pool, our automatic scratch detection algorithm holds the potential for objectively assessing sleep quality and disease state in AD patients. This advancement promises to inform and refine therapeutic strategies for individuals with AD.
1 March 2022 in Journal of Medical Internet Research
Background: Monitoring eating is central to the care of many conditions such as diabetes, eating disorders, heart diseases, and dementia. However, automatic tracking of eating in a free-living environment remains a challenge because of the lack of a mature system and large-scale, reliable training set. Objective: This study aims to fill in this gap by an integrative engineering and machine learning effort and conducting a large-scale study in terms of monitoring hours on wearable-based eating detection. Methods: This prospective, longitudinal, passively collected study, covering 3828 hours of records, was made possible by programming a digital system that streams diary, accelerometer, and gyroscope data from Apple Watches to iPhones and then transfers the data to the cloud. Results: On the basis of this data collection, we developed deep learning models leveraging spatial and time augmentation and inferring eating at an area under the curve (AUC) of 0.825 within 5 minutes in the general population. In addition, the longitudinal follow-up of the study design encouraged us to develop personalized models that detect eating behavior at an AUC of 0.872. When aggregated to individual meals, the AUC is 0.951. We then prospectively collected an independent validation cohort in a different season of the year and validated the robustness of the models (0.941 for meal-level aggregation). Conclusions: The accuracy of this model and the data streaming platform promises immediate deployment for monitoring eating in applications such as diabetic integrative care.
TFT-LCD is an important part of the mobile phone, and the defect detection of it requires a lot of manpower and material resources. Common TFT -LCD defects include point defect, line defect and Mura defect. The water-stains defects are a common Mura defect. This paper presents an efficient algorithm for detecting water defects. The first step is to strengthen the detect features by band-pass filter. Then, Sobel edge detection operator is used to enhance the edge of the abnormal defect. The backlight of the mobile phone screen may not be uniformly distributed, and the enhanced image takes on an irregular texture background, so the screen can be divided into several small blocks. After that, a background assessment is made on each small piece to roughly locate where the defect area is. Finally, to make a second judge on the small pieces of interest, a SVM classifier is trained. Through many tests in the mobile screen production workshop, the accuracy of the algorithm is 95.9%, meeting the requirements of industrial inspection.