Successful activity recognition in patients with motor disabilities can improve patient care by informing researchers and clinicians about changes in patient mobility both in the clinic and at home. Standard machine learning approaches can improve activity recognition in patient populations by tailoring recognition models to specific populations. However, many approaches use only static machine learning classifiers, which classify each data sample individually, ignoring the temporal relationship of successive samples over time. Static classification can be augmented by integrating the output of static classifiers with a dynamic state estimation model. Here we use a hidden Markov model (HMM) and apply the static supervised machine learning classifier results as observations. We experimentally validate the effectiveness of our model by recognizing six activities from 13 ambulatory incomplete spinal cord injury subjects who were instructed to perform a standardized set of activities while wearing a waist-worn accelerometer in a clinical setting. Activities included lying, sitting, standing, walking, wheeling, and stair climbing. Using within-subject cross validation, the highest classification accuracy from static classifiers alone was 86.3% (85.5-87.0, 95% confidence). By augmenting the classification model with an HMM, we were able to improve the accuracy to 88.9% (88.2-89.6). The additional 2.6% demonstrated a significant improvement of the classification accuracy using a hybrid static/dynamic classifier compared to the use of static classifiers alone. Such improved activity recognition can provide better outcome measures, aiding clinicians to select or refine the right physical or drug therapies to improve patient mobility.
Large language models (LLMs) and large vision models (LVMs) have driven significant advancements in natural language processing (NLP) and computer vision (CV), establishing a foundation for multimodal large language models (MLLMs) to integrate diverse data types in real-world applications. This survey explores the evolution of MLLMs in radiology, focusing on radiology report generation (RRG) and radiology visual question answering (RVQA), where MLLMs leverage the combined capabilities of LLMs and LVMs to improve clinical efficiency. We begin by tracing the history of radiology and the development of MLLMs, followed by an overview of MLLM applications in RRG and RVQA, detailing core datasets, evaluation metrics, and leading MLLMs that demonstrate their potential in generating radiology reports and answering image-based questions. We then discuss the challenges MLLMs face in radiology, including dataset scarcity, data privacy and security, and issues within MLLMs such as bias, toxicity, hallucinations, catastrophic forgetting, and limitations in traditional evaluation metrics. Finally, this paper proposes future research directions to address these challenges, aiming to help AI researchers and radiologists overcome these obstacles and advance the study of MLLMs in radiology.
Conventional Applicant Tracking Systems (ATSs) encounter considerable constraints in accurately aligning resumes with job descriptions (JD), especially in handling unstructured data and intricate qualifications. We provide Resume2Vec, an innovative method that utilizes transformer-based deep learning models, including encoders (BERT, RoBERTa, and DistilBERT) and decoders (GPT, Gemini, and Llama), to create embeddings for resumes and job descriptions, employing cosine similarity for evaluation. Our methodology integrates quantitative analysis via embedding-based evaluation with qualitative human assessment across several professional fields. Experimental findings indicate that Resume2Vec outperformed conventional ATS systems, achieving enhancements of up to 15.85% in Normalized Discounted Cumulative Gain (nDCG) and 15.94% in Ranked Biased Overlap (RBO) scores, especially within the mechanical engineering and health and fitness domains. Although conventional the ATS exhibited slightly superior nDCG scores in operations management and software testing, Resume2Vec consistently displayed a more robust alignment with human preferences across the majority of domains, as indicated by the RBO metrics. This research demonstrates that Resume2Vec is a powerful and scalable method for matching resumes to job descriptions, effectively overcoming the shortcomings of traditional systems, while preserving a high alignment with human evaluation criteria. The results indicate considerable promise for transformer-based methodologies in enhancing recruiting technology, facilitating more efficient and precise candidate selection procedures.
Parkinson's disease (PD) is one of the most common neurodegenerative disorders, but it is often diagnosed after the majority of dopaminergic cells are already damaged. It is critical to develop biomarkers to identify the disease as early as possible for early intervention. PD patients appear to have an altered pupillary response consistent with an abnormality in photoreceptive retinal ganglion cells. Tracking the pupil size manually is a tedious process and offline automated systems can be prone to errors that may require intervention; for this reason in this work we describe a system for pupil size estimation with a user interface to allow rapid adjustment of parameters and extraction of pupil parameters of interest for the present study. We implemented a user-friendly system designed for clinicians to automate the process of tracking the pupil diameter to measure the post-illumination pupillary response (PIPR), permit manual corrections when needed, and continue automation after correction. Tracking was automated using a Kalman filter estimating the pupil center and diameter over time. The resulting system was tested on a PD classification task in which PD subjects are known to have similar responses for two wavelengths of light. The pupillary response is measured in the contralateral eye to two different light stimuli (470 and 610 nm) for 19 PD and 10 control subjects. The measured Net PIPR indicating different responsiveness to the wavelengths was 0.13 mm for PD subjects and 0.61 mm for control subjects, demonstrating a highly significant difference (p < 0.001). Net PIPR has the potential to be a biomarker for PD, suggesting further study to determine clinical validity.
We report on the first measurement of J/ψ photoproduction from nuclei in the photon energy range of 7 to 10.8 GeV, extending above and below the photoproduction threshold in the free proton of ∼8.2 GeV. The experiment used a tagged photon beam incident on deuterium, helium, and carbon, and the GlueX detector at Jefferson Lab to measure the semi-inclusive A(γ,e^{+}e^{-}p) reaction with a dilepton invariant mass M(e^{+}e^{-})∼m_{J/ψ}=3.1 GeV. The incoherent J/ψ photoproduction cross sections in the measured nuclei are extracted as a function of the incident photon energy, momentum transfer, and proton-reconstructed missing light-cone momentum fraction. Comparisons with theoretical predictions assuming a dipole form factor allow for extracting a gluonic radius for bound protons of sqrt[⟨r^{2}⟩]=0.85±0.14 fm. The data also suggest an excess of the measured cross section for subthreshold production and for interactions with high missing light-cone momentum fraction protons. The measured enhancement can be explained by modified gluon structure for high-virtuality bound protons.
In the evolving field of machine learning, deploying fair and transparent models remains a formidable challenge. This study builds on earlier research, demonstrating that neural architectures exhibit inherent biases by analyzing a broad spectrum of transformer-based language models from base to x-large configurations. This article investigates movie reviews for genre-based bias, which leverages the Word Embedding Association Test (WEAT), revealing that scaling models up tends to mitigate bias, with larger models showing up to a 29% reduction in prejudice. Alternatively, this study also underscores the effectiveness of prompt-based learning, a facet of prompt engineering, as a practical approach to bias mitigation, as this technique reduces genre bias in reviews by more than 37% on average. This suggests that the refinement of development practices should include the strategic use of prompts in shaping model outputs, highlighting the crucial role of ethical AI integration to weave fairness seamlessly into the core functionality of transformer models. Despite the basic nature of the prompts employed in this research, this highlights the possibility of embracing structured prompt engineering to create AI systems that are ethical, equitable, and more responsible for their actions.