3 March 2025 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Human Activity Recognition (HAR) faces significant challenges when deployed in real-world scenarios due to non-independent and identically distributed (non-IID) data distributions. While existing domain adaptation (DA) approaches attempt to address this issue, they either require access to source data or struggle with large domain shifts. This paper presents a novel source-free domain adaptation framework for HAR that effectively handles substantial domain discrepancies across different datasets. Our approach introduces two key innovations: (1) a Discriminative Information Gramian (DIG) method that quantifies the relationship between target-domain samples and the source domain without requiring access to source data, and (2) an unsupervised domain generalization technique that ensures consistent feature extraction across augmented data samples, enhancing the model's effectiveness in the target domain. We evaluate our framework on five diverse HAR datasets comprising 87 users with varying demographics, devices, and environmental conditions. In single-source scenarios, our method achieves 76.77% accuracy and 67.03% F1-score, surpassing state-of-the-art solutions by 9.77% and 17.43%, respectively. For multi-source scenarios, we attain 85.33% accuracy and 79.55% F1-score, exceeding existing methods by at least 8.8% and 14.8%, respectively. This work represents the first successful attempt at dataset-level HAR domain adaptation without access to source data, marking a significant advancement in practical HAR applications.
3 September 2025 in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Developing an accessible fruit sugar content detection system for average users, particularly diabetic patients, is essential. Current fruit sugar detection solutions often fail to balance ease of use with high accuracy. In this study, we introduce FruitPhone, an innovative smartphone-based spectral imaging system that provides quantitative assessments of fruit sugar content. To enable the smartphone to capture the fine-grained spectral features necessary for accurate sugar content analysis, FruitPhone utilizes the smartphone screen to simulate multiple monochromatic light sources. This approach allows for the collection of spectral data that extends beyond the standard three-channel RGB format. To address the discrepancies between screen-generated and true monochromatic light, we propose a two-stage spectral reconstruction algorithm that translates the smartphone's pseudo-spectral data into real multi-spectral images for further analysis. Additionally, we tackle environmental variability by employing a black screen light for reference data collection, which helps mitigate ambient influences and enhance consistency. We also introduce a detrending algorithm for high-dimensional spectral images to correct spatial inconsistencies while preserving spectral trends. We evaluate FruitPhone using 335 spectral images from 37 different fruit types, achieving a normalized mean-absolute error of 8.48% °Bx, which is comparable to that of a laboratory spectral system and demonstrates a 19.98% reduction in reconstruction errors, along with a 45.58% R2 improvement over baseline schemes.
20 October 2025 in IEEE Transactions on Mobile Computing
Meat adulteration is a significant problem that can pose health risks economic losses to consumers. Current detection methods are hindered by high costs, limited capabilities, or time-consuming sample preparation, making them only accessible in laboratory tests and can not protect the safety of end-users. This paper introduces MeatSpec, a low-cost and user-friendly system for detecting meat adulteration using spectral imaging, to move the adulteration inspection out of laboratories. MeatSpec employs a multispectral camera to reduce costs while quickly capturing spectral images, but this leads to a decrease in spectral resolution and coverage. To solve this challenge, the system uses spectral reconstruction technology and innovative designs tailored for meat adulteration detection. This includes involving adulteration-related prior information during the reconstruction training phase and incorporating contrastive learning to enlarge the distances among reconstructed samples belonging to various adulteration types. Additionally, we devise distinct feature extractors for different bands based on characteristics of the reconstructed spectra and employ knowledge distillation to mitigate error in full-band reconstructed spectra while capturing features related to adulteration. Further, we extend our system to MeatSpec-G to improve its generalizability to varied adulteration conditions and unknown adulterants. To achieve this, we first propose a feature alignment-based training scheme to reduce the feature gap among samples of diverse concentrations and admixture patterns. Then, we propose a cascaded open-set recognition framework that decouples uncertainty quantification and anomaly feature discrimination, to address the limitations of softmax confidence in detecting distribution shifts and reconstruction artifacts. Experimental evaluations on 347 paired spectral images demonstrate that our system achieves a 91.06% accuracy in detecting multiple adulteration types, merely 7.78% inferior to the expensive professional solution, yet 21.58% superior to the baseline at the same price point. Moreover, our system can generalize to achieve an 88.89% detection accuracy in unknown adulteration conditions with a 27.78% improvement, and an 83.33% detection accuracy for unknown adulterants.
20 June 2025 in IEEE Transactions on Mobile Computing
Monitoring sashimi freshness, i.e., histamine levels, in showcases poses a critical challenge for sushi restaurants and fresh food stores. Current histamine monitoring methods involve labor-intensive chemical experiments or expensive devices, making affordable on-site monitoring difficult. This paper proposes FreshSpec, a low-cost and automatic spectral imaging system capable of precisely monitoring histamine levels in sashimi with minimal human intervention. The low concentration of histamine, combined with the potential for other ingredients to mask its spectral characteristics, complicates precise histamine level predictions using coarse or redundant spectral data from low-cost devices. To address this issue, FreshSpec employs an innovative feature-wise spectral reconstruction (SR) framework that effectively eliminates irrelevant and redundant data while preserving critical histamine-related spectral features. Specifically, we redefine the SR reconstruction target by utilizing features derived from the encoder of the spectral foundation model that is enhanced to focus on histamine-related spectral features. Furthermore, inspired by the monotonic accumulation properties of histamine over time, we propose a histamine regression model with unsupervised continual adaptation to new sashimi samples during practical deployment. Experimental results from 240 samples of salmon, tuna, and snapper demonstrate that FreshSpec achieves an R2 of 0.9319 and an RMSE of 3.101 mg/100 g, comparable to laboratory spectral imaging systems, while outperforming baseline schemes with a 46.95% RMSE reduction and a 0.1631 R2 improvement.