Human activity event recognition (HAER) within a residence is a topic of significant interest in the field of ambient assisted living (AAL). Commonly, various sensors are installed within a residence to enable the monitoring of people. This work presents a new approach for HAER within a residence by (re-)using measurements from commercial smart water meters. Our approach is based on the assumption that changes in water flow within a residence, specifically the transition from no flow to flow above a certain threshold, indicate human activity. Using a separate, labeled evaluation data set from three households that was collected under controlled/laboratory-like conditions, we assess the performance of our HAER method. Our results showed that the approach has a high precision (0.86) and recall (1.00). Within this work, we further recorded a new open data set of water consumption data in 17 German households with a median sample rate of Hz to demonstrate that water flow data are sufficient to detect activity events within a regular daily routine. Overall, this article demonstrates that smart water meter data can be effectively used for HAER within a residence.
In this paper, we expand upon our previous research on unsupervised learning algorithms to map the spectral parameters of the Martian surface. Previously, we focused on the VIS-NIR range of hyperspectral data from the CRISM imaging spectrometer instrument onboard NASA’s Mars Reconnaissance Orbiter to relate to other correspondent imager data sources. In this study, we generate spectral cluster maps on a selected CRISM datacube in a NIR range of 1050–2550 nm. This range is suitable for identifying most dominate mineralogy formed in ancient wet environment such as phyllosilicates, pyroxene and smectites. In the machine learning community, the UMAP method for dimensionality reduction has recently gained attention because of its computing efficiency and speed. We apply this algorithm in combination with k-Means to data from Jezero Crater. Such studies of Jezero Crater are of priority to support the planning of the current NASA’s Perseversance rover mission. We compare our results with other methodologies based on a suitable metric and can identify an optimal cluster size of six for the selected datacube. Our proposed approach outperforms comparable methods in efficiency and speed. To show the geological relevance of the different clusters, the so-called “summary products” derived from the hyperspectral data are used to correlate each cluster with its mineralogical properties. We show that clustered regions relate to different mineralogical compositions (e.g., carbonates and pyroxene). Finally the generated spectral cluster map shows a qualitatively strong resemblance with a given manually compositional expert map. As a conclusion, the presented method can be implemented for automated region-based analysis to extend our understanding of Martian geological history.
The reliance on deep learning models for sensor-based material classification amplifies the demand for labeled training data. However, acquiring large-scale, annotated spectral data for applications such as near-infrared (NIR) reflectance spectroscopy in plastic sorting remains a significant challenge due to high acquisition costs and environmental variability. This paper investigates the potential of large language models (LLMs) in synthetic spectral data generation. Specifically, it examines whether LLMs have acquired sufficient implicit knowledge to assist in generating spectral data and introduce meaningful variations that enhance model performance when used for data augmentation. Classification accuracy is reported exclusively as a proxy for structural plausibility of the augmented spectra; maximizing augmentation performance itself is not the study’s goal. From as little as one empirical mean spectrum per class, LLM-guided simulation produced data that enabled up to 86% accuracy, evidence that the generated variation preserves class-distinguishing information. While the approach performs best for spectral distinct polymers, overlapping classes remain challenging. Additionally, the transfer of optimized augmentation parameters to unseen classes indicates potential for generalization across material types. While plastic sorting serves as a case study, the methodology may be applicable to other domains such as agriculture or food quality assessment, where spectral data are limited. The study outlines a novel path toward scalable, AI-supported data augmentation in spectroscopy-based classification systems.
Chemically pure plastic granulate is used as the starting material in the production of plastic parts. Extrusion machines rely on purity, otherwise resources are lost, and waste is produced. To avoid losses, the machines need to analyze the raw material. Spectroscopy in the visible and near-infrared range and machine learning can be used as analyzers. We present an approach using two spectrometers with a spectral range of 400–1700 nm and a fusion model comprising classification, regression, and validation to detect 25 materials and proportions of their binary mixtures. one dimensional convolutional neural network is used for classification and partial least squares regression for the estimation of proportions. The classification is validated by reconstructing the sample spectrum using the component spectra in linear least squares fitting. To save time and effort, the fusion model is trained on semi-empirical spectral data. The component spectra are acquired empirically and the binary mixture spectra are computed as linear combinations. The fusion model achieves very a high accuracy on visible and near-infrared spectral data. Even in a smaller spectral range from 400–1100 nm, the accuracy is high. The visible and near-infrared spectroscopy and the presented fusion model can be used as a concept for building an analyzer. Inexpensive silicon sensor-based spectrometers can be used.
Four-band color imaging of the Martian surface using the Color and Stereo Surface Imaging System (CaSSIS) onboard the European Space Agency’s ExoMars Trace Gas Orbiter exhibits a high color diversity in specific regions. Not only is the correlation of color diversity maps with local morphological properties desirable, but mineralogical interpretation of the observations is also of great interest. The relatively high spatial resolution of CaSSIS data mitigates its low spectral resolution. In this paper, we combine the broad-band imaging of the surface of Mars, acquired by CaSSIS with hyperspectral data from the Compact Reconnaissance Imaging Spectrometer (CRISM) onboard NASA’s Mars Reconnaissance Orbiter to achieve a fusion of both datasets. We achieve this using dimensionality reduction and data clustering of the high dimensional datasets from CRISM. In the presented research, CRISM data from the Coprates Chasma region of Mars are tested with different machine learning methods and compared for robustness. With the help of a suitable metric, the best method is selected and, in a further step, an optimal cluster number is determined. To validate the methods, the so-called “summary products” derived from the hyperspectral data are used to correlate each cluster with its mineralogical properties. We restrict the analysis to the visible range in order to match the generated clusters to the CaSSIS band information in the range of 436–1100 nm. In the machine learning community, the so-called UMAP method for dimensionality reduction has recently gained attention because of its speed compared to the already established t-SNE. The results of this analysis also show that this method in combination with the simple K-Means outperforms comparable methods in its efficiency and speed. The cluster size obtained is between three and six clusters. Correlating the spectral cluster maps with the given summary products from CRISM shows that four bands, and especially the NIR bands and VIS albedo, are sufficient to discriminate most of these clusters. This demonstrates that features in the four-band CaSSIS images can provide robust mineralogical information, despite the limited spectral information using semi-automatic processing.
Spectrometers measure diffuse reflectance and create a “molecular fingerprint” of the material under investigation. Ruggedized, small scale devices for “in-field” use cases exist. Such devices might for example be used by companies in the food supply chain for inward inspection of goods. However, their application for the industrial Internet of Things workflows or scientific research is limited due to their proprietary nature. We propose an open platform for visible and near-infrared technology (OpenVNT), an open platform for capturing, transmitting, and analysing spectral measurements. It is built for use in the field, as it is battery-powered and transmits data wireless. To achieve high accuracy, the OpenVNT instrument contains two spectrometers covering a wavelength range of 400–1700 nm. We conducted a study on white grapes to compare the performance of the OpenVNT instrument against the Felix Instruments F750, an established commercial instrument. Using a refractometer as ground truth, we built and validated models to estimate the Brix value. As a quality measure, we used coefficient of determination of the cross-validation () between the instrument estimation and ground truth. With 0.94 for the OpenVNT and 0.97 for the F750, a comparable was achieved for both instruments. OpenVNT matches the performance of commercially available instruments at one tenth of the price. We provide an open bill of materials, building instructions, firmware, and analysis software to enable research and industrial IOT solutions without the limitations of walled garden platforms.