Water level data obtained from telemetry stations typically contains large number of outliers. Anomaly detection and a data imputation are necessary steps in a data monitoring system. Anomaly data can be detected if its values lie outside of a normal pattern distribution. We developed a median-based statistical outlier detection approach using a sliding window technique. In order to fill anomalies, various interpolation techniques were considered. Our proposed framework exhibited promising results after evaluating with F1-score and root mean square error (RMSE) based on our artificially induced data points. The present system can also be easily applied to various patterns of hydrological time series with diverse choices of internal methods and fine-tuned parameters. Specifically, the Spline interpolation method yielded a superior performance on non-cyclical data while the long short-term memory (LSTM) outperformed other interpolation methods on a distinct tidal data pattern.
Water level data from telemetry stations typically demonstrate diverse behaviors over time. Specific characteristics can be observed among distinct station groups that are different from others. Clustering time series data into a specified number of groups based on their similarity is an initial step for further analysis in water management analytics. Our main goal in this work is to develop a clustering framework based on a combination of feature representations, feature reduction techniques, as well as clustering algorithms. Thorough experiments on multiple combinations of these methods were conducted and compared. Based on collected water level data in Thailand, UMAP reduced representations of engineered features using HAC clustering with euclidean distance outperformed other methods. Its performance reached 0.8 Fowlkes-Mallows score. Out of 81 stations, only nine unclear cases were incorrectly clustered. Distinct behaviors with abrupt and frequent fluctuations could be perfectly identified.
4 February 2021 in Multimedia Tools and Applications
The conventional evaluation of maize seed vigor is a time-consuming and labor-intensive process. By contrast, this study introduces an automated, nondestructive framework for classifying maize seed vigor with different seed DNA repair capabilities using hyperspectral images. The selection of coated maize seeds for our case study also aligned well with practical applications. To ensure the accuracy and reliability of the results, rigorous data preprocessing steps were implemented to extract high-quality information from raw spectral data obtained from the hyperspectral images. In particular, commonly used pretreatment methods were explored. Instead of analyzing all the wavelengths of spectral data, a competitive adaptive reweighted sampling method was used to select more informative wavelengths, optimizing analysis efficiency. Furthermore, this study leveraged machine learning models, enriched through oversampling techniques to address data imbalance at the seed level. The results obtained using a support vector machine with enhanced techniques demonstrated promising results with 100% sensitivity, 96.91% specificity, and a 0.9807 Matthews correlation coefficient (MCC). Thus, this study highlighted the effectiveness of hyperspectral imaging and machine learning in modern seed assessment practices. By introducing a seed vigor classification system that can even accommodate coated seeds, this study offers a potential pathway for empowering seed producers in practical, real-world applications.