In this paper, we present EC-WAMI, the first successful application of neuromorphic event cameras (ECs) for Wide-Area Motion Imagery (WAMI) and Remote Sensing (RS), showcasing their potential for advancing Structure-from-Motion (SfM) and 3D reconstruction across diverse imaging scenarios. ECs, which detect asynchronous pixel-level brightness changes, offer key advantages over traditional frame-based sensors such as high temporal resolution, low power consumption, and resilience to dynamic lighting. These capabilities allow ECs to overcome challenges such as glare, uneven lighting, and low-light conditions that are common in aerial imaging and remote sensing, while also extending UAV flight endurance. To evaluate the effectiveness of ECs in WAMI, we simulate event data from RGB WAMI imagery and integrate them into SfM pipelines for camera pose optimization and 3D point cloud generation. Using two state-of-the-art SfM methods, namely, COLMAP and Bundle Adjustment for Sequential Imagery (BA4S), we show that although ECs do not capture scene content like traditional cameras, their spike-based events, which only measure illumination changes, allow for accurate camera pose recovery in WAMI scenarios even in low-framerate(5 fps) simulations. Our results indicate that while BA4S and COLMAP provide comparable accuracy, BA4S significantly outperforms COLMAP in terms of speed. Moreover, we evaluate different feature extraction methods, showing that the deep learning-based LIGHTGLUE descriptor consistently outperforms traditional handcrafted descriptors by providing improved reliability and accuracy of event-based SfM. These results highlight the broader potential of ECs in remote sensing, aerial imaging, and 3D reconstruction beyond conventional WAMI applications. Our dataset will be made available for public use.
The accuracy of machine learning models in plant disease detection significantly relies on large volumes of knowledge-based labeled data; the acquisition of annotation remains a significant bottleneck in domain-specific research such as plant disease detection. While unsupervised learning alleviates the need for labeled data, its effectiveness is constrained by the intrinsic separability of feature clusters. These limitations underscore the need for approaches that enable supervised early disease detection without extensive annotation. To this end, we propose a self-supervised learning (SSL) framework for the early detection of soybean’s sudden death syndrome (SDS) using hyperspectral data acquired from an unmanned aerial vehicle (UAV). The methodology employs a novel distance-based spectral pairing technique that derives intermediate labels directly from the data. In addition, we introduce an adapted contrastive loss function designed to improve cluster separability and reinforce discriminative feature learning. The proposed approach yields an 11% accuracy gain over agglomerative hierarchical clustering and attains both classification accuracy and F1 score of 0.92, matching supervised baselines. Reflectance frequency analysis further demonstrates robustness to label noise, highlighting its suitability in label-scarce settings.
Multi-sensor networks provide complementary information for various taskslike object detection, movement analysis and tracking. One of the important ingredientsfor efficient multi-sensor network actualization is the optimal configuration of sensors.In this work, we consider the problem of optimal configuration of a network of coupledcamera-inertial sensors for 3D data registration and reconstruction to determine humanmovement analysis. For this purpose, we utilize a genetic algorithm (GA) based optimizationwhich involves geometric visibility constraints. Our approach obtains optimal configurationmaximizing visibility in smart sensor networks, and we provide a systematic study usingedge visibility criteria, a GA for optimal placement, and extension from 2D to 3D.Experimental results on both simulated data and real camera-inertial fused data indicate weobtain promising results. The method is scalable and can also be applied to other smartnetwork of sensors. We provide an application in distributed coupled video-inertial sensorbased 3D reconstruction for human movement analysis in real time.
Multi-modal systems extract information about the environment using specialized sensors that are optimized based on the wavelength of the phenomenology and material interactions. To maximize the entropy, complementary systems operating in regions of non-overlapping wavelengths are optimal. VIS-IR (Visible-Infrared) systems have been at the forefront of multi-modal fusion research and are used extensively to represent information in all-day all-weather applications. Prior to image fusion, the image pairs have to be properly registered and mapped to a common resolution palette. However, due to differences in the device physics of image capture, information from VIS-IR sensors cannot be directly correlated, which is a major bottleneck for this area of research. In the absence of camera metadata, image registration is performed manually, which is not practical for large datasets. Most of the work published in this area assumes calibrated sensors and the availability of camera metadata providing registered image pairs, which limits the generalization capability of these systems. In this work, we propose a novel end-to-end pipeline termed DeepFusion for image registration and fusion. Firstly, we design a recursive crop and scale wavelet spectral decomposition (WSD) algorithm for automatically extracting the patch of visible data representing the thermal information. After data extraction, both the images are registered to a common resolution palette and forwarded to the DNN for image fusion. The fusion performance of the proposed pipeline is compared and quantified with state-of-the-art classical and DNN architectures for open-source and custom datasets demonstrating the efficacy of the pipeline. Furthermore, we also propose a novel keypoint-based metric for quantifying the quality of fused output.