Autonomous systems are expanding rapidly, driving a demand for robust perception technologies capable of navigating challenging, unstructured environments. While urban autonomy has made significant progress, off-road environments pose unique challenges, including dynamic terrain and limited communication infrastructure. This research addresses these challenges by introducing a novel three-part solution for off-road autonomous vehicles. First, we present a large-scale off-road dataset curated to capture the visual complexity and variability of unstructured environments, providing a realistic training ground that supports improved model generalization. Second, we propose a Confusion-Aware Loss (CAL) that dynamically penalizes systematic misclassifications based on class-level confusion statistics. When combined with cross-entropy, CAL improves segmentation mean Intersection over Union (mIoU) on the off-road test set from 68.66% to 70.06% and achieves cross-domain gains of up to ~0.49% mIoU on the Cityscapes dataset. Third, leveraging semantic segmentation as an intermediate representation, we introduce a spatial overlay video encoding scheme that preserves high-fidelity RGB information in semantically critical regions while compressing non-essential background regions. Experimental results demonstrate Peak Signal-to-Noise Ratio (PSNR) improvements of up to +5 dB and Video Multi-Method Assessment Fusion (VMAF) gains of up to +40 points under lossy compression, enabling efficient and reliable off-road autonomous operation. This integrated approach provides a robust framework for real-time remote operation in bandwidth-constrained environments.
Rapid and reliable assessment of structural damage following disasters is critical for prioritizing rescue operations. In this study, we present a unified deep learning framework for building damage assessment from satellite imagery. The proposed approach integrates segmentation-driven feature construction, morphological processing, cost-sensitive learning, and cross-disaster evaluation to support robust performance under limited and imbalanced data conditions. The framework combines an adapted U-Net for building localization with a hybrid convolutional neural network (CNN)-deep neural network (DNN) classifier for damage-level prediction and evaluates transferability across disaster events, geographic regions, and sensing conditions. The proposed method is evaluated on selected events from the xView2 Building Damage Assessment (xBD) and BRIGHT datasets, using optical imagery from xBD and pre-disaster optical and post-disaster Synthetic Aperture Radar (SAR) imagery from BRIGHT. Despite the limited and highly imbalanced event-specific samples, the framework achieves a mean cross-validation macro-F1 score of 70% and a maximum fold-level score of 77% on the Mexico earthquake subset of xBD and up to 98% on earthquake-related events in BRIGHT. Cross-validation characterizes performance variability across source-image-grouped data partitions, while cross-disaster evaluation reveals event-dependent transferability and provides a preliminary indication that structural domain similarity may be related to transfer performance. Although the evaluation is constrained by data availability, the results indicate that lightweight, cost-sensitive deep learning frameworks may support auxiliary post-disaster screening and decision support in resource-constrained scenarios. This study highlights both the potential and the remaining challenges of deploying artificial intelligence (AI) for rapid post-disaster assessment.
Rapid and reliable assessment of structural damage following disasters is critical for prioritizing rescue operations. In this study, we present a unified deep learning framework for building damage assessment from satellite imagery. The proposed approach integrates segmentation-driven feature construction, morphological processing, cost-sensitive learning, and Cross-Disaster strategies to enable robust performance under limited and imbalanced data conditions. Our approach combines an adapted U-Net for building segmentation with a hybrid CNN-DNN classifier for damage evaluation, and incorporates cross-learning to assess generalization across different disasters and imaging conditions.We evaluate our method on the xBD and BRIGHT datasets, leveraging both pre-disaster optical and post-disaster SAR imagery. Despite extremely limited and imbalanced samples, our framework achieves competitive performance, with a macro F1-score of 70\% on the Mexico earthquake (xBD) and up to 98\% on earthquake cases in BRIGHT. Cross-validation and cross-disaster transfer learning further demonstrate the model’s generalizability and resilience, highlighting its potential for aiding real-time disaster response.Although constrained by data availability, our results indicate that lightweight, cost-aware deep learning models can provide actionable insights for resource-constrained rescue operations. This work highlights both the promise and the challenges of deploying AI for real-time disaster response.