Red–Green–Blue–Thermal (RGBT) object detection is critical for robust all-weather perception. However, deploying dual-stream networks on resource-constrained edge devices is severely hindered by insufficiently adaptive multimodal fusion, the loss of small-object features during downsampling, and substantial computational overhead. To address these challenges, we propose GEM-YOLO, a real-time and lightweight RGBT detector. Specifically, an Adaptive Multimodal Gated Fusion Mechanism (GFM) is designed to dynamically calibrate modality weights and suppress noise. Furthermore, Space-to-Depth (SPD) convolutions are integrated into the backbone to achieve lossless downsampling, preventing the feature collapse of small targets. Finally, a lightweight Ghost-Neck is constructed using Ghost modules and GSConv to eliminate computational redundancy. Extensive experiments on the Forward-Looking Infrared (FLIR) and Multi-Modal Multispectral Fusion Dataset (M3FD) datasets demonstrate the effectiveness of the proposed method. With only 7.58 Giga Floating-Point Operations (GFLOPs) and 3.44 million parameters (M), GEM-YOLO reduces the computational cost by 18.6% relative to the dual-stream YOLOv11n baseline. Concurrently, it achieves competitive mean Average Precision at IoU = 0.5 (mAP@50) scores of 82.8% and 69.0% on FLIR and M3FD, respectively, with more evident gains on small-target localization. In practice, GEM-YOLO maintains competitive detection performance while keeping computational overhead low, making it promising for real-time multispectral perception on resource-constrained edge platforms.
In security applications, visible-light pedestrian detectors are highly sensitive to changes in illumination and fail under low-light or nighttime conditions, while infrared sensors, though resilient to lighting, often produce blurred object boundaries that hinder precise localization. To address these complementary limitations, we propose a practical multimodal pipeline—Adaptive Energy–Gradient–Contrast (EGC) Fusion with AIFI-YOLOv12—that first fuses infrared and low-light visible images using per-pixel weights derived from local energy, gradient magnitude and contrast measures, then detects pedestrians with an improved YOLOv12 backbone. The detector integrates an AIFI attention module at high semantic levels, replaces selected modules with A2C2f blocks to enhance cross-channel feature aggregation, and preserves P3–P5 outputs to improve small-object localization. We evaluate the complete pipeline on the LLVIP dataset and report Precision, Recall, mAP@50, mAP@50–95, GFLOPs, FPS and detection time, comparing against YOLOv8, YOLOv10–YOLOv12 baselines (n and s scales). Quantitative and qualitative results show that the proposed fusion restores complementary thermal and visible details and that the AIFI-enhanced detector yields more robust nighttime pedestrian detection while maintaining a competitive computational profile suitable for real-world security deployments.
The optical transition characteristics of fully strained Ge1−xSnx films grown on Ge substrate were investigated by high-resolution X-ray diffraction (HRXRD) and spectroscopic ellipsometry (SE). The results showed Sn composition-dependent nonlinear behaviors in interband transition energies. The influence of strain on nonlinear behaviors was identified by the ratio of bowing parameters. Optical transition energies are largely tuned due to the strain-induced band structure. The strain in GeSn alloys may be responsible for the fluctuation of interband transition energies. The effect of full strain appears to result in an opposite trend in the direct and indirect band gap energies. The transition from indirect-to-direct band gap semiconductor in the present work is determined to be x = 0.103 at 300 K. These results contribute to further exploration into band gap engineering for mid-infrared optoelectronic materials.
Visible–thermal object detection benefits from the complementary properties of RGB and thermal imagery, but repeated cross-modal fusion can increase model complexity, particularly in lightweight detectors. This paper proposes SDR-YOLO, a scale-selective detector designed to make better use of shallow spatial details without adding an extra prediction scale. A P2-guided Cross-modal Detail Enhancement module uses visible and thermal P2 features as auxiliary detail sources and injects the resulting residual into the P3 fused feature. P4 and P5 retain simple concatenation-based fusion, while a Lightweight Shared Convolutional Detection Head reduces redundant prediction parameters across scales. Experiments are conducted on DroneVehicle and M3FD. On DroneVehicle, SDR-YOLO achieves 80.4% mAP@50 and 56.7% mAP@50:95, improving both metrics by 1.0 percentage point over YOLO11s, with 14.06 M parameters and 32.51 GFLOPs; under workstation profiling conditions, it reaches 197.62 ± 1.57 FPS. On M3FD, the model obtains 82.5% mAP@50 and 55.6% mAP@50:95, corresponding to changes of 0.2 and −0.1 percentage points relative to YOLO11s. Since these differences are comparable to the run-to-run variation observed across three training seeds, they are treated as numerical trends rather than statistically established improvements. On the Jetson Orin Nano, TensorRT FP16 deployment achieves 45.78 ± 0.16 FPS, with a latency of 21.84 ± 0.08 ms and peak additional unified-memory usage of 590.4 ± 5.1 MiB, although YOLO11s-RGBT runs faster on this platform. Overall, the proposed design provides a clearer benefit in dense UAV-view scenes while maintaining comparable accuracy and slightly lower model complexity on M3FD, although its runtime efficiency remains hardware-dependent.