3 July 2024 in IEEE Transactions on AgriFood Electronics
Agriculture is facing bigger challenges in the 21st century due to the scarcity of resources. Artificial intelligence is being integrated with agriculture to cater to people's needs, unlocking fresh avenues for sustainability and innovation. One of the crucial agricultural practices is plant growth monitoring to detect plant stress at an early stage. In the past, there have been preliminary attempts at plant growth monitoring using red–green–blue (RGB) and depth images. The major challenge of this approach is the unavailability of the depth camera at the farmers' end. In this work, we have developed a transformer-based plant age RGB-depth fusion knowledge distillation network (PA-RDFKNet), a multi-to-single modal teacher–student network, that exploits the combined knowledge of RGB-depth pairs at the training time to infer the growth using RGB images alone during test time. The model uses a distillation loss that combines response-based, feature-based, and relation-based knowledge distillation techniques in the offline scheme. The proposed knowledge distillation improves the mean squared error for RGB images from 2 to 0.14 weeks. The results are validated on three different datasets.
12 June 2026 in ACM Transactions on Multimedia Computing, Communications, and Applications
User-generated content (UGC) videos recorded in uncontrolled environments often exhibit blur, camera shake, lighting fluctuations, and large viewpoint differences, making it difficult to organize multiple recordings of the same event. This work proposes an integrated pipeline that groups UGC videos into coherent events and sub-events by combining distortion-aware keyframe selection, adaptive audio–visual fusion, and confidence-weighted graph construction. The method first filters and clusters segment-level representations to obtain reliable keyframes, then fuses audio and visual cues through a lightweight gating module to produce robust multimodal descriptors. These descriptors populate a similarity graph whose strong and weak edges reveal sub-event and event structure without requiring shot boundaries or manual segmentation. Although distortion modeling, keyframe extraction, and multimodal similarity have been studied separately, existing approaches do not integrate them for hierarchical UGC video grouping. Experiments on the JIKU dataset and a curated YouTube dataset show consistent improvements in fidelity, diversity, and clustering metrics, demonstrating the applicability of the approach to video summarization, multi-view organization, and other UGC analysis tasks.
15 July 2026 in Knowledge and Information Systems