Task-conditional architecture offers advantage in parameter efficiency but falls short in performance compared to state-of-the-art multi-decoder methods. How to trade off performance and model parameters is an important and difficult problem. In this paper, we introduce a simple and lightweight task-conditional model called Prompt Guided Transformer (PGT) to optimize this challenge. Our approach designs a Prompt-conditioned Transformer block, which incorporates task-specific prompts in the self-attention mechanism to achieve global dependency modeling and parameter-efficient feature adaptation across multiple tasks. This block is integrated into both the shared encoder and decoder, enhancing the capture of intra- and inter-task features. Moreover, we design a lightweight decoder to further reduce parameter usage, which accounts for only 2.7% of the total model parameters. Extensive experiments on two multi-task dense prediction benchmarks, PASCAL-Context and NYUD-v2, demonstrate that our approach achieves state-of-the-art results among task-conditional methods while using fewer parameters, and maintains a significant balance between performance and parameter size.

In the Industrial Internet of Things (IIoT), cross-silo federated learning (CSFL) enables entities, such as manufacturers and suppliers to train global models for optimizing production processes while ensuring data privacy. A well-designed incentive mechanism is essential to persuade clients to contribute data resources. However, existing methodologies overlook the dynamic nature of the training process, where the accuracy of the globally trained model and the client’s data ownership change over time. Furthermore, the majority of previous research assumes a defined functional relationship between the data contribution and the model accuracy, which is infeasible in realistic and dynamic training environments. To address these challenges, we design a novel adaptive mechanism for CSFL that inspires organizations to contribute data resources in a dynamic training environment with the aim of maximizing their long-term payoffs. This mechanism leverages multiagent reinforcement learning (MARL) to ascertain near-optimal data contribution strategies from potential game histories without necessitating private organizational information or a precise accuracy function. Experimental results indicate that our mechanism achieves adaptive incentive in dynamic environments and effectively enhances the long-term payoffs of organizations.

Gynecological malignancies, particularly lymph node metastasis, have presented a diagnostic challenge, even with traditional imaging techniques such as CT, MRI, and PET/CT. This study was conceived to explore and, subsequently, to bridge this diagnostic gap through a more holistic and innovative approach. By developing a comprehensive framework that integrates both non-image data and detailed MRI image analyses, this study harnessed the capabilities of a multimodal federated-learning model. Employing a composite neural network within a federated-learning environment, this study adeptly merged diverse data sources to enhance prediction accuracy. This was further complemented by a sophisticated deep convolutional neural network with an enhanced U-NET architecture for meticulous MRI image processing. Traditional imaging yielded sensitivities ranging from 32.63% to 57.69%. In contrast, the federated-learning model, without incorporating image data, achieved an impressive sensitivity of approximately 0.9231, which soared to 0.9412 with the integration of MRI data. Such advancements underscore the significant potential of this approach, suggesting that federated learning, especially when combined with MRI assessment data, can revolutionize lymph-node-metastasis detection in gynecological malignancies. This paves the way for more precise patient care, potentially transforming the current diagnostic paradigm and resulting in improved patient outcomes.

In this paper, we address the challenge of Multi-Object Tracking (MOT) in moving Unmanned Aerial Vehicle (UAV) scenarios, where irregular flight trajectories, such as hovering, turning left/right, and moving up/down, lead to significantly greater complexity compared to fixed-camera MOT. Specifically, changes in the scene background not only render traditional frame-to-frame object IoU association methods ineffective but also introduce significant view shifts in the objects, which complicates tracking. To overcome these issues, we propose a novel HomView-MOT framework, which for the first time, harnesses the view homography inherent in changing scenes to solve MOT challenges in moving environments, incorporating homographic matching and view-centric concepts. We introduce a Fast Homography Estimation (FHE) algorithm for rapid computation of homography matrices between video frames, enabling object View-Centric ID Learning (VCIL) and leveraging multi-view homography to learn cross-view ID features. Concurrently, our Homographic Matching Filter (HMF) maps object bounding boxes from different frames onto a common view plane for a more realistic physical IoU association. Extensive experiments have proven that these innovations allow HomView-MOT to achieve state-of-the-art performance on prominent UAV MOT datasets VisDrone and UAVDT.

Detection of human body and its parts has been intensively studied. However, most of CNNs-based detectors are trained independently, making it difficult to associate detected parts with body. In this paper, we focus on the joint detection of human body and its parts. Specifically, we propose a novel extended object representation integrating center-offsets of body parts, and construct an end-to-end generic Body-Part Joint Detector (BPJDet). In this way, body-part associations are neatly embedded in a unified representation containing both semantic and geometric contents. Therefore, we can optimize multi-loss to tackle multi-tasks synergistically. Moreover, this representation is suitable for anchor-based and anchor-free detectors. BPJDet does not suffer from error-prone post matching, and keeps a better trade-off between speed and accuracy. Furthermore, BPJDet can be generalized to detect body-part or body-parts of either human or quadruped animals. To verify the superiority of BPJDet, we conduct experiments on datasets of body-part (CityPersons, CrowdHuman and BodyHands) and body-parts (COCOHumanParts and Animals5C). While keeping high detection accuracy, BPJDet achieves state-of-the-art association performance on all datasets. Besides, we show benefits of advanced body-part association capability by improving performance of two representative downstream applications: accurate crowd head detection and hand contact estimation. Project is available in https://hnuzhy.github.io/projects/BPJDet .