Text-based person search aims at retrieving the target person in an image gallery using a descriptive sentence of that person. The core of this task is to calculate a similarity score between the pedestrian image and description, which requires inferring the complex latent correspondence between image sub-regions and textual phrases at different scales. Transformer is an intuitive way to model the complex alignment by its self-attention mechanism. Most previous Transformer-based methods simply concatenate image region features and text features as input and learn a cross-modal representation in a brute force manner. Such weakly supervised learning approaches fail to explicitly build alignment between image region features and text features, causing an inferior feature distribution. In this paper, we present CFLT, Conditional Feature Learning based Transformer. It maps the sub-regions and phrases into a unified latent space and explicitly aligns them by constructing conditional embeddings where the feature of data from one modality is dynamically adjusted based on the data from the other modality. The output of our CFLT is a set of similarity scores for each sub-region or phrase rather than a cross-modal representation. Furthermore, we propose a simple and effective multi-modal re-ranking method named Re-ranking scheme by Visual Conditional Feature (RVCF). Benefit from the visual conditional feature and better feature distribution in our CFLT, the proposed RVCF achieves significant performance improvement. Experimental results show that our CFLT outperforms the state-of-the-art methods by 7.03% in terms of top-1 accuracy and 5.01% in terms of top-5 accuracy on the text-based person search dataset.
13 August 2021 in IEEE Geoscience and Remote Sensing Letters
Air pollution is a societal and cross-boundary environmental problem that can be visualized using a satellite. Satellite imaging is not only useful to the home country but also to the neighboring countries. Moreover, monitoring the movement of air pollution can help susceptible people avoid acid rain and photochemical smog. Using advanced remote sensing (RS) images, substantial information can be obtained, which can produce numerous effective methods for visualizing air pollution. In this article, a novel method for extracting air pollution has been proposed; it applies various pipeline networks along with a focus area method to exploit the spectral aspect information. Afterward, three indices with numerous modified fully convolutional networks (FCNs) were extracted. Then, by employing a multivote module, visualized air pollution can be presented. In the conducted experiments, five-year Himawari-8 satellite images have been utilized in the North-East Asia area to validate the frameworks. Furthermore, the experimental result indicating that the given methods could effectively visualize air pollution. Source code and data sets are available at https://github.com/ark1234/Himawari-8-based-visualized-understanding.
4 December 2024 in IEEE Transactions on Pattern Analysis and Machine Intelligence
Iterative methods such as iterative closest point (ICP) for point cloud registration often suffer from bad local optimality ( e.g. saddle points), due to the nature of nonconvex optimization. To address this fundamental challenge, in this paper we propose learning to form the loss landscape of a deep iterative method w.r.t. predictions at test time into a convex- like shape locally around each ground truth given data, namely Deep Loss Convexification (DLC) , thanks to the overparametrization in neural networks. To this end, we formulate our learning objective based on adversarial training by manipulating the ground-truth predictions, rather than input data. In particular, we propose using star-convexity, a family of structured nonconvex functions that are unimodal on all lines that pass through a global minimizer, as our geometric constraint for reshaping loss landscapes, leading to (1) extra novel hinge losses appended to the original loss and (2) near-optimal predictions. We demonstrate the state-of-the-art performance using DLC with existing network architectures for the tasks of training recurrent neural networks (RNNs), 3D point cloud registration, and multimodel image alignment.
AI systems increasingly produce fluent, correct, end-to-end outcomes. Over time, this erodes users' ability to explain, verify, or intervene. We define this divergence as the Capability-Comprehension Gap: a decoupling where assisted performance improves while users' internal models deteriorate. This paper argues that prevailing approaches to transparency, user control, literacy, and governance do not define the foundational understanding humans must retain for oversight under sustained AI delegation. To formalize this, we define the Cognitive Integrity Threshold (CIT) as the minimum comprehension required to preserve oversight, autonomy, and accountable participation under AI assistance. CIT does not require full reasoning reconstruction, nor does it constrain automation. It identifies the threshold beyond which oversight becomes procedural and contestability fails. We operatinalize CIT through three functional dimensions: (i) verification capacity, (ii) comprehension-preserving interaction, and (iii) institutional scaffolds for governance. This motivates a design and governance agenda that aligns human-AI interaction with cognitive sustainability in responsibility-critical settings.
Clinical large language model (LLM) agents are increasingly engineered as systems that combine a language model backbone with memory, tools, orchestration loops, and feedback mechanisms. In this setting, the key engineering question is no longer only what the backbone model can answer, but how the surrounding harness stores experience, retrieves context, orchestrates tools, and converts feedback into reusable knowledge. Existing reviews of LLM agents in healthcare primarily emphasise prompting strategies, task capabilities, and benchmark performance, leaving these harness-level mechanisms insufficiently synthesised. This review addresses that gap by organising the emerging literature under the term Self-Evolving Agent Engineering (SEAE), defined here as a harness-level design paradigm centred on three recurring mechanisms: persistent cross-session memory, autonomous skill or experience synthesis, and closed-loop feedback-driven improvement. We review 148 references and 23 representative clinical systems across six task categories, using radiology as the main translational focus. Rather than treating these systems as isolated applications, we map how persistent memory, skill synthesis, tool orchestration, and feedback-driven improvement are implemented across current healthcare agents, and examine the technical, clinical, and regulatory challenges that arise when clinical agents are designed to evolve across sessions.