5 March 2022 in Computers in Biology and Medicine
29 March 2022 in Computers in Biology and Medicine
29 January 2024 in IEEE Transactions on Geoscience and Remote Sensing
With the prosperity of deep learning techniques, salient object detection in remote sensing images (RSI-SOD) is concomitantly in full flourishing. However, due to the inherent challenges such as uncertainty in object quantities and scales, cluttered backgrounds, and blurred edges arising from shadows, most current approaches struggle for salient feature learning with the aid of heavy model architecture, yet often result in barely satisfactory performance. Some methods compromise model complexity to improve efficiency, albeit with significantly degraded results. To earn a satisfactory balance of efficacy and efficiency, we propose a new network for RSI-SOD, namely SFANet, based on progressive semantic flow and uncertainty-aware refinement. Specifically, we design a global semantic enhancement block (GSEB) to reduce background interference and accurately localize salient objects of varying quantities and scales, which further consists of three modularized components, i.e., semantic extraction module (SEM), interscale fusion module (IFM), and deep semantic graph-inference module (DSGM). SEM together with IFM contributes to the effective aggregation of multi-scale contexts by extracting fused and progressive semantic cues. DSGM performs semantic inference to better localize salient objects with irregularities in scale and topological structure. Furthermore, we present an uncertainty-aware refinement module (URM) to recognize salient objects in cluttered backgrounds and effectively suppress shadows. Extensive experiments are conducted on three RSI-SOD datasets, from which superior results can be achieved by our SFANet, outperforming the other cutting-edge methods. The code is available at https://github.com/ZhengJianwei2/SFANet.
9 March 2016 in IEEE Transactions on Circuits and Systems for Video Technology
A better understanding of human interactions in videos can be achieved by simultaneously considering the coarse interactions between people, the action of each individual, and the activity of all people as a whole. We divide the recognition task into two stages. The first stage discriminates interactions and noninteractions, actions and activities based on local image information, while during the second stage, actions and activities are recognized in a global manner based on the local recognition results. A conditional random field (CRF) is designed to model human interactions in the spatio-temporal space. Different from most existing global models which cover either action or activity variables only, our model covers them both by considering the interactions between different types of variables. The graph structure of the CRF is predicted by a model learned from training data, which is different from traditional graph construction methods that typically rely on human heuristics. We learn the parameters of the CRF via structured support vector machine. We propose an efficient inference algorithm to tackle the estimation of labels in long videos containing many people. Our model admits both semantic-level understanding of human interactions in videos and competitive action and activity recognition performance.