1 July 2019 in Pattern Recognition
11 October 2017 in IEEE Transactions on Multimedia
This paper presents an effective method based on Vector Regression and Object oriented Pooling (VROP) for blind image quality assessment (BIQA). Unlike previous models which map the extracted features directly to a quality score, the proposed vector regression framework yields a vector of belief scores for the input image. We explore the uncertainty factors in quality assessment and design the belief scores to measure the confidences of an image to be assigned to the corresponding quality grades. Moreover, we propose an object oriented pooling strategy to further improve the performance by incorporating semantic information of image contents. According to this strategy, regions occupied by objects will be assigned more weights in the pooling phase, leading to a more accurate quality assessment. Extensive experiments on benchmark datasets demonstrate that our approach achieves state-of-the-art performance and shows a great generalization ability.
17 July 2019 in Proceedings of the AAAI Conference on Artificial Intelligence
Opinion-unaware no-reference image quality assessment (NR-IQA) methods have received many interests recently because they do not require images with subjective scores for training. Unfortunately, it is a challenging task, and thus far no opinion-unaware methods have shown consistently better performance than the opinion-aware ones. In this paper, we propose an effective opinion-unaware NR-IQA method based on reinforcement recursive list-wise ranking. We formulate the NR-IQA as a recursive list-wise ranking problem which aims to optimize the whole quality ordering directly. During training, the recursive ranking process can be modeled as a Markov decision process (MDP). The ranking list of images can be constructed by taking a sequence of actions, and each of them refers to selecting an image for a specific position of the ranking list. Reinforcement learning is adopted to train the model parameters, in which no ground-truth quality scores or ranking lists are necessary for learning. Experimental results demonstrate the superior performance of our approach compared with existing opinion-unaware NR-IQA methods. Furthermore, our approach can compete with the most effective opinion-aware methods. It improves the state-of-the-art by over 2% on the CSIQ benchmark and outperforms most compared opinion-aware models on TID2013.
31 July 2026 in SSRN Electronic Journal
Reconstructing geometry, appearance, and motion from videos is a central problem in computer vision and world modeling. In the monocular dynamic setting, this problem is severely ill-posed because the underlying 3D structure and time-varying motion must be inferred from sparse and self-motion views. Mitigating this ill-posedness requires a representation that is both temporally coherent and sufficiently constrained for monocular optimization. We introduce Gaussian Sequences, a framework that converts a monocular video into a temporally coherent sequence of 3D Gaussian primitives for dynamic reconstruction and 3D tracking. At the core of the framework is a global-local SE(3) dynamic field. Global motion patterns provide a compact representation of coherent scene-level dynamics, while local residual motion controllers add bounded corrections for fine non-rigid deformation. To further reduce monocular ambiguity, we leverage foundation-model priors as initialization cues and complementary constraints that guide geometry and motion recovery under weak observations. As an application, Gaussian sequences serve as spatio-temporal observations for differentiable particle simulation, enabling physical parameter identification from monocular videos and action-conditioned dynamics prediction. Experiments on real-world monocular videos show that our Gaussian sequences outperform strong dynamic reconstruction baselines in novel-view synthesis and point tracking. Downstream particle simulation of deformable objects further validates that the reconstructed sequences provide useful information for predictive physical modeling.
6 November 2026 in Information Fusion