In this paper, two metrics for measuring image sharpness are presented and used for an autofocus (AF) application. Both measures exploit reorganized discrete cosine transform (DCT) representation. The first metric is a focus measure, which involves optimal high- and middle-frequency coefficients to evaluate relative sharpness. It is robust to noise while remaining sensitive to the best focus position. A psychometric function-based metric is introduced to quantify the focus measure. The second metric is a no-reference blurriness metric, which is used to measure absolute blurriness. It first constructs multiscale DCT edge maps using directional energy information and then determines image blurriness by combining change information in edge structures with image contrast. This metric gives predictions that are closely correlated with subjective perceived scores and shows performance comparable with that of state-of-the-art methods, especially for noisy images. For noisy situations, the two metrics are adjusted adaptively according to the estimated noise level. To prevent the introduction of extra computational load, an efficient noise-level estimation algorithm based on median absolute deviation is presented. This algorithm exploits only the available reorganized DCT coefficients. With the focus and blurriness measures, an AF method for which the two metrics play an important role was developed. Because of their high-quality performance, the realized AF function is able to locate the best focus position swiftly and reliably.
We present a multi-camera based 3D dynamic surface capture solution, which supports high-fidelity generation of 3D dynamic content for various performance scenes. Our system uses a set of RGB cameras to synchronously acquire scene image sequences and performs a processing pipeline to produce 4D videos. We propose a multi-view point cloud reconstruction method which integrates volumetric based guidence and contraint into a coarse-to-fine depth estimation framework. It gives accurate point cloud models and can handle well with the scenes where textureless objects and multiple subjects present. We also present new methods and introduce modifications for several other key computation modules of the processing pipeline, including foreground segmentation, multi-camera calibration, mesh surface reconstruction and registration, texturing, 4D video compression, etc. Experiments on captured scenes show that our system can produce highly accurate and realistic 4D models of the human performances. We develop a 4D video player and toolkit plugins, and demonstrate the use of integrating the 4D content in VR and AR applications.
Object detection in Wide Area Motion Imagery (WAMI) is crucial for large-scale intelligent surveillance and monitoring systems. However, detecting extremely small moving targets in low-frame-rate grayscale WAMI remains highly challenging. In particular, three key problems limit the performance of existing methods: weak motion responses caused by low target contrast can lead to missed detections; densely distributed targets often produce merged responses that are difficult to separate; and registration artifacts, parallax, and dynamic background clutter can generate numerous false alarms. To address these problems, we propose MDF-Det, a coarse-to-fine spatiotemporal framework for WAMI small moving target detection. The framework consists of three complementary components. First, a Motion and Appearance Feature Fusion (MAFF) strategy integrates dense optical-flow-derived motion saliency with grayscale frame differencing to enhance weak target responses and improve candidate preservation. Second, a Spatial Attention-Guided Target Decoupling (SA-TD) module employs fine-grained heatmap decoding and step-threshold degradation to separate merged responses in densely populated scenes. Finally, a Scene-Prior Guided Filtering (SPGF) mechanism learns complementary vehicle-accessibility and motion-activity priors from scene context to suppress contextually implausible false alarms caused by complex background interference. Extensive experiments on six evaluation AOIs of the WPAFB 2009 dataset demonstrate that MDF-Det achieves an average score of 0.878, corresponding to a relative improvement of 5.5% over the strongest baseline.