19 July 2023 in Applied Intelligence
27 December 2023 in IEEE Sensors Journal
Existing stereo matching networks with high accuracy generally demand high computational overhead, making them expensive to deploy and unsuitable for many real-time applications, especially on source-constrained hardware platforms. Some recent works have tried to build lightweight stereo matching networks, but their accuracy and inference speed is far from satisfactory when deployed on source-constrained GPUs. This paper aims to build a lightweight stereo matching network with high accuracy. First, we claim that a reasonable disparity upsampling strategy is crucial for lightweight stereo matching to achieve high accuracy, whose importance is underestimated in existing works. Accordingly, an efficient and effective disparity upsampling strategy named Spatial Adaptive Disparity Shuffle (SADS) is proposed to meet the upsampling requirements of disparities within diverse regions. Second, a novel Channel-Disparity-Mixed Attention (CDMA) mechanism is proposed to regularize the high-resolution 4D compact cost volume. The attention values in CDMA are adaptive across channels, pixels and disparity candidates, making CDMA suitable for regularizing the compact cost volume. Based on the proposed methods, a lightweight stereo matching network (SADSNet) is designed that achieves real-time performance with high accuracy on source-limited hardware platforms (e.g., the NVIDIA Jetson TX2). In addition, SADSNet can be easily scaled up or down to suit different application scenarios according to available computational power. Extensive experimental results on multiple datasets show its clear superiority over SOTA lightweight stereo models and even many large accuracy-oriented models.
25 May 2024 in Expert Systems with Applications
11 March 2026 in Pattern Recognition