We present two simple approaches to calibrate a stereo camera setup with heterogeneous lenses: a wide-angle fish-eye lens and a narrow-angle lens in left and right sides, respectively. Instead of using a conventional black-white checkerboard pattern, we design an embedded checkerboard pattern by combining two differently colored patterns. In both approaches, we split the captured stereo images into RGB channels and extract R and inverted G channels from left and right camera images, respectively. In our first approach, we consider the checkerboard pattern as the world coordinate system and calculate left and right transformation matrices corresponding to it. We use these two transformation matrices to estimate the relative pose of the right camera by multiplying the inversed left transformation with the right. In the second approach, we calculate a planar homography transformation to identify common object points in left-right image pairs and treat them with the well-known Zhangs camera calibration method. We analyze the robustness of these two approaches by comparing reprojection errors and image rectification results. Experimental results show that the second method is more accurate than the first one.
This paper presents an improved dense disparity estimating technique for a collection of multi-baseline stereo (referred to as MBS in the text) images. The flow of the proposed system consists of two main frameworks: a preliminary cost calculation and initial disparity estimating framework, and an iterative cost refinement framework. The first framework implements an accurate multi-baseline stereo cost (referred to as MBSC in the text) calculation method, and a scan line optimization inspired by the Semi Global Matching (SGM) algorithm. Cost volumes of each two-view camera pair are calculated by fusing two pixel dissimilarity measures: i) weighted Census transformation and ii) sum of absolute difference color consistency term (SAD-Census). The initial disparity map between reference and the matching view with the largest baseline displacement is calculated by summing-and-interpolating SAD-Census costs of the current and all neighboring camera pairs in-between, and taking the minimum after aggregating for sixteen directions. The second framework refines the aggregated MBSC volume recursively. In each iteration, individual pair-wise disparity maps are used to warp matching views towards the reference to create binary masks that resemble overlapping differences. White locations in the mask represent incorrect correspondence matches, thus a penalty is added for costs associated with, adapting a Gaussian modulating function. This significantly reduces the selection probability of incorrect disparity minima in proceeding iterations. A Guided filter-based Rolling Guidance filter is applied to further up-vote the probability of pixels with the lowest costs, which are similar or close enough to ground truth readings. Through experimental results evaluated on the Middlebury dataset, we show that our method leads to effective and efficient multibaseline disparity estimations.
Modern developments of gamma-ray imagers by integrating multi-contextual sensors and advanced computer vision theories have enabled unprecedented capabilities in detection and imaging, reconstruction and mapping of radioactive sources. Notwithstanding these remarkable capabilities, the addition of multiple sensors such as light detection and ranging units (LiDAR), RGB-D sensors (Microsoft Kinect), inertial measurement units (IMU) are mostly expensive. Instead of using such expensive sensors, we, in this paper, introduce a modest three dimensional (3D) gamma-ray imaging method by exploiting the advancements in modern stereo vision technologies. A stereo line equation model is proposed to properly identify the distribution area of gamma-ray intensities that are used for two dimensional (2D) visualizations. Scene data information of the surrounding environment captured at different locations are reconstructed by re-projecting disparity images created with the Semi-Global Matching algorithm (SGM) and are merged together by employing the point-to-point Iterative Closest Point algorithm (ICP). Instead of superimposing/overlaying 2D radioisotopes on the merged scene area, reconstructions of 2D gamma images are fused together with it to create a detailed 3D volume. Through experimental results, we try to emphasize the accuracy of our proposed fusion method.