Person re-identification is a problem of identifying individuals across non-overlapping cameras. Although remarkable progress has been made in the re-identification problem, it is still a challenging problem due to appearance variations of the same person as well as other people of similar appearance. Some prior works solved the issues by separating features of positive samples from features of negative ones. However, the performances of existing models considerably depend on the characteristics and statistics of the samples used for training. Thus, we propose a novel framework named sampling independent robust feature representation network (SirNet) that learns disentangled feature embedding from randomly chosen samples. A carefully designed sampling independent maximum discrepancy loss is introduced to model samples of the same person as a cluster. As a result, the proposed framework can generate additional hard negatives/positives using the learned features, which results in better discriminability from other identities. Extensive experimental results on large-scale benchmark datasets verify that the proposed model is more effective than prior state-of-the-art models.
15 January 2018 in IEEE Transactions on Image Processing
We propose novel lossless and lossy compression schemes for color filter array (CFA) sampled images based on the Camera-Aware Multi-Resolution Analysis, or CAMRA. Specifically, by CAMRA we refer to modifications that we make to wavelet transform of CFA sampled images in order to achieve a very high degree of decorrelation at the finest scale wavelet coefficients; and a series of color processing steps applied to the coarse scale wavelet coefficients, aimed at limiting the propagation of lossy compression errors through the subsequent camera processing pipeline. We validated our theoretical analysis and the performance of the proposed compression schemes using the images of natural scenes captured in a raw format. The experimental results verify that our proposed methods improve coding efficiency relative to the standard and the state-of-the-art compression schemes for CFA sampled images.
7 February 2022 in IEEE Robotics and Automation Letters
This work addresses the task of electric vehicle (EV) charging inlet detection for autonomous EV charging robots. Recently, automated EV charging systems have received huge attention to improve users’ experience and to efficiently utilize charging infrastructures and parking lots. However, most related works have focused on system design, robot control, planning, and manipulation. Towards robust EV charging inlet detection, we propose a new dataset (EVCI dataset) and a novel data augmentation method that is based on image-to-image translation where typical image-to-image translation methods synthesize a new image in a different domain given an image. To the best of our knowledge, the EVCI dataset is the first EV charging inlet dataset. For the data augmentation method, we focus on being able to control synthesized images’ captured environments (e.g., time, lighting) in an intuitive way. To achieve this, we first propose the environment guide vector that humans can intuitively interpret. We then propose a novel image-to-image translation network that translates a given image towards the environment described by the vector. Accordingly, it aims to synthesize a new image that has the same content as the given image while looking like captured in the provided environment by the environment guide vector. Lastly, we train a detection method using the augmented dataset. Through experiments on the EVCI dataset, we demonstrate that the proposed method outperforms the state-of-the-art methods. We also show that the proposed method is able to control synthesized images using an image and environment guide vectors.
Driving is a task that puts heavy demands on visual information, thereby the human visual system plays a critical role in making proper decisions for safe driving. Understanding a driver’s visual attention and relevant behavior information is a challenging but essential task in advanced driver-assistance systems (ADAS) and efficient autonomous vehicles (AV). Specifically, robust prediction of a driver’s attention from images could be a crucial key to assist intelligent vehicle systems where a self-driving car is required to move safely interacting with the surrounding environment. Thus, in this paper, we investigate a human driver’s visual behavior in terms of computer vision to estimate the driver’s attention locations in images. First, we show that feature representations at high resolution improves visual attention prediction accuracy and localization performance when being fused with features at low-resolution. To demonstrate this, we employ a deep convolutional neural network framework that learns and extracts feature representations at multiple resolutions. In particular, the network maintains the feature representation with the highest resolution at the original image resolution. Second, attention prediction tends to be biased toward centers of images when neural networks are trained using typical visual attention datasets. To avoid overfitting to the center-biased solution, the network is trained using diverse regions of images. Finally, the experimental results verify that our proposed framework improves the prediction accuracy of a driver’s attention locations.
The development of state estimators for local electrical energy supply systems is inevitable as the role of the system’s become more important, especially with the recent increased interest in direct current (DC) microgrids. Proper control and monitoring requires a state estimator that can adapt to the new technologies for DC microgrids. This paper mainly deals with the DC microgrid state estimation (SE) using a modified long short-term memory (LSTM) network, which until recently has been applied only in forecasting studies. The modified LSTM network for the proposed state estimator adopted a specifically weighted least square (WLS)-based loss function for training. To demonstrate the performance of the proposed state estimator, a comparison study was done with other SE methods included in this paper. The results showed that the proposed state estimator had high accuracy in estimating the states of DC microgrids. Other than the enhanced accuracy, the deep-learning-based state estimator also provided faster computation speeds than the conventional state estimator.
In this letter, we improve lossless intra-frame compression of color filter array (CFA) video based on Camera-Aware Multi-Resolution Analysis (CAMRA). CAMRA-based compression leverages the correlation between LH and HL subbands of wavelet-transformed CFA video frames. The key contribution of this letter is an analysis showing that the chrominance components shared by LH and HL subbands of LeGall 5/3 wavelet transform are misaligned, negatively impacting the coding efficiency. To decorrelate the subbands more effectively with minimal dynamic range growth, we developed a new lifting scheme that corrects for this misalignment. We validated our theoretical analysis and the performance of the proposed compression scheme using videos of natural scenes captured in a raw format. The experimental results verify that our proposed transform improves the coding efficiency of CFA intra-frame lossless compression.