Multimedia content analysis is applied in different real‐world computer vision applications, and digital images constitute a major part of multimedia data. In last few years, the complexity of multimedia contents, especially the images, has grown exponentially, and on daily basis, more than millions of images are uploaded at different archives such as Twitter, Facebook, and Instagram. To search for a relevant image from an archive is a challenging research problem for computer vision research community. Most of the search engines retrieve images on the basis of traditional text‐based approaches that rely on captions and metadata. In the last two decades, extensive research is reported for content‐based image retrieval (CBIR), image classification, and analysis. In CBIR and image classification‐based models, high‐level image visuals are represented in the form of feature vectors that consists of numerical values. The research shows that there is a significant gap between image feature representation and human visual understanding. Due to this reason, the research presented in this area is focused to reduce the semantic gap between the image feature representation and human visual understanding. In this paper, we aim to present a comprehensive review of the recent development in the area of CBIR and image representation. We analyzed the main aspects of various image retrieval and image representation models from low‐level feature extraction to recent semantic deep‐learning approaches. The important concepts and major research studies based on CBIR and image representation are discussed in detail, and future research directions are concluded to inspire further research in this area.
India, Pakistan, and Bangladesh (IPB) are the largest South Asian countries in terms of land area, gross domestic product (GDP), and population. The growth in these countries is impacted by inadequate renewable energy policy and implementation over the years, resulting in slow progress towards human development and economic sustainability. These developing countries are blessed with huge potential for renewable energy resources; however, they still heavily rely on fossil fuels (93%). IPB is a major contributor to the total energy consumption of the world and its most energy-intensive building sector (India 47%, Pakistan 55% and Bangladesh 55%) displays inadequate energy performance. This paper comprehensively reviews the energy mix and consumption in IPB with special emphasis on current policies and its impact on economic and human development. The main performance indicators have been critically analyzed for the period 1970–2017. The strength of this paper is a broad overview on energy and development of energy integration in major South Asian countries. Furthermore, it presents a broad deepening on the main sector of energy consumption, i.e., the building sector. The paper also particularly analyzes the existing buildings energy efficiency codes and policies, with specific long-term recommendations to improve average energy consumption per person. The study also examines the technical and regulatory barriers and recommends specific measures to adapt renewable technologies, with special attention to policies affecting energy consumption. The analysis and results are general and can be applied to other developing countries of the world.
The requirement for effective image search, which motivates the use of Content-Based Image Retrieval (CBIR) and the search of similar multimedia contents on the basis of user query, remains an open research problem for computer vision applications. The application domains for Bag of Visual Words (BoVW) based image representations are object recognition, image classification and content-based image analysis. Interest point detectors are quantized in the feature space and the final histogram or image signature do not retain any detail about co-occurrences of features in the 2D image space. This spatial information is crucial, as it adversely affects the performance of an image classification-based model. The most notable contribution in this context is Spatial Pyramid Matching (SPM), which captures the absolute spatial distribution of visual words. However, SPM is sensitive to image transformations such as rotation, flipping and translation. When images are not well-aligned, SPM may lose its discriminative power. This paper introduces a novel approach to encoding the relative spatial information for histogram-based representation of the BoVW model. This is established by computing the global geometric relationship between pairs of identical visual words with respect to the centroid of an image. The proposed research is evaluated by using five different datasets. Comprehensive experiments demonstrate the robustness of the proposed image representation as compared to the state-of-the-art methods in terms of precision and recall values.
The recent development in the technology has increased the complexity of image contents and demand for image classification becomes more imperative. Digital images play a vital role in many applied domains such as remote sensing, scene analysis, medical care, textile industry and crime investigation. Feature extraction and image representation is considered as an important step in scene analysis as it affects the image classification performance. Automatic classification of images is an open research problem for image analysis and pattern recognition applications. The Bag-of-Features (BoF) model is commonly used to solve image classification, object recognition and other computer vision-based problems. In BoF model, the final feature vector representation of an image contains no information about the co-occurrence of features in the 2D image space. This is considered as a limitation, as the spatial arrangement among visual words in image space contains the information that is beneficial for image representation and learning of classification model. To deal with this, researchers have proposed different image representations. Among these, the division of image-space into different geometric sub-regions for the extraction of histogram for BoF model is considered as a notable contribution for the extraction of spatial clues. Keeping this in view, we aim to explore a Hybrid Geometric Spatial Image Representation (HGSIR) that is based on the combination of histograms computed over the rectangular, triangular and circular regions of the image. Five standard image datasets are used to evaluate the performance of the proposed research. The quantitative analysis demonstrates that the proposed research outperforms the state-of-art research in terms of classification accuracy.
The use of unmanned aerial vehicles (UAVs) for different applications has increased tremendously during the past decade. The small size, high maneuverability, ability to fly at predetermined coordinates, simple construction, and affordable price have made UAVs a popular choice for diverse aerial applications. However, the small size and the ability to fly close to the terrain make the detection and tracking of UAVs challenging. Similarly, unmanned underwater vehicles (UUVs) have revolutionized underwater operations. UUVs can accomplish numerous tasks that were not possible with manned underwater vehicles. In this survey paper, we provide features and capabilities expected from current and future UAVs and UUVs, and review potential challenges and threats due to use of such UAVs/UUVs. We also overview the countermeasures against such threats, including approaches for the detection, tracking, and classification of UAVs and UUVs.
1 January 2019 in Mathematical Problems in Engineering
Face recognition aims to establish the identity of a person based on facial characteristics and is a challenging problem due to complex nature of the facial manifold. A wide range of face recognition applications are based on classification techniques and a class label is assigned to the test image that belongs to the unknown class. In this paper, a pose invariant deeply learned multiview 3D face recognition approach is proposed and aims to address two problems: face alignment and face recognition through identification and verification setups. The proposed alignment algorithm is capable of handling frontal as well as profile face images. It employs a nose tip heuristic based pose learning approach to estimate acquisition pose of the face followed by coarse to fine nose tip alignment using L2 norm minimization. The whole face is then aligned through transformation using knowledge learned from nose tip alignment. Inspired by the intrinsic facial symmetry of the Left Half Face (LHF) and Right Half Face (RHF), Deeply learned (d) Multi‐View Average Half Face (d‐MVAHF) features are employed for face identification using deep convolutional neural network (dCNN). For face verification d‐MVAHF‐Support Vector Machine (d‐MVAHF‐SVM) approach is employed. The performance of the proposed methodology is demonstrated through extensive experiments performed on four databases: GavabDB, Bosphorus, UMB‐DB, and FRGC v2.0. The results show that the proposed approach yields superior performance as compared to existing state‐of‐the‐art methods.