Human action recognition and video summarization represent challenging tasks for several computer vision applications including video surveillance, criminal investigations, and sports applications. For long videos, it is difficult to search within a video for a specific action and/or person. Usually, human action recognition approaches presented in the literature deal with videos that contain only a single person, and they are able to recognize his action. This paper proposes an effective approach to multiple human action detection, recognition, and summarization. The multiple action detection extracts human bodies’ silhouette, then generates a specific sequence for each one of them using motion detection and tracking method. Each of the extracted sequences is then divided into shots that represent homogeneous actions in the sequence using the similarity between each pair frames. Using the histogram of the oriented gradient (HOG) of the Temporal Difference Map (TDMap) of the frames of each shot, we recognize the action by performing a comparison between the generated HOG and the existed HOGs in the training phase which represents all the HOGs of many actions using a set of videos for training. Also, using the TDMap images we recognize the action using a proposed CNN model. Action summarization is performed for each detected person. The efficiency of the proposed approach is shown through the obtained results for mainly multi-action detection and recognition.

The success of minimally invasive interventions and the remarkable technological and medical progress have made endoscopic image enhancement a very active research field. Due to the intrinsic endoscopic domain characteristics and the surgical exercise, stereo endoscopic images may suffer from different degradations which affect its quality. Therefore, in order to provide the surgeons with a better visual feedback and improve the outcomes of possible subsequent processing steps, namely a 3D organ reconstruction/registration, it would be interesting to improve the stereo endoscopic image quality. To this end, we propose in this paper two joint enhancement methods which operate in the wavelet transform domain. More precisely, by resorting to a joint wavelet decomposition, the wavelet subbands of the right and left views are simultaneously processed to exploit the binocular vision properties. While the first proposed technique combines only the approximation subbands of both views, the second method combines all the wavelet subbands yielding an inter-view processing fully adapted to the local features of the stereo endoscopic images. Experimental results, carried out on various stereo endoscopic datasets, have demonstrated the efficiency of the proposed enhancement methods in terms of perceived visual image quality.

Contrast in visible images is one of the most relevant characteristics of visual signals. Since the pioneering works performed in vision psychology and optics, different definitions have been proposed in the literature. However, for the time being there exist no definition of contrast on which the vision research and visual processing scientific community can agree on. This makes it critical to have a clear view on the notion of contrast and its use in various applications. One issue to consider is how to define and particularly use this important measure in developing image processing and analysis methods. In this paper, we present a critical review of contrast measures and associated models developed by the scientific community in vision, optics, and image processing. We also provide learned lessons and guidelines on the use of appropriate contrast measures in selected visual information processing and analysis applications. We discuss challenges and propose research avenues for models enriched by recent findings in the field of human vision research and machine learning. We believe that this work serves as a guideline and can potentially open new research perspectives to the scientific community working on visual information processing and analysis.

Tumor segmentation in Computed Tomography (CT) images is a crucial step in image-guided surgery. However, low-contrast CT images impede the performance of subsequent segmentation tasks. Contrast enhancement is then used as a preprocessing step to highlight the relevant structures, thus facilitating not only medical diagnosis but also image segmentation with higher accuracy. In this paper, we propose a goal-oriented contrast enhancement method to improve tumor segmentation performance. The proposed method is based on two concepts, namely guided image enhancement and image quality control through an optimization scheme. The proposed OPTimized Guided Contrast Enhancement (OPTGCE) scheme exploits both contextual information from the guidance image and structural information from the input image in a two-step process. The first step consists of applying a two-dimensional histogram specification exploiting contextual information in the corresponding guidance image, i.e. Magnetic Resonance Image (MRI). In the second step, an optimization scheme using a structural similarity measure to preserve the structural information of the original image is performed. To the best of our knowledge, this kind of contrast enhancement optimization scheme using cross-modal guidance is proposed for the first time in the medical imaging context. The experimental results obtained on real data demonstrate the effectiveness of the method in terms of enhancement and segmentation quality in comparison to some state-of-the-art methods based on the histogram.