High quality virtual views need to be synthesized from adjacent available views for free viewpoint video and multiview video coding (MVC) to provide users with a more realistic 3D viewing experience of a scene. View synthesis techniques suffer from poor rendering quality due to holes created by occlusion and rounding integer error through warping. To remove the holes in the virtual view, the existing techniques use spatial and temporal correlation in intra/inter-view images and depth maps. However, they still suffer quality degradation in the boundary region of foreground and background areas due to the low spatial correlation in texture images and low correspondence in inter-view depth maps. To overcome the above-mentioned limitations, we use a number of models in the Gaussian mixture modeling (GMM) to separate background and foreground pixels in our proposed technique. Here, the missing pixels introduced from the warping process are recovered by the adaptive weighted average of the pixel intensities from the corresponding GMM model(s) and warped image. The weights vary with time to accommodate the changes due to a dynamic background and the motions of the moving objects for view synthesis. We also introduce an adaptive strategy to reset the GMM modeling if the contributions of the pixel intensities drop significantly. Our experimental results indicate that the proposed approach provides 5.40–6.60-dB PSNR improvement compared with the relevant methods. To verify the effectiveness of the proposed view synthesis technique, we use it as an extra reference frame in the motion estimation for MVC. The experimental results confirm that the proposed view synthesis is able to improve PSNR by 3.15–5.13 dB compared with the conventional three reference frames.
The efficiency of a vineyard management system is directly related to the effective management of nutritional disorders, which significantly downgrades vine growth, crop yield and wine quality. To detect nutritional disorders, we successfully extracted a wide range of features using hyperspectral (HS) images to identify healthy and individual nutrient deficiencies of grapevine leaves. Features such as mean reflectance, mean first derivative reflectance, variation index, mean spectral ratio, normalised difference vegetation index (NDVI) and standard deviation (SD) were employed at various stages in the ultraviolet (UV), visible (VIS) and near-infrared (N.I.R.) regions for our experiment. Leaves were examined visually in the laboratory and grouped as either healthy (i.e. control) or unhealthy. Then, the features of the leaves were extracted from these two groups. In a second experiment, features of individual nutrient-deficient leaves (e.g., N, K and Mg) were also analysed and compared with those of control leaves. Furthermore, a customised support vector machine (SVM) was used to demonstrate that these features can be utilised with a high degree of effectiveness to identify unhealthy samples and not only to distinguish from control and nutrient deficient but also to identify individual nutrient defects. Therefore, the proposed work corroborated that HS imaging has excellent potential to analyse features based on healthiness and individual nutrient deficiencies of grapevine leaves.
The application of computer vision for COVID-19 diagnosis is complex and challenging, given the risks associated with patient misclassifications. Arguably, the primary value of medical imaging for COVID-19 lies rather on patient prognosis. Radiological images can guide physicians assessing the severity of the disease, and a series of images from the same patient at different stages can help to gauge disease progression. Hence, a simple method based on lung-pathology interpretable features for scoring disease severity from Chest X-rays is proposed here. As the primary contribution, this method correlates well to patient severity in different stages of disease progression with competitive results compared to other existing, more complex methods. An original data selection approach is also proposed, allowing the simple model to learn the severity-related features. It is hypothesized that the resulting competitive performance presented here is related to the method being feature-based rather than reliant on lung involvement or opacity as others in the literature. A second contribution comes from the validation of the results, conceptualized as the scoring of patients groups from different stages of the disease. Besides performing such validation on an independent data set, the results were also compared with other proposed scoring methods in the literature. The results show that there is a significant correlation between the scoring system (MAVIDH) and patient outcome, which could potentially help physicians rating and following disease progression in COVID-19 patients.
X-ray images may present non-trivial features with predictive information of patients that develop severe symptoms of COVID-19. If true, this hypothesis may have practical value in allocating resources to particular patients while using a relatively inexpensive imaging technique. The difficulty of testing such a hypothesis comes from the need for large sets of labelled data, which need to be well-annotated and should contemplate the post-imaging severity outcome. This paper presents an original methodology for extracting semantic features that correlate to severity from a data set with patient ICU admission labels through interpretable models. The methodology employs a neural network trained to recognise lung pathologies to extract the semantic features, which are then analysed with low-complexity models to limit overfitting while increasing interpretability. This analysis points out that only a few features explain most of the variance between patients that developed severe symptoms. When applied to an unrelated larger data set with pathology-related clinical notes, the method has shown to be capable of selecting images for the learned features, which could translate some information about their common locations in the lung. Besides attesting separability on patients that eventually develop severe symptoms, the proposed methods represent a statistical approach highlighting the importance of features related to ICU admission that may have been only qualitatively reported. While handling limited data sets, notable methodological aspects are adopted, such as presenting a state-of-the-art lung segmentation network and the use of low-complexity models to avoid overfitting. The code for methodology and experiments is also available.
Glyphosate-resistant annual ryegrass (Lolium rigidum) is a major problem in Australian grain production. Early detection of resistant populations is important for effective management, yet current bioassay-based detection takes 21–28 days. Here, this proof-of-concept study tested whether consumer-grade smartphone imaging, combined with machine learning and deep learning, can compress that timeline. One confirmed glyphosate-resistant (GR) and one susceptible (GS) L. rigidum population were sprayed with glyphosate at 540 g ae ha−1. RGB images were captured with a Samsung Galaxy S21 at 0, 3 and 9 days post-application (DPA) and split at the plant level using stratified 5-fold cross-validation. A pretrained EfficientNet-B0, fine-tuned via transfer learning, achieved 95.45% binary accuracy at 3 DPA, outperforming a custom CNN (90.91%) and Random Forest (81.82%). By 9 DPA, EfficientNet-B0 reached 100%. For four-class classification (biotype × treatment), EfficientNet-B0 scored 60.98% at 3 DPA and 94.44% at 9 DPA, exceeding both CNN and RF. Baseline accuracy of 54.55–72.73% before spraying points to intrinsic population differences; the post-glyphosate gains suggest the herbicide sharpens the contrast between biotypes. Because only one population pair was tested, these results should be treated as proof-of-concept; validation across multiple independent populations in the field is the obvious next step.