29 March 2022 in IEEE Transactions on Multimedia
Semantic segmentation is a classic computer vision task with multiple applications, which includes medical and remote sensing image analysis. Despite recent advances with deep-based approaches, labeling samples (pixels) for training models is laborious and, in some cases, unfeasible. In this paper, we present two novel meta learning methods, named WeaSeL and ProtoSeg, for the few-shot semantic segmentation task with sparse annotations. We conducted extensive evaluation of the proposed methods in different applications (12 datasets) in medical imaging and agricultural remote sensing, which are very distinct fields of knowledge and usually subject to data scarcity. The results demonstrated the potential of our method, achieving suitable results for segmenting both coffee/orange crops and anatomical parts of the human body in comparison with full dense annotation.
23 October 2020 in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
It is undeniable that aerial/satellite images can provide useful information for a large variety of tasks. But, since these images are always taken from above, some applications can benefit from complementary information provided by other perspective views of the scene, such as ground-level images. Despite a large number of public repositories for both georeferenced photographs and aerial images, there is a lack of benchmark datasets that allow the development of approaches that exploit the benefits and complementarity of aerial/ground imagery. In this article, we present two new publicly available datasets named AiRound and CV-BrCT. The first one contains triplets of images from the same geographic coordinate with different perspectives of view extracted from various places around the world. Each triplet is composed of an aerial RGB image, a ground-level perspective image, and a Sentinel-2 sample. The second dataset contains pairs of aerial and street-level images extracted from southeast Brazil. We design an extensive set of experiments concerning multiview scene classification, using early and late fusion. Such experiments were conducted to show that image classification can be enhanced using multiview data.
8 April 2024 in Pattern Recognition
RCRoberto Marcondes Cesar
9 July 2021 in Machine Learning
25 July 2022 in IEEE Geoscience and Remote Sensing Letters
Current deep learning methods for interpreting seismic images require large amounts of labeled data, and due to strategic and economic interests, these data are not plenty available. In this scenario, seismic interpretation can benefit from self-supervised learning (SSL) by relying on prior training without manually annotated labels within the target data domain and subsequent fine-tuning with few shots. To demonstrate the potential of such an approach, we conducted experiments with three classic context-based pretext tasks: rotation, jigsaw, and frame order prediction. Our results for 1, 5, 10, and 20 shots showed significant improvement for mean Intersection-over-Union (mIoU) measurements for semantic segmentation in most scenarios, outperforming the baseline method in 38% in the one-shot scenario for the F3 Netherlands Dataset and 16.4% in the New Zealand Parihaka dataset, and this gap grows even higher after performing ensemble modeling. These experiments suggest that applying SSL methods can also bring great benefits in seismic interpretation when few labeled data are available.
1 December 2020 in Pattern Recognition Letters