Ankur Deria

Ankur Deria

Auto-generated profile, based on publicly available information

Ankur Deria

Department of Informatics, Technical University of Munich, Garching bei Mnchen, Germany

Research Focus & Metrics

Academic Career Length

5Years (2022-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
15 June 2023 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
Swalpa Kumar RoySwalpa Kumar Roy
Swalpa Kumar Roy
ADAnkur Deria
Ankur Deria
Danfeng HongDanfeng Hong
Danfeng Hong
Behnood RastiBehnood Rasti
Behnood Rasti
Antonio PlazaAntonio Plaza
Antonio Plaza
Jocelyn  ChanussotJocelyn Chanussot
Jocelyn Chanussot
Vision transformers (ViTs) have been trending in image classification tasks due to their promising performance when compared to convolutional neural networks (CNNs). As a result, many researchers have tried to incorporate ViTs in hyperspectral image (HSI) classification tasks. To achieve satisfactory performance, close to that of CNNs, transformers need fewer parameters. ViTs and other similar transformers use an external classification (CLS) token which is randomly initialized and often fails to generalize well, whereas other sources of multimodal datasets, such as light detection and ranging (LiDAR) offer the potential to improve these models by means of a CLS. In this paper, we introduce a new multimodal fusion transformer (MFT) network which comprises a multihead cross patch attention (mCrossPA) for HSI land-cover classification. Our mCrossPA utilizes other sources of complementary information in addition to the HSI in the transformer encoder to achieve better generalization. The concept of tokenization is used to generate CLS and HSI patch tokens, helping to learn a distinctive representation in a reduced and hierarchical feature space. Extensive experiments are carried out on widely used benchmark datasets i.e., the University of Houston, Trento, University of Southern Mississippi Gulfpark (MUUFL), and Augsburg. We compare the results of the proposed MFT model with other state-of-the-art transformers, classical CNNs, and conventional classifiers models. The superior performance achieved by the proposed model is due to the use of multihead cross patch attention. The source code will be made available publicly at https://github.com/AnkurDeria/MFT.

3 February 2023 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
Swalpa Kumar RoySwalpa Kumar Roy
Swalpa Kumar Roy
ADAnkur Deria
Ankur Deria
Chiranjibi ShahChiranjibi Shah
Chiranjibi Shah
JHJuan M. Haut
Juan M. Haut
Qian DuQian Du
Qian Du
Antonio PlazaAntonio Plaza
Antonio Plaza
In recent years, convolutional neural networks (CNNs) have drawn significant attention for classification of hyperspectral images (HSIs). Due to their self-attention mechanism, the vision transformer (ViT) provides promising classification performance compared to CNNs. Many researchers have incorported ViT for HSI classification purposes. However, its performance can be further improved because the current version does not use spatial-spectral features. In this paper, we present a new morphological transformer (morphFormer) that implements a learnable spectral and spatial morphological network, where spectral and spatial morphological convolution operations are used (in conjunction with the attention mechanism) to improve the interaction between the structural and shape information of the HSI token and the CLS token. Experiments conducted on widely used HSIs demonstrate the superiority of proposed morphFormer over the classical CNN models and state-of-the-art transformer models. The source will be made available publicly at https://github.com/mhaut/morphFormer.

23 May 2022 in IEEE Transactions on Geoscience and Remote Sensing
Verified
Journal Article
Closed access
Swalpa Kumar RoySwalpa Kumar Roy
Swalpa Kumar Roy
ADAnkur Deria
Ankur Deria
Danfeng HongDanfeng Hong
Danfeng Hong
Muhammad AhmadMuhammad Ahmad
Muhammad Ahmad
Antonio PlazaAntonio Plaza
Antonio Plaza
Jocelyn  ChanussotJocelyn Chanussot
Jocelyn Chanussot
Convolutional neural networks (CNNs) have been extensively utilized for hyperspectral image (HSI) and light detection and ranging (LiDAR) data classification. However, CNNs have not been much explored for joint HSI and LiDAR image classification. Therefore, this article proposes a joint feature learning (HSI and LiDAR) and fusion mechanism using CNN and spatial morphological blocks, which generates highly accurate land-cover maps. The CNN model comprises three Conv3D layers and is directly applied to the HSIs for extracting discriminative spectral–spatial feature representation. On the contrary, the spatial morphological block is able to capture the information relevant to the height or shape of the different land-cover regions from LiDAR data. The LiDAR features are extracted using morphological dilation and erosion layers that increase the robustness of the proposed model by considering elevation information as an additional feature. Finally, both the obtained features from CNNs and spatial morphological blocks are combined using an additive operation prior to the classification. Extensive experiments are shown with widely used HSIs and LiDAR datasets, i.e., University of Houston (UH), Trento, and MUUFL Gulfport scene. The reported results show that the proposed model significantly outperforms traditional methods and other state-of-the-art deep learning models. The source code for the proposed model will be made available publicly at https://github.com/AnkurDeria/HSI+LiDAR .