Nikola Simidjievski

Dr. Nikola Simidjievski

orcid

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
1 December 2015 in Expert Systems with Applications
Verified
Journal Article
Closed access
NSNikola Simidjievski
Nikola Simidjievski
LTLjupčo Todorovski
Ljupčo Todorovski
SDSašo Džeroski
Sašo Džeroski

14 April 2016 in PLOS ONE
Verified
Journal Article
Open access
PDF file
NSNikola Simidjievski
Nikola Simidjievski
LTLjupčo Todorovski
Ljupčo Todorovski
SDSašo Džeroski
Sašo Džeroski
Ensembles are a well established machine learning paradigm, leading to accurate and robust models, predominantly applied to predictive modeling tasks. Ensemble models comprise a finite set of diverse predictive models whose combined output is expected to yield an improved predictive performance as compared to an individual model. In this paper, we propose a new method for learning ensembles of process-based models of dynamic systems. The process-based modeling paradigm employs domain-specific knowledge to automatically learn models of dynamic systems from time-series observational data. Previous work has shown that ensembles based on sampling observational data (i.e., bagging and boosting), significantly improve predictive performance of process-based models. However, this improvement comes at the cost of a substantial increase of the computational time needed for learning. To address this problem, the paper proposes a method that aims at efficiently learning ensembles of process-based models, while maintaining their accurate long-term predictive performance. This is achieved by constructing ensembles with sampling domain-specific knowledge instead of sampling data. We apply the proposed method to and evaluate its performance on a set of problems of automated predictive modeling in three lake ecosystems using a library of process-based knowledge for modeling population dynamics. The experimental results identify the optimal design decisions regarding the learning algorithm. The results also show that the proposed ensembles yield significantly more accurate predictions of population dynamics as compared to individual process-based models. Finally, while their predictive performance is comparable to the one of ensembles obtained with the state-of-the-art methods of bagging and boosting, they are substantially more efficient.

28 April 2023 in Remote Sensing
Verified
Journal Article
Open access
PDF file
IDIvica Dimitrovski
Ivica Dimitrovski
IKIvan Kitanovski
Ivan Kitanovski
PPPnace Panov
Pnace Panov
AKAna Kostovska
Ana Kostovska
NSNikola Simidjievski
Nikola Simidjievski
Dragi KocevDragi Kocev
Dragi Kocev
We propose AiTLAS—an open-source, state-of-the-art toolbox for exploratory and predictive analysis of satellite imagery. It implements a range of deep-learning architectures and models tailored for the EO tasks illustrated in this case. The versatility and applicability of the toolbox are showcased in a variety of EO tasks, including image scene classification, semantic image segmentation, object detection, and crop type prediction. These use cases demonstrate the potential of the toolbox to support the complete data analysis pipeline starting from data preparation and understanding, through learning novel models or fine-tuning existing ones, using models for making predictions on unseen images, and up to analysis and understanding of the predictions and the predictive performance yielded by the models. AiTLAS brings the AI and EO communities together by facilitating the use of EO data in the AI community and accelerating the uptake of (advanced) machine-learning methods and approaches by EO experts. It achieves this by providing: (1) user-friendly, accessible, and interoperable resources for data analysis through easily configurable and readily usable pipelines; (2) standardized, verifiable, and reusable data handling, wrangling, and pre-processing approaches for constructing AI-ready data; (3) modular and configurable modeling approaches and (pre-trained) models; and (4) standardized and reproducible benchmark protocols including data and models.

6 February 2020 in IEEE Access
Verified
Journal Article
Open access
NSNikola Simidjievski
Nikola Simidjievski
LTLjupco Todorovski
Ljupco Todorovski
Jus KocijanJus Kocijan
Jus Kocijan
SDSašo Džeroski
Sašo Džeroski
Equation discovery methods enable modelers to combine domain-specific knowledge and system identification to construct models most suitable for a selected modeling task. The method described and evaluated in this paper can be used as a nonlinear system identification method for gray-box modeling. It consists of two interlaced parts of modeling that are computer-aided. The first performs computer-aided identification of a model structure composed of elements selected from user-specified domain-specific modeling knowledge, while the second part performs parameter estimation. In this paper, recent developments of the equation discovery method called process-based modeling, suited for nonlinear system identification, are elaborated and illustrated in two continuous-time case studies. The first case study illustrates the use of the process-based modeling on synthetic data while the second case-study evaluates process-based modeling on measured data for a standard system-identification benchmark. The experimental results clearly demonstrate the ability of process-based modeling to reconstruct both model structure and parameters from measured data.

1 December 2021 in Applied Soft Computing
Verified
Journal Article
Closed access
MPMatej Petković
Matej Petković
BŠBlaž Škrlj
Blaž Škrlj
Dragi KocevDragi Kocev
Dragi Kocev
NSNikola Simidjievski
Nikola Simidjievski

16 January 2024 in IEEE Geoscience and Remote Sensing Letters
Verified
Journal Article
Closed access
IDIvica Dimitrovski
Ivica Dimitrovski
IKIvan Kitanovski
Ivan Kitanovski
NSNikola Simidjievski
Nikola Simidjievski
Dragi KocevDragi Kocev
Dragi Kocev
We investigate the utility of in-domain self-supervised pretraining of vision models in the analysis of remote sensing imagery. Self-supervised learning (SSL) has emerged as a promising approach for remote sensing image classification due to its ability to exploit large amounts of unlabeled data. Unlike traditional supervised learning, SSL aims to learn representations of data without the need for explicit labels. This is achieved by formulating auxiliary tasks that can be used for pretraining models before fine-tuning them on a given downstream task. A common approach in practice to SSL pretraining is utilizing standard pretraining datasets, such as ImageNet. While relevant, such a general approach can have a suboptimal influence on the downstream performance of models, especially on tasks from challenging domains such as remote sensing. In this letter, we analyze the effectiveness of SSL pretraining by employing the image bidirectional encoder representations from transformers (BERT) pretraining with online tokenizer (iBOT) framework coupled with Vision transformers (ViTs) trained on million aerial image dataset (Million-AID), a large and unlabeled remote sensing dataset. We present a comprehensive study of different self-supervised pretraining strategies and evaluate their effect across 14 downstream datasets with diverse properties. Our results demonstrate that leveraging large in-domain datasets for self-supervised pretraining consistently leads to improved predictive downstream performance, compared to the standard approaches found in practice.