Olivera Grljević

Prof. Dr. Olivera Grljević

Business informatics, University of Novi Sad, The Faculty of Economics in Subotica, Serbia, Subotica, Serbia
orcid

Research Focus & Metrics

Academic Career Length

13Years (2014-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 January 2020 in The Electronic Library
Verified
Journal Article
Closed access
NNNikola Nikolić
Nikola Nikolić
Olivera GrljevićOlivera Grljević
Olivera Grljević
AKAleksandar Kovačević
Aleksandar Kovačević
Purpose: Student recruitment and retention are important issues for all higher education institutions. Constant monitoring of student satisfaction levels is therefore crucial. Traditionally, students voice their opinions through official surveys organized by the universities. In addition to that, nowadays, social media and review websites such as “Rate my professors” are rich sources of opinions that should not be ignored. Automated mining of students’ opinions can be realized via aspect-based sentiment analysis (ABSA). ABSA s is a sub-discipline of natural language processing (NLP) that focusses on the identification of sentiments (negative, neutral, positive) and aspects (sentiment targets) in a sentence. The purpose of this paper is to introduce a system for ABSA of free text reviews expressed in student opinion surveys in the Serbian language. Sentiment analysis was carried out at the finest level of text granularity – the level of sentence segment (phrase and clause). Design/methodology/approach: The presented system relies on NLP techniques, machine learning models, rules and dictionaries. The corpora collected and annotated for system development and evaluation comprise students’ reviews of teaching staff at the Faculty of Technical Sciences, University of Novi Sad, Serbia, and a corpus of publicly available reviews from the Serbian equivalent of the “Rate my professors” website. Findings: The research results indicate that positive sentiment can successfully be identified with the F-measure of 0.83, while negative sentiment can be detected with the F-measure of 0.94. While the F-measure for the aspect’s range is between 0.49 and 0.89, depending on their frequency in the corpus. Furthermore, the authors have concluded that the quality of ABSA depends on the source of the reviews (official students’ surveys vs review websites). Practical implications: The system for ABSA presented in this paper could improve the quality of service provided by the Serbian higher education institutions through a more effective search and summary of students’ opinions. For example, a particular educational institution could very easily find out which aspects of their service the students are not satisfied with and to which aspects of their service more attention should be directed. Originality/value: To the best of the authors’ knowledge, this is the first study of ABSA carried out at the level of sentence segment for the Serbian language. The methodology and findings presented in this paper provide a much-needed bases for further work on sentiment analysis for the Serbian language that is well under-resourced and under-researched in this area.

1 November 2020 in Enterprise Information Systems
Verified
Journal Article
Closed access
Olivera GrljevićOlivera Grljević
Olivera Grljević
ZBZita Bošnjak
Zita Bošnjak
AKAleksandar Kovačević
Aleksandar Kovačević
Student recruitment and retention heavily depend on student satisfaction and word of mouth voiced through surveys, social media, and review websites. The amount of online reviews makes their manual analysis intractable, revealing the need for automated approaches. The paper presents the first Serbian language corpus manually annotated for opinions in the domain of higher education. Agreement among annotators was calculated using the Fleiss’ kappa and agr metrics. Statistical and linguistic analyses of the corpus revealed information useful for hand-crafted rules for sentiment analysis. Using developed corpus, dictionary- and machine learning-based approaches to sentiment analysis are benchmarked. Both exhibit high performance.

1 January 2018 in Strategic Management
Verified
Journal Article
Open access
PDF file
Olivera GrljevićOlivera Grljević
Olivera Grljević
ZBZita Bošnjak
Zita Bošnjak
The value of a customer for the company is not measured only by the monetary effect, but also by the degree of its satisfaction. Satisfied customers spread positive word of mouth, while dissatisfied customers spread negative one (in online or offline environment). Their voice shapes company reputation and the reputation is one of the key parameters in choosing a product, service, or a company. In order to look into customer satisfaction, companies need to get certain feedback from consumers. The traditional way of collecting feedback from consumers is questionnaires. However, the way in which consumers express their opinions on social media opens up new opportunities and makes it easier for companies to cover a larger number of consumers, to collect data of interest and to continuously monitor the brand. Social media sites have significantly changed the nature of human activities, interactions and ways of disseminating information. Consumer behavior has changed accordingly. In search for information about products and services consumers are planning to buy or use, offline sources of information are increasingly replaced with online sources and e-WoM. Before making a purchase decision, consumers visit many sites and read the content and comments that other users have generated. Within these contents - texts that users voluntarily post on the Internet and make it publicly available - users freely express their views, opinions, describe their consumer experience, the problems they have encountered and the way in which the problems were addressed, they point to the aspects of products or services they are satisfied or dissatisfied with. These contents shape the opinions of future consumers in great extent and affect their consumer actions. Numerous studies have confirmed the impact these sources have on consumer behavior: • Consumers appreciate opinions of other individuals and trust them more than the company's promotional campaigns, • Consumers have equal trust in online comments and reviews as in personal recommendations from friends, • Online comments on products and services are on the third place according to the influence on buying decisions (after coupons and discounts). Each business can benefit from analysis of social media content since it comprises useful feedback from consumers in form of expressed opinions and attitudes. Opinions and attitudes are extremely subjective. Due to subjectivity it is necessary to analyze a collection of opinions of different people instead of a single opinion which expresses a subjective view of an individual. In addition to this large number of available sources, the amount of data makes it impossible to manually process them and identify the general pattern, problem or source of (dis)satisfaction. Hence, automated analysis of unstructured content from social media sites is required, i.e. the application of sentiment analysis or opinion mining. Sentiment analysis is a young research area which has rapidly developed during the past 10 years and it has achieved significant commercialization. The surrounding industries also experienced significant expansion. Sentiment analysis allows companies to analyze public opinion, attitudes and emotions directed at a particular entity (e.g. a particular person, a political candidate, a party, a law, a company, a specific product, or a product feature) which expresses particular sentiment or points to (usually positive, negative or neutral), as well as all variations and gradations of the sentiment. In addition to the significance of sentiment analysis for business, this paper deals with sentiment analysis process and underlying data mining techniques.

29 January 2025 in Sustainability
Verified
Journal Article
Open access
PDF file
Olivera GrljevićOlivera Grljević
Olivera Grljević
Mirjana MaricMirjana Maric
Mirjana Maric
Rade BožićRade Božić
Rade Božić
Exploring user satisfaction and experience is the first step of software product improvement and business sustainability. The primary goal of this research is to investigate how companies can use topic modeling to understand mobile application user experience and offer methodological steps for identifying factors shaping it. SalesForce was selected for this case study as it was the most widely used CRM application in 2023. This study aims to uncover factors influencing positive and negative user experience, to compare and systematize them, and to indicate the business implications of topic modeling findings. For this study, authors collected 9081 online reviews of the SalesForce application from Google Play Store. The corpus is divided into three subsets based on the associated star ratings, where four and five stars indicate positive sentiment, three mixed sentiment, and two and one negative. Each subset is analyzed using the Latent Dirichlet Allocation algorithm, hyper-parameters were fine-tuned, and the experimental models were evaluated with coherence measures to determine the model with the optimal number of topics. The results indicate that the driving factors of positive experience are seamless functionality and reliability, design flaws and performance issues shape negative experiences, and mixed experiences arise from inconsistencies in usability and authentication challenges.

1 January 2024 in Anali Ekonomskog fakulteta u Subotici
Verified
Journal Article
Open access
PDF file
Mirjana MaricMirjana Maric
Mirjana Maric
Olivera GrljevićOlivera Grljević
Olivera Grljević
LGLuka Gluščević
Luka Gluščević
Contemporary digital technologies have significantly influenced the transformation of marketing activities in companies over the past decade. Artificial intelligence is considered one of the most disruptive modern technologies. Their implementation is the most significant challenge of digital marketing. Artificial intelligence can automate customer service, generate content, and enable targeted ad campaigns. The problem identified by the authors is that smaller companies and entrepreneurs lack the necessary knowledge and understanding of artificial intelligence techniques that could enhance digital marketing strategies. By reviewing current literature, this paper aims to explain the digital marketing strategies and the role and place of various artificial intelligence techniques for their improvement. In line with the defined goal, the paper presents three case studies on industry giants - Coca-Cola, Starbucks, and Nike - illustrating successful implementations of artificial intelligence and machine learning techniques in their digital marketing.

1 January 2025 in Menadzment u hotelijerstvu i turizmu
Verified
Journal Article
Open access
PDF file
Olivera GrljevićOlivera Grljević
Olivera Grljević
Purpose - Topic modeling (TM) explores customer experience and behaviors from large volumes of textual data, such as online reviews uncovering (dis)satisfaction cues often overlooked by hospitality managers. Despite its potential, TM application in hospitality research is limited compared to other social science methods. This paper aims to investigate the scope of TM research in the hospitality domain and contribute to the understanding of the areas where it can be effectively applied, the purposes it can serve, and the types of problems it can address. Methodology - The research methodology is rooted in the systematic literature review - 40 relevant papers were collected and analysed to identify the areas of hospitality where TM is mostly applied, business insights derived from TM application, and commonly utilised TM approaches. Findings -TM research in hospitality is conducted in five research areas: accommodation and lodging, food and beverages, attractions and events, nature-based tourism, and travel services. Researchers apply TM to gain nine different business insights, such as dissatisfaction drivers, segment-based preferences, sentiments, preference changes over time, service quality perception, or underexplored areas. Implications - TM-based research provides actionable recommendations for the enhancement of managerial practices within the hospitality industry, such as promotion and destination management, service improvements, and reduction of overtourism.