Extracting useful and relevant information from the massive amount of data by web users becomes a challenging task. This work regarding applications based on the use of Web Usage Mining (WUM). Clickstream, transaction data, and user profile data represent various sources of web usage data. Preprocessing is an essential process in WUM for understanding the user's life as a whole within a session on a website. It signifies the aggregation of consequent series of page views executed by a singular user traversing through a website. Therefore, it represents a critical task that involves converting raw web log data to obtain a suitable pattern for efficient analysis. The importance of these processes relies on the complex nature of web architecture, and it takes almost 80% of the mining process. This work introduces a complete framework for data preprocessing with a comprehensive demonstration of a real dataset.
Online customers’ opinions represent a significant resource for both customers and enterprises to extract much information that helps them make the right decision. Finding relevant data while searching the internet is a big challenge for web users, known as the “Problem of Information Overload”. Recommender systems have been recognized as a promising way of solving such problems. In this paper, a product recommendation system called “SmartTips” is introduced. The proposed model is built based on aspect-based sentiment analysis, which exploits customers’ feedback and applies the aspect term extraction model to rate various products and extract user preferences as well. Several factors were considered, including readers’ votes, aspect term frequency, opinion words’ frequencies, etc. We tested our model on benchmark datasets that are widely used, and the results show that it outperforms the baseline methods regarding the mean squared errors of generated predictions.
1 March 2021 in Vestnik Udmurtskogo Universiteta. Matematika. Mekhanika. Komp'yuternye Nauki
The problem of finding relevant data while searching the internet represents a big challenge for web users due to the enormous amounts of available information on the web. These difficulties are related to the well-known problem of information overload. In this work, we propose an online web assistant called OWNA. We developed a fully integrated framework for making recommendations in real-time based on web usage mining techniques. Our work starts with preparing raw data, then extracting useful information that helps build a knowledge base as well as assigns a specific weight for certain factors. The experiments show the advantages of the proposed model against alternative approaches.
Sentiment analysis on social media and e-markets has become an emerging trend. Extracting aspect terms for structure-free text is the primary task incorporated in the aspect-based sentiment analysis. This significance relies on the dependency of other tasks on the results it provides, which directly influences the accuracy of the final results of the sentiment analysis. In this work, we propose an aspect term extraction model to identify the prominent aspects. The model is based on clustering the word vectors generated using the pre-trained word embedding model. Dimensionality reduction was employed to improve the quality of word clusters obtained using the K-Means++ clustering algorithm. The proposed model was tested on the real datasets collected from online retailers’ websites and the SemEval-14 dataset. Results show that our model outperforms the baseline models.
1 January 2020 in Proceedings of the Institute for System Programming of the RAS
Термин «большие данные» относится к объемным коллекциям цифровых данных, генерируемых каждую секунду. Производимые наборы данных представлены в структурированном, полуструктурированном и неструктурированном форматах по всему миру, и их трудно анализировать с применением традиционных систем управления базами данных. В последнее время аналитика больших данных становится важной областью исследований из-за популярности Интернета и появления новых веб-технологий. Эта растущая область исследований представляет собой междисциплинарную деятельность, которая привлекает исследователей из различных областей. Исследователи проектируют, разрабатывают и внедряют инструменты, технологии, архитектуры и платформв для анализа этих больших объемов данных. Эта статья начинается с краткого введения в проблематику большие данные и связанные с ними концепции, включая основные характеристики больших данных, после чего обсуждаются наиболее важные открытые исследовательские проблемы и возникающие тенденции. Далее приводится обзор исследований в области аналитики больших данных, обсуждаются преимущества использования решений для больших данных и обсуждаются виды оценок, требуемых перед переходом с традиционных решений. Наконец, представлен обзор основных существующих приложений, обеспечивающий общую панораму аналитики больших данных.
Big Data refers to the highly growing digital data collections that involve data with different formats, including structured, semi-structured, and unstructured datasets. Analyzing these combinations requires capabilities beyond the traditional database management systems' abilities. Among most sources of big data appears e-markets and social media platforms as significant contributors. This distinction is due to its features that facilitate consumers to express their views or opinions about specific products and services. Customer reviews and ratings become a significant resource for both consumers and firms regarding their plentiful and valuable knowledge. The proposed work introduces a big data framework to analyze such reviews and ratings, starting with data collection from different sources. Followed by integrating the collected data, which comes in different formats, toward the further processing phase. Finally, the analysis and visualization steps to draw the conclusions. Our work was tested on real data collected from active web resources.