Robert Kwieciński

Mr. Robert Kwieciński

orcid

Research Focus & Metrics

Academic Career Length

4Years (2023-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
27 February 2023 in IEEE Access
Verified
Journal Article
Open access
RKRobert Kwieciński
Robert Kwieciński
GMGrzegorz Melniczak
Grzegorz Melniczak
Tomasz GóreckiTomasz Górecki
Tomasz Górecki
Collaborative filtering recommendation systems are traditionally trained in a batch manner and are designed to produce personalized recommendations for a large number of users at the same time. However, in many industrial use cases, it is reasonable to produce recommendations in real time, taking account of very recent user interactions. In this work, we present the implementation of batch and real-time recommendation systems using the example of the RP3Beta model, a simple scalable graph-based model that outperforms multiple more advanced models. Our approach can be utilized by any recommendation system if user-to-item recommendations can be obtained based on item-to-item recommendations. We show that it covers multiple common recommendation models, especially collaborative filtering approaches where user features are not available. We also provide the results of A/B tests comparing these two approaches in a real-world scenario of a job recommendation task, conducted with almost 200,000 OLX users. We report at least 10% more users applying for recommended job ads when using a real-time instead of a batch approach. We believe that our results can help other organizations to take informed decisions about whether to make the effort of moving from a batch to a real-time recommendation setting.

1 August 2024 in Electronics
Verified
Journal Article
Open access
PDF file
RKRobert Kwieciński
Robert Kwieciński
Tomasz GóreckiTomasz Górecki
Tomasz Górecki
AFAgata Filipowska
Agata Filipowska
VDViacheslav Dubrov
Viacheslav Dubrov
Classifieds pose numerous challenges for recommendation methods, including the temporary visibility of ads, the anonymity of most users, and the fact that typically only one user can consume an advertised item. In this work, we address these challenges by choosing models and evaluation procedures that are considered accurate, diverse, and efficient (in terms of memory and time consumption during training and prediction). This paper aims to benchmark various recommendation methods for job classifieds, using OLX Jobs as an example, to enhance the conversion rate of advertisements and user satisfaction. In our research, we implement scalable methods and represent different approaches to the recommendations: Alternating Least Square (ALS), LightFM, Prod2Vec, RP3Beta, and Sparse Linear Methods (SLIM). We conducted A/B tests by sending millions of messages with recommendations to perform online evaluations of selected methods. In addition, we have published the dataset created for our research. To the best of our knowledge, this is the first dataset of its kind. It contains 65,502,201 events performed on OLX Jobs by 3,295,942 users who interacted with (displayed, replied to, or bookmarked) 185,395 job ads over two weeks in 2020. We demonstrate that RP3Beta, SLIM, and ALS perform significantly better than Prod2Vec and LightFM when tested in a laboratory setting. Online A/B tests also show that sending messages with recommendations generated by the ALS and RP3Beta models increases the number of users contacting advertisers. Additionally, RP3Beta had a 20% more significant impact on this metric than ALS.

19 January 2023 in arXiv
Verified
Preprint
Open access
PDF file
RKRobert Kwieciński
Robert Kwieciński
AFAgata Filipowska
Agata Filipowska
Tomasz GóreckiTomasz Górecki
Tomasz Górecki
VDViacheslav Dubrov
Viacheslav Dubrov
Classifieds provide many challenges for recommendation methods, due to the limited information regarding users and items. In this paper, we explore recommendation methods for classifieds using the example of OLX Jobs. The goal of the paper is to benchmark different recommendation methods for jobs classifieds in order to improve advertisements' conversion rate and user satisfaction. In our research, we implemented methods that are scalable and represent different approaches to recommendation, namely ALS, LightFM, Prod2Vec, RP3beta, and SLIM. We performed a laboratory comparison of methods with regard to accuracy, diversity, and scalability (memory and time consumption during training and in prediction). Online A/B tests were also carried out by sending millions of messages with recommendations to evaluate models in a real-world setting. In addition, we have published the dataset that we created for the needs of our research. To the best of our knowledge, this is the first dataset of this kind. The dataset contains 65,502,201 events performed on OLX Jobs by 3,295,942 users, who interacted with (displayed, replied to, or bookmarked) 185,395 job ads in two weeks of 2020. We demonstrate that RP3beta, SLIM, and ALS perform significantly better than Prod2Vec and LightFM when tested in a laboratory setting. Online A/B tests also demonstrated that sending messages with recommendations generated by the ALS and RP3beta models increases the number of users contacting advertisers. Additionally, RP3beta had a 20% greater impact on this metric than ALS.