Traditional recommendation systems have predominantly relied on user-provided ratings as explicit input. Concurrently, visually aware recommender systems harness inherent visual cues within data to decode item characteristics and deduce user preferences. However, the untapped potential of incorporating item images into the recommendation process warrants investigation. This paper introduces an original convolutional neural network (CNN) architecture that leverages multimodal information, connecting user ratings with product images to enhance item recommendations. A central innovation of the proposed model is the User-Adaptive Filtering Module, a dynamic component that utilizes user profiles to generate personalized filters. Through meticulous visual influence analysis, the effectiveness of these filters is demonstrated. Furthermore, experimental results underscore the competitive performance of the approach compared to traditional collaborative filtering methods, thereby offering a promising avenue for personalized recommendations. This approach capitalizes on user adaptation patterns, enhancing the understanding of user preferences and visual attributes.
23 July 2024 in Natural Language Processing Journal
The widespread availability of pseudonymized user datasets has enabled personalized recommendation systems. However, recent studies have shown that users can be de-anonymized by exploiting the uniqueness of their data patterns, raising significant privacy concerns. This paper presents a novel approach that tackles the challenging task of linking user identities across multiple rating datasets from diverse domains, such as movies, books, and music, by leveraging the consistency of users’ rating patterns as high-dimensional quasi-identifiers. The proposed method combines probabilistic record linkage techniques with quasi-identifier attacks, employing the Fellegi–Sunter model to compute the likelihood of two records referring to the same user based on the similarity of their rating vectors. Through extensive experiments on three publicly available rating datasets, we demonstrate the effectiveness of the proposed approach in achieving high precision and recall in cross-dataset de-anonymization tasks, outperforming existing techniques, with F1-scores ranging from 0.72 to 0.79 for pairwise de-anonymization tasks. The novelty of this research lies in the unique integration of record linkage techniques with quasi-identifier attacks, enabling the effective exploitation of the uniqueness of rating patterns as high-dimensional quasi-identifiers to link user identities across diverse datasets, addressing a limitation of existing methodologies. We thoroughly investigate the impact of various factors, including similarity metrics, dataset combinations, data sparsity, and user demographics, on the de-anonymization performance. This work highlights the potential privacy risks associated with the release of anonymized user data across diverse contexts and underscores the critical need for stronger anonymization techniques and tailored privacy-preserving mechanisms for rating datasets and recommender systems.
Although walking methodologies (WMs) and machine learning (ML) have been objects of interest for urban scholars, it is difficult to find research that integrates both. We propose a ‘cyborg walk’ method and apply it to studying litter in public spaces. Walking routes are created based on an unsupervised learning algorithm (k-means) to classify public spaces. Then, a deep learning model (YOLOv5) is used to collect data from geotagged photos taken by an automatic Insta360 X3 camera worn by human walkers. Results from image recognition have an accuracy between 83.7% and 95%, which is similar to what is validated by the literature. The data collected by the machine are automatically georeferenced thanks to the metadata generated by a GPS attached to the camera. WMs could benefit from the introduction of ML for informative route optimisation and georeferenced visual data quantification. The links between these findings and the existing WM literature are discussed, reflecting on the parallels between this ‘cyborg walk’ experiment and the seminal cyborg metaphor proposed by Donna Haraway.
29 August 2019 in International Journal on Artificial Intelligence Tools