Nowadays, web designers are forced to have an even deeper perception of how users approach their products in terms of user experience and usability. Remote Usability Testing (RUT) is the most appropriate tool to assess the usability of web platforms by measuring the level of user attention, satisfaction, and productivity. RUT does not require the physical presence of users and evaluators, but for this very reason makes data collection more difficult. To simplify data collection and analysis and help RUT moderators collect and analyze user’s data in a non-intrusive manner, this research work proposes a low-cost comprehensive framework based on Deep Learning algorithms. The proposed framework, called Miora, employs facial expression recognition, gaze recognition, and analytics algorithms to capture data about other information of interest for in-depth usability analysis, such as interactions with the analyzed software. It uses a comprehensive evaluation methodology to elicit information about usability metrics and presents the results in a series of graphs and statistics so that the moderator can intuitively analyze the different trends related to the KPI used as usability indicators. To demonstrate how the proposed framework could facilitate the collection of large amounts of data and enable moderators to conduct both remote formative and summative tests in a more efficient way than traditional lab-based usability testing, two case studies have been presented: the analysis of an online shop and of a management platform. Obtained results suggest that this framework can be employed in remote usability testing to conduct both formative and summative tests.
Recommender engines are software applications employed in online tourism information searches to suggest useful content and guide user choices. They represent a significant area of research within the tourism sector, crucially influencing traveler decisions through personalized recommendations. This paper focuses specifically on the Branding4Resilience (B4R) project, whose objective is to promote inner areas, by co-designing virtuous transformations with their inhabitants through novel branding strategies and digital enabling infrastructures. All experiments and assessments described in this study were conducted within the italian area of Sassoferrato, corresponding to the criteria defined by the B4R initiative. The paper introduces a dedicated web platform aimed at enhancing tourism by directing attention towards inland destinations and networking opportunities. The platform enables local providers of tourism-related services, such as guides, event organizers, and restaurateurs, to connect effectively with tourists seeking distinctive experiences. By facilitating interactions, the platform promotes collaboration, innovation, and the co-creation of personalized experiences, transforming tourists into active participants and contributors. To evaluate user experience, perceived usefulness, and innovation of the platform, we analyzed user responses to a structured questionnaire, which combined frequently addressed questions from existing literature with newly developed items specific to our platform. Constructs included tourist platform usage, perceived utility, content quality, design and usability, and innovative elements. The implemented algorithm demonstrated an average sensitivity of 79.74%, highlighting its efficacy in providing relevant suggestions to the platform’s “consumers” users.
The perception of sound greatly impacts users’ emotional states, expectations, affective relationships with products, and purchase decisions. Consequently, assessing the perceived quality of sounds through jury testing is crucial in product design. However, the subjective nature of jurors’ responses may limit the accuracy and reliability of jury test outcomes. This research explores the utility of facial expression analysis in jury testing to enhance response reliability and mitigate subjectivity. Some quantitative indicators allow the research hypothesis to be validated, such as the correlation between jurors’ emotional responses and valence values, the accuracy of jury tests, and the disparities between jurors’ questionnaire responses and the emotions measured by FER (facial expression recognition). Specifically, analysis of attention levels during different statuses reveals a discernible decrease in attention levels, with 70 percent of jurors exhibiting reduced attention levels in the ‘distracted’ state and 62 percent in the ‘heavy-eyed’ state. On the other hand, regression analysis shows that the correlation between jurors’ valence and their choices in the jury test increases when considering the data where the jurors are attentive. The correlation highlights the potential of facial expression analysis as a reliable tool for assessing juror engagement. The findings suggest that integrating facial expression recognition can enhance the accuracy of jury testing in product design by providing a more dependable assessment of user responses and deeper insights into participants’ reactions to auditory stimuli.