Featured snippets that attempt to satisfy users’ information needs directly on top of the first search engine results page (SERP) have been shown to strongly impact users’ post-search attitudes and beliefs. In the context of debated but scientifically answerable topics, recent research has demonstrated that users tend to trust featured snippets to such an extent that they may reverse their original beliefs based on what such a snippet suggests; even when erroneous information is featured. This paper examines the effect of featured snippets in more nuanced and complicated search scenarios concerning debated topics that have no ground truth and where diverse arguments in favor and against can legitimately be made. We report on a preregistered, online user study (N = 182) investigating how the stances and logics of evaluation (i.e., underlying reasons behind stances) expressed in featured snippets influence post-task attitudes and explanations of users without strong pre-search attitudes. We found that such users tend to not only change their attitudes on debated topics (e.g., school uniforms) following whatever stance a featured snippet expresses but also incorporate the featured snippet’s logic of evaluation into their argumentation. Our findings imply that the content displayed in featured snippets may have large-scale undesired consequences for individuals, businesses, and society, and urgently call for researchers and practitioners to examine this issue further.
In this work, we investigate the efficacy of boost interventions rooted in information literacy principles to enhance user interaction with search results and promote knowledge acquisition on debated topics. We conducted a pre-registered online user study with a between-groups design involving 351 participants who each completed knowledge assessments before and after performing a search task. In total, 9 boost conditions were tested (consisting of 4 search tips × 2 presentations and one control without a boost). Our findings indicate that the tested boost interventions successfully steer users towards examining a greater number of search results, investing more time in their search, and achieving a more equitable distribution of arguments presented for each side of a debated topic. Nonetheless, in terms of overall knowledge gain, the interventions do not yield a significant difference when compared to the baseline. The results underscore that boosts could be useful in effectively restricting some of the biases involved when users perform searches on debated topics, and should therefore be tested in more naturalistic settings. However, additional support mechanisms are essential if the goal is to enhance overall knowledge acquisition.
Many users struggle with effective online search and critical evaluation, especially in high-stakes domains like health, while often overestimating their digital literacy. Thus, in this demo, we present an interactive search companion that seamlessly integrates expert search strategies into existing search engine result pages. Providing context-aware tips on clarifying information needs, improving query formulation, encouraging result exploration, and mitigating biases, our companion aims to foster reflective search behaviour while minimising cognitive burden. A user study demonstrates the companion’s successful encouragement of more active and exploratory search, leading users to submit 75% more queries and view roughly twice as many results, as well as performance gains in difficult tasks. This demo illustrates how lightweight, contextual guidance can enhance search literacy and empower users through micro-learning opportunities. While the vision involves real-time LLM adaptivity, this study utilises a controlled implementation to test the underlying intervention strategies.