Roberto Ulloa

Dr. Roberto Ulloa

orcid

Research Focus & Metrics

Academic Career Length

11Years (2016-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
18 July 2023 in Discover Artificial Intelligence
Verified
Journal Article
Open access
PDF file
MMMykola Makrotykh
Mykola Makrotykh
EZEve M. Zucker
Eve M. Zucker
DSDavid J. Simon
David J. Simon
DBDaniel Bultmann
Daniel Bultmann
RURoberto Ulloa
Roberto Ulloa
The memorialization of mass atrocities such as war crimes and genocides facilitates the remembrance of past suffering, honors those who resisted the perpetrators, and helps prevent the distortion of historical facts. Digital technologies have transformed memorialization practices by enabling less top-down and more creative approaches to remember mass atrocities. At the same time, they may also facilitate the spread of denialism and distortion, attempt to justify past crimes and attack the dignity of victims. The emergence of generative forms of artificial intelligence (AI), which produce textual and visual content, has the potential to revolutionize the field of memorialization even further. AI can identify patterns in training data to create new narratives for representing and interpreting mass atrocities—and do so in a fraction of the time it takes for humans. The use of generative AI in this context raises numerous questions: For example, can the paucity of training data on mass atrocities distort how AI interprets some atrocity-related inquiries? How important is the ability to differentiate between human- and AI-made content concerning mass atrocities? Can AI-made content be used to promote false information concerning atrocities? This article addresses these and other questions by examining the opportunities and risks associated with using generative AIs for memorializing mass atrocities. It also discusses recommendations for AIs integration in memorialization practices to steer the use of these technologies toward a more ethical and sustainable direction.

17 January 2025 in PLOS ONE
Verified
Journal Article
Open access
PDF file
CKCelina Kacperski
Celina Kacperski
RURoberto Ulloa
Roberto Ulloa
DBDenis Bonnay
Denis Bonnay
JKJuhi Kulshrestha
Juhi Kulshrestha
PSPeter Selb
Peter Selb
ASAndreas Spitz
Andreas Spitz
A major challenge of our time is reducing disparities in access to and effective use of digital technologies, with recent discussions highlighting the role of AI in exacerbating the digital divide. We examine user characteristics that predict usage of the AI-powered conversational agent ChatGPT. We combine behavioral and survey data in a web tracked sample of N = 1376 German citizens to investigate differences in ChatGPT activity (usage, visits, and adoption) during the first 11 months from the launch of the service (November 30, 2022). Guided by a model of technology acceptance (UTAUT-2), we examine the role of socio-demographics commonly associated with the digital divide in ChatGPT activity and explore further socio-political attributes identified via stability selection in Lasso regressions. We confirm that lower age and higher education affect ChatGPT usage, but do not find that gender or income do. We find full-time employment and more children to be barriers to ChatGPT activity. Using a variety of social media was positively associated with ChatGPT activity. In terms of political variables, political knowledge and political self-efficacy as well as some political behaviors such as voting, debating political issues online and offline and political action online were all associated with ChatGPT activity, with online political debating and political self-efficacy negatively so. Finally, need for cognition and communication skills such as writing, attending meetings, or giving presentations, were also associated with ChatGPT engagement, though chairing/organizing meetings was negatively associated. Our research informs efforts to address digital disparities and promote digital literacy among underserved populations by presenting implications, recommendations, and discussions on ethical and social issues of our findings.

2 May 2022 in Journal of Information Science
Verified
Journal Article
Open access
RURoberto Ulloa
Roberto Ulloa
MMMykola Makhortykh
Mykola Makhortykh
AUAleksandra Urman
Aleksandra Urman
Algorithm audits have increased in recent years due to a growing need to independently assess the performance of automatically curated services that process, filter and rank the large and dynamic amount of information available on the Internet. Among several methodologies to perform such audits, virtual agents stand out because they offer the ability to perform systematic experiments, simulating human behaviour without the associated costs of recruiting participants. Motivated by the importance of research transparency and replicability of results, this article focuses on the challenges of such an approach. It provides methodological details, recommendations, lessons learned and limitations based on our experience of setting up experiments for eight search engines (including main, news, image and video sections) with hundreds of virtual agents placed in different regions. We demonstrate the successful performance of our research infrastructure across multiple data collections, with diverse experimental designs, and point to different changes and strategies that improve the quality of the method. We conclude that virtual agents are a promising venue for monitoring the performance of algorithms across long periods of time, and we hope that this article can serve as a basis for further research in this area.

30 November 2022 in Memory Studies
Verified
Journal Article
Open access
MMMykola Makrotykh
Mykola Makrotykh
AUAleksandra Urman
Aleksandra Urman
RURoberto Ulloa
Roberto Ulloa
Search engines, such as Google or Yandex, shape social reality by informing their users about current and historical phenomena. However, there is little research on how search engines deal with contested memories, which are subjected to ontological conflicts known as memory wars. In this article, we investigate how search engines circulate information about memory wars related to the Holodomor, a mass famine caused by Soviet repressive politics in Ukraine in 1932–1933. For this aim, we conduct an agent-based audit of four search engines—Bing, DuckDuckGo, Google, and Yandex—and examine how their top search results represent the Holodomor and related memory wars. Our findings demonstrate that search engines prioritize interpretations of the Holodomor aligning with specific sides in the memory wars, thus becoming memory warriors themselves.

19 June 2022 in New Media & Society
Verified
Journal Article
Open access
RURoberto Ulloa
Roberto Ulloa
ARAna Carolina Richter
Ana Carolina Richter
MMMykola Makrotykh
Mykola Makrotykh
AUAleksandra Urman
Aleksandra Urman
CKCelina Sylwia Kacperski
Celina Sylwia Kacperski
Implicit and explicit gender biases in media representations of individuals have long existed. Women are less likely to be represented in gender-neutral media content (representation bias), and their face-to-body ratio in images is often lower (face-ism bias). In this article, we look at representativeness and face-ism in search engine image results. We systematically queried four search engines (Google, Bing, Baidu, Yandex) from three locations, using two browsers and in two waves, with gender-neutral (person, intelligent person) and gendered (woman, intelligent woman, man, intelligent man) terminology, accessing the top 100 image results. We employed automatic identification for the individual’s gender expression (female/male) and the calculation of the face-to-body ratio of individuals depicted. We find that, as in other forms of media, search engine images perpetuate biases to the detriment of women, confirming the existence of the representation and face-ism biases. In-depth algorithmic debiasing with a specific focus on gender bias is overdue.

6 March 2023 in New Media & Society
Verified
Journal Article
Open access
RURoberto Ulloa
Roberto Ulloa
CKCelina Sylwia Kacperski
Celina Sylwia Kacperski
While individuals’ trust in search engine results is well-supported, little is known about their preferences when selecting news. We use web-tracked behavioral data across a 2-month period (280 participants) and we analyze three competing factors, two algorithmic (ranking and representativeness) and one psychological (familiarity), that could influence the selection of search results. We use news engagement as a proxy for familiarity and investigate news articles presented on Google search pages ( n = 1221). We find a significant effect of algorithmic factors but not of familiarity. We find that ranking plays a lesser role for news compared to non-news, suggesting a more careful decision-making process. We confirm that Google Search drives individuals to unfamiliar sources, and find that it increases the diversity of the political audience of news sources. We tackle the challenge of measuring social science theories in contexts shaped by algorithms, demonstrating their leverage over the behaviors of individuals.