With the widespread availability and pervasiveness of artificial intelligence (AI) in many application areas across the globe, the role of crowdsourcing has seen an upsurge in terms of importance for scaling up data-driven algorithms in rapid cycles through a relatively low-cost distributed workforce or even on a volunteer basis. However, there is a lack of systematic and empirical examination of the interplay among the processes and activities combining crowd-machine hybrid interaction. To uncover the enduring aspects characterizing the human-centered AI design space when involving ensembles of crowds and algorithms and their symbiotic relations and requirements, a Computer-Supported Cooperative Work (CSCW) lens strongly rooted in the taxonomic tradition of conceptual scheme development is taken with the aim of aggregating and characterizing some of the main component entities in the burgeoning domain of hybrid crowd-AI centered systems. The goal of this article is thus to propose a theoretically grounded and empirically validated analytical framework for the study of crowd-machine interaction and its environment. Based on a scoping review and several cross-sectional analyses of research studies comprising hybrid forms of human interaction with AI systems and applications at a crowd scale, the available literature was distilled and incorporated into a unifying framework comprised of taxonomic units distributed across integration dimensions that range from the original time and space axes in which every collaborative activity take place to the main attributes that constitute a hybrid intelligence architecture. The upshot is that when turning to the challenges that are inherent in tasks requiring massive participation, novel properties can be obtained for a set of potential scenarios that go beyond the single experience of a human interacting with the technology to comprise a vast set of massive machine-crowd interactions.

Recently, citizen involvement has been increasingly used in urban disaster prevention and management, taking advantage of new ubiquitous and collaborative technologies. This scenario has created a unique opportunity to leverage the work of crowds of volunteers. As a result, crowdsourcing approaches for disaster prevention and management have been proposed and evaluated. However, the articulation of citizens, tasks, and outcomes as a continuous flow of knowledge generation reveals a complex ecosystem that requires coordination efforts to manage interdependencies in crowd work. To tackle this challenging problem, this paper extends to the context of urban emergency management the results of a previous study that investigates how crowd work is managed in crowdsourcing platforms applied to urban planning. The goal is to understand how crowdsourcing techniques and quality control dimensions used in urban planning could be used to support urban emergency management, especially in the context of mining-related dam outages. Through a systematic literature review, our study makes a comparison between crowdsourcing tools designed for urban planning and urban emergency management and proposes a five-dimension typology of quality in crowdsourcing, which can be leveraged for optimizing urban planning and emergency management processes.

With the increasing development of human-AI teaming structures within and across geographies, the time is ripe for a continuous and objective look at the predictors, barriers, and facilitators of human-AI scientific collaboration from a multidisciplinary point of view. This paper aims at contributing to this end by exploiting a set of factors affecting attitudes towards the adoption of human-AI interaction into scientific work settings. In particular, we are interested in identifying the determinants of trust and acceptability when considering the combination of hybrid human-AI approaches for improving research practices. This includes the way as researchers assume human-centered artificial intelligence (AI) and crowdsourcing as valid mechanisms for aiding their tasks. Through the lens of a unified theory of acceptance and use of technology (UTAUT) combined with an extended technology acceptance model (TAM), we pursue insights on the perceived usefulness, potential blockers, and adoption drivers that may be representative of the intention to use hybrid intelligence systems as a way of unveiling unknown patterns from large amounts of data and thus enabling novel scientific discoveries.

Human-Computer Interaction (HCI) research has illuminated how technology can influence users’ awareness of their environmental impact and the potential for mitigating these impacts. From hot water saving to food waste reduction, researchers have systematically and widely tried to find pathways to speed up achieving sustainable development goals through persuasive technology interventions. However, motivating users to adopt sustainable behaviors through interactive technologies presents significant psychological, cultural, and technical challenges in creating engaging and long-lasting experiences. Aligned with this perspective, there is a dearth of research and design solutions addressing the use of persuasive technology to promote sustainable recycling behavior. Guided by a participatory design approach, this investigation focuses on the design opportunities for leveraging persuasive and human-centered Internet of Things (IoT) applications to enhance user engagement in recycling activities. The assumption is that one pathway to achieve this goal is to adopt persuasive strategies that may be incorporated into the design of sustainable applications. The insights gained from this process can then be applied to various sustainable HCI scenarios and therefore contribute to HCI’s limited understanding in this area by providing a series of design-oriented research recommendations for informing the development of persuasive and socially engaged recycling platforms. In particular, we advocate for the inclusion of educational content, real-time interactive feedback, and intuitive interfaces to actively engage users in recycling activities. Moreover, recognizing the cultural context in which the technology is socially situated becomes imperative for the effective implementation of smart devices to foster sustainable recycling practices. To this end, we present a case study that seeks to involve children and adolescents in pro-recycling activities within the school environment.

Visualizing and examining the intellectual landscape and evolution of scientific communities to support collaboration is crucial for multiple research purposes. In some cases, measuring similarities and matching patterns between research publication document sets can help to identify people with similar interests for building research collaboration networks and university–industry linkages. The premise of this work is assessing feasibility for resolving ambiguous cases in similarity detection to determine authorship with natural language processing (NLP) techniques so that crowdsourcing is applied only in instances that require human judgment. Using an NLP-crowdsourcing convergence strategy, we can reduce the costs of microtask crowdsourcing while saving time and maintaining disambiguation accuracy over large datasets. This article contributes a next-gen crowd-artificial intelligence framework that used an ensemble of term frequency-inverse document frequency and bidirectional encoder representation from transformers to obtain similarity rankings for pairs of scientific documents. A sequence of content-based similarity tasks was created using a crowd-powered interface for solving disambiguation problems. Our experimental results suggest that an adaptive NLP-crowdsourcing hybrid framework has advantages for inter-researcher similarity detection tasks where fully automatic algorithms provide unsatisfactory results, with the goal of helping researchers discover potential collaborators using data-driven approaches.