Digital archives of memory institutions are typically concerned with the cataloguing of artefacts of artistic, historical, and cultural value. Recently, new forms of citizen participation in cultural heritage have emerged, producing a wealth of material spanning from visitors’ experiential feedback on exhibitions and cultural artefacts to digitally mediated interactions like the ones happening on social media platforms. Citizen curation is proposed in the context of the European project SPICE (Social Participation, Cohesion, and Inclusion through Cultural Engagement) as a methodology for producing, collecting, interpreting, and archiving people’s responses to cultural objects, with the aim of favouring the emergence of multiple, sometimes conflicting, viewpoints and motivating users and memory institutions to reflect upon them. We argue that citizen curation urges to rethink the nature of computational infrastructures supporting data management of memory institutions, bringing novel challenges that include issues of distribution, authoritativeness, interdependence, privacy, and rights management. To approach these issues, we survey relevant literature toward a distributed, Linked Data infrastructure, with a focus on identifying the roles and requirements involved in such an infrastructure. We show how existing research can contribute significantly in facing the challenges raised by citizen curation and discuss challenges and opportunities from the socio-technical standpoint.
This contribution analyzes the impact of factors related to story structure, meaningfulness, and concentration in the design of Serious Games. To explore them, the authors carried out an experimental evaluation aiming to identify relevant aspects affecting the cognitive-emotional impact of immersive Virtual Reality (VR), specifically Educational Environmental Narrative (EEN) Games. The experiment was designed around three main research questions: if passive or active interaction is preferable for factual and spatial knowledge acquisition; whether meaningfulness is a relevant experience in a serious game (SG) context; and if concentration impacts knowledge acquisition and engagement also in VR educational games. The findings highlight that passive interaction should only be encouraged for factual knowledge acquisition, that meaningfulness is a relevant experience and should be included in serious game design, and, finally, that concentration is a factor that impacts the experience in immersive games. The authors discuss potential design paths to improve both factual and spatial knowledge acquisition, such as abstract concept-oriented design, concluding that SGs should contain game mechanics explicitly supporting players’ moments of reflection, and story structures explicitly aligned to educational facts.
1 November 2023 in International Journal of Digital Humanities
In an era of information abundance and visual saturation, the need for resources to organise and access the vast expanse of visual data is paramount. Abstract concepts-such as comfort, power, or freedom-emerge as potent instruments to index and manage visual data, particularly in contexts like Cultural Heritage (CH). However, the variance and disparity in the visual signals that evoke a single abstract concept challenge conventional approaches to automatic visual management rooted in the Computer Vision (CV) field. This paper critically engages with the prevalent trend of automating high-level visual reasoning while placing exclusive reliance on visual signals, prominently featuring Convolutional Neural Networks (CNNs). We delve into this trend, scrutinising the knowledge sought by CNNs and the knowledge they ultimately encapsulate. In this endeavour, we accomplish three main objectives: (1) introduction of ARTstract, an extensive dataset encompassing cultural images that evoke specific abstract concepts; (2) presentation of baseline model performances on ARTstract to elucidate the intricate nuances of image classification based on abstract concepts; and, critically, (3) utilization of ARTstract as a case study to explore both traditional and non-traditional avenues of visual interpretability, a trajectory inspired by Offert and Bell (2021). To more comprehensively understand how CNNs assimilate and reflect cultural meanings, and to discern the echoes reverberating within these visions, we unveil SD-AM, a novel approach to explainability that collapses visuals into hypericon images through a fusion of feature visualization techniques and Stable Diffusion denoising. Overall, this study critically addresses abstract concept image classification’s challenges within the CNN paradigm. By embracing innovative methodologies and providing comprehensive analyses of explainability techniques, we make a substantial contribution to the broader discourse surrounding automatic high-level visual understanding, its interpretability, and the ensuing implications for comprehending culture within the digital era. Through our exploration, we illuminate the multifaceted trends, complexities, and opportunities that underlie the fusion of high-level visual reasoning and computer vision.
Delving into the intricate complexities of naming and categorizing the visual evocation of abstract concepts, this paper brings to light the limitations of relying on binary thinking to tackle these inherently intricate “wicked problems.” As computer vision applications rapidly expand, the pressing challenge of accurately labeling these abstract concepts in visual media comes into focus, necessitating a close examination of the interplay between visual data, nuanced cultural meanings, and artificial intelligence (AI). This work discusses the role these concepts play in automatic visual indexing, as well as the ways in which they expose how binary frameworks curtail technical performance and perpetuate power dynamics. To address this, the paper draws upon insights from recent cognitive neuroscience research and advocates for a more comprehensive, queer, and situated understanding of these concepts. This approach highlights the significance of humanistic and ethical perspectives in shaping the trajectory of AI development.