Every human culture has developed practices and rituals associated with remembering people of the past - be it for mourning, cultural preservation, or learning about historical events. In this paper, we present the concept of “Living Memories”: interactive digital mementos that are created from journals, letters and data that an individual have left behind. Like an interactive photograph, living memories can be talked to and asked questions, making accessing the knowledge, attitudes and past experiences of a person easily accessible. To demonstrate our concept, we created an AI-based system for generating living memories from any data source and implemented living memories of the three historical figures “Leonardo Da Vinci”, “Murasaki Shikibu”, and “Captain Robert Scott”. As a second key contribution, we present a novel metrics scheme for evaluating the accuracy of living memory architectures and show the accuracy of our pipeline to improve over baselines. Finally, we compare the user experience and learning effects of interacting with the living memory of Leonardo Da Vinci to reading his journal. Our results show that interacting with the living memory, in addition to simply reading a journal, increases learning effectiveness and motivation to learn about the character.
Recent advancements in generative AI have led to the development of powerful models capable of generating full-length, professional-sounding music from brief text prompts. These models have also sparked concerns among artists who feel their creative roles are being overshadowed. To address this issue, we propose the development of AI-augmented instruments, defined as generative AI systems embedded within musical instruments, that provide artists with extensive control and responsiveness to real-time musical inputs while harnessing the capability of powerful AI models. Through a thorough definition of virtuosity, we explore how these AI-augmented instruments can exhibit virtuosic qualities, serve as collaborative partners, and enable artists to attain a new form of virtuosity, which we call ‘symbiotic virtuosity.’ Furthermore, we present a set of guidelines for effectively communicating the AI’s capabilities to live audiences. To exemplify our reflections, we delve into our collaboration with Grammy-winning keyboardist Jordan Rudess, which resulted in a pioneering AI–human co-created demonstrative performance that was held at the MIT Media Lab in April 2024.