We present Sophia-in-Audition (SiA), a new frontier in virtual production, by employing the humanoid robot Sophia within an UltraStage environment composed of a controllable lighting dome coupled with multiple cameras. We demonstrate Sophia's capability to replicate iconic film segments, follow real performers, and perform a variety of motions and expressions, showcasing her versatility as a virtual actor. Key to this process is the integration of facial motion transfer algorithms and the UltraStage's controllable lighting and multi-camera setup, enabling dynamic performances that align with the director's vision. Our comprehensive user studies indicate positive audience reception towards Sophia's performances, highlighting her potential to reduce the uncanny valley effect in virtual acting. Additionally, the immersive lighting in dynamic clips was highly rated for its naturalness and its ability to mirror professional film standards. The paper presents a first-of-its-kind multi-view robot performance video dataset with dynamic lighting, offering valuable insights for future enhancements in humanoid robotic performers and virtual production techniques. This research contributes significantly to the field by presenting a unique virtual production setup, developing tools for sophisticated performance control, and providing a comprehensive dataset and user study analysis for diverse applications.
We present Meaningful, Contextual, Media, a three-axis design space for personal memory that treats memory media materials as design resources. Through a co-design study that paired a cross-media outing with a structured workshop, 15 participants selected five media materials from a shared toolkit and recorded 6 to 10 memory nodes during a half-day outing. In the workshop, participants revisited their records and produced group rankings of sensitizing points, route recall timelines, and individual mapping sheets that linked artifacts to points. We applied thematic analysis to distill media signatures and organized them into the three axes. We then created full-color transparent 3D printed memory tokens as probes to explore and extend a distinctive region of the space. The probes surfaced design moves around curation, disclosure, and fabrication friction that can strengthen memory experiences. We contribute a practice-grounded design space, an artifact-based comparative workflow, and implications for future memory-related design.