Sounds play a crucial role in shaping dining experiences. Recently, designers have increasingly integrated them into interfaces that connect diners with food. Yet, little is known about how sounds can function as culinary materials to enrich chefs’ creativity, particularly in creating meaningful auditory interactions that resonate with their culinary creations. Hence, we present GastroConcerto, an auditory dining system that combines a magnetic contact microphone equipped under the plate with a companion mobile application. This system delves into the interactive space between diners and their food to introduce a novel interactive mechanism of dining–sound pairing, enabling chefs to design specific auditory interactions that respond to diners’ individual interactions with the food on dining containers. Through a within-subjects study and field deployment, we examined how GastroConcerto enriches chefs’ creative practices in crafting "sonic dish" experiences. Ultimately, our goal is to shift the ownership of auditory interaction design from interface designers to chefs, thereby supporting their culinary creativity.
Sound plays a crucial role in shaping eating experiences and sensory perception. This has drawn increasing attention from the HCI community to use sound as a means to enrich chefs’ culinary creativity. However, ownership over sound creation has remained with interaction designers or restaurateurs, overlooking how sound can represent chefs’ authentic culinary expressions. With the advancements of human–AI sound co-creation, contemporary AI models allow users to modify various inputs (e.g., modality, parameters, and weights) to generate creative outputs. This process closely mirrors how chefs experiment with ingredients (e.g., combinations, proportions, and layers) to craft curated dining experiences. This parallel inspired us to explore the the opportunity for chefs to meaningfully reconfigure the sound within their dishes, aligning the auditory elements with their distinctive culinary vision. To demonstrate this, we created SoniFork, a fork-like system with capacitive sensing and sound-release capabilities, that lets chefs orchestrate real-time auditory experience via its companion app at each bite. This work repositions sound design ownership within the kitchen, supporting chefs’ culinary creativity through chef-AI sound co-creation.