We introduce Augmented Physics, a machine learning-integrated authoring tool designed for creating embedded interactive physics simulations from static textbook diagrams. Leveraging recent advancements in computer vision, such as Segment Anything and Multi-modal LLMs, our web-based system enables users to semi-automatically extract diagrams from physics textbooks and generate interactive simulations based on the extracted content. These interactive diagrams are seamlessly integrated into scanned textbook pages, facilitating interactive and personalized learning experiences across various physics concepts, such as optics, circuits, and kinematics. Drawing from an elicitation study with seven physics instructors, we explore four key augmentation strategies: 1) augmented experiments, 2) animated diagrams, 3) bi-directional binding, and 4) parameter visualization. We evaluate our system through technical evaluation, a usability study (N=12), and expert interviews (N=12). Study findings suggest that our system can facilitate more engaging and personalized learning experiences in physics education.
Foam is a soft, malleable, and highly deformable substrate suited for creating interactive devices. However, prior work has mostly focused on deformation sensing by dipping foam in conductive inks. We present the first exploration of printing high-resolution functional patterns on foam, enabling multifunctional interactive devices beyond deformation sensing. Due to foam’s porosity, printing precise patterns is challenging as inks tend to seep through. Through systematic exploration, we contribute the formulation of functional inks with minimal seepage, low-temperature curing, and easy lab preparation. We then contribute the fabrication of biochemical sensors, electrotactile devices, and deformation sensors. Technical and user evaluations show FabFoam’s glucose sensors detect sweat glucose at an activation voltage of 0.45 V, with a sensitivity of 2.74 µA/µM and a resolution of 4.67 µM. FabFoam tactile devices deliver perceivable electrotactile feedback, and our technique supports a minimum patterning resolution of 0.5 mm spacing and 1 mm trace width across foam types. We present a set of application scenarios demonstrating the versatility of FabFoam.