We present FoodSkin, a technique for adding interactive elements to foods by implementing edible circuits on the surface of the food. The circuit is easily fabricated using commercially available materials. Existing approaches to enhance the eating experience, such as presenting an electrical taste by making food part of an electronic circuit, are challenging to apply to foods with low water content due to their low conductivity. Our technique enables the integration of dry foods into an electronic circuit and provides displaying (e.g., smell or taste) and sensing (e.g., eating activity) functionalities. We describe our fabrication technique with a library of food materials that we can utilize, evaluate the conductivity and adhesion of the gold-leaf traces, introduce demonstrative applications, and conclude with a workshop we conducted to evaluate the accessibility of our technique. FoodSkin enriches the design space for the computer-augmented eating experience by enabling the digital fabrication of electronics on versatile materials, surfaces, and shapes of foods.
We present ShiftTouch, an attachment-type passive interface that provides multiple inputs for capacitive touchscreens with minimal screen occlusion. ShiftTouch utilizes multiple linear electrodes to control the fine displacement of the touch position. The touch input is activated under the electrodes when several adjacent electrodes are grounded simultaneously. Each input area shares several electrodes with neighboring input areas, and the touchscreen identifies each one by detecting the fine displacement of the touch position. ShiftTouch can effectively reduce the occlusion area while inheriting the advantages of existing touch extension interfaces, which are battery-free, freely detachable, and easy to construct. Depending on the number of inputs to implement, ShiftTouch can alleviate screen occlusion by up to 80.5% compared to existing approaches using finger-sized electrodes.
This paper presents a novel approach for expanding one-handed interactions using the thumb positioned above the smartphone screen. Our approach is based on acoustic sensing, a technique for leveraging the built-in speaker and microphone of the smartphone without requiring additional sensors or attachments. We explored the feasibility of our approach on smartphones with the conventional speaker and microphone arrangement and investigated the enhancement of recognition accuracy by using smartphones equipped with Acoustic Surface, which is a technology enabling the entire screen to vibrate and emit sound over a wider area and installed in several commercial smartphones such as LG G8 ThinQ and Huawei P30 Pro. We focused on classifying 12 different thumb postures and developed models that achieve prediction accuracies of 78.6% (conventional smartphone) and 87.0% (Acoustic Surface).
To achieve mid-air interactions for smartphones, acoustic-sensing, a technique using the built-in speaker and microphone of smartphones, is promising. However, detecting hand poses on the near-surface of touchscreens remains challenging due to the arrangement of the built-in speaker and microphone. To address this, we present Acoustic+Pose, a novel approach for combining conventional touch interactions with near-surface hand-pose estimation to enable a wide range of interactions. We focused on smartphones incorporating Acoustic Surface, a technology that vibrates the entire smartphone screen to emit sound over a wide area. We used this technology to extend the input space to the near surface of touchscreens. We trained machine-learning models to recognize hand poses in the near-surface area and demonstrated interaction techniques to use the recognized poses for a new modality of smartphone input. Through an evaluation, we confirmed that the trained models recognized 10 hand poses with 90.2% accuracy.
25 June 2025 in International Journal of Human–Computer Interaction