In this study, an earphone-type interface named “earable TEMPO” was developed for hands-free operation, wherein the user can control the device by simply pushing the tongue against the roof of the mouth for about one second. This interface can be used to start and stop the music from a portable audio player. The earable TEMPO uses an earphone-type sensor equipped with a light emitting diode (LED) and a phototransistor to optically measure shape variations that occur in the external auditory meatus when the tongue is pressed against the roof of the mouth. To evaluate the operation of the earable TEMPO, experiments were performed on five subjects (men and women aged 22–58) while resting, chewing gum (representing mastication), and walking. The average accuracy was 100% while resting and chewing and 99% while walking. The precision was 100% under all conditions. The average recall value of the five subjects was 92%, 90%, and 48% while resting, masticating, and walking, respectively. All subjects were reliably able to perform the action of pressing the tongue against the roof of the mouth. The measured shape variations in the ear canal were highly reproducible, indicating that this method is suitable for various applications such as controlling a portable audio player.

Gastric cancer patients having undergone gastrectomy are at a high risk of becoming malnourished owing to decreased gastric function. To prevent malnutrition, patients need to thoroughly chew a mouthful of food at least 30 times. For these gastrectomy patients requiring dietary support, we developed a chewing-count measurement device named earable RCC using an earphone-type sensor. Experiments to evaluate the performance of this device were conducted on six healthy volunteers who participated in “gum-chewing tests” and “almond-eating tests.” The precision calculated based on the results was ≥0.958, indicating that the earphone-type chewing-count measurement device could experimentally distinguish chewing from other actions. In addition, the recall calculated from the test results was ≥0.937, showing that the device does not miss chewing actions and can accurately count the number of chews with high probability at the timing of chewing. The experimental results also imply that earphone-type sensors may be used to measure swallowing, occlusal force, and tongue motion. Our future plans include clinical testing of the earphone-type chewing-count measurement device to determine its utility in patients who have undergone gastrectomy. We also intend to expand the application of this device for use in other patients to aid in dementia prevention and dietary support.

In this study, we describe a technique for estimating meal times using an earphone-type wearable sensor. A small optical sensor composed of a light-emitting diode and phototransistor is inserted into the ear hole of a user and estimates the meal times of the user from the time variations in the amount of light received. This is achieved by emitting light toward the inside of the ear canal and receiving light reflected back from the ear canal. This proposed technique allowed “meals” to be differentiated from having conversations, sneezing, walking, ascending and descending stairs, operating a computer, and using a smartphone. Conventional devices worn on the head of users and that measure food intake can vibrate during running as the body is jolted more violently than during walking; this can result in the misidentification of running as eating by these devices. To solve this problem, we used two of our sensors simultaneously: one in the left ear and one in the right ear. This was based on our finding that measurements from the left and right ear canals have a strong correlation during running but no correlation during eating. This allows running and eating to be distinguished based on correlation coefficients, which can reduce misidentification. Moreover, by using an optical sensor composed of a semiconductor, a small and lightweight device can be created. This measurement technique can also measure body motion associated with running, and the data obtained from the optical sensor inserted into the ear can be used to support a healthy lifestyle regarding both eating and exercise.

We intend to develop earphone-type wearable devices to measure occlusal force by measuring ear canal movement using an ear sensor that we developed. The proposed device can measure occlusal force during eating. In this work, we simultaneously measured the ear canal movement (ear sensor value), the surface electromyography (EMG) of the masseter muscle and the occlusal force six times from five subjects as a basic study toward occlusal force meter development. Using the results, we investigated the correlation coefficient between the ear sensor value and the occlusal force, and the partial correlation coefficient between ear sensor values. Additionally, we investigated the average of the partial correlation coefficient and the absolute value of the average for each subject. The absolute value results indicated strong correlation, with correlation coefficients exceeding 0.9514 for all subjects. The subjects showed a lowest partial correlation coefficient of 0.6161 and a highest value of 0.8286. This was also indicative of correlation. We then estimated the occlusal force via a single regression analysis for each subject. Evaluation of the proposed method via the cross-validation method indicated that the root-mean-square error when comparing actual values with estimates for the five subjects ranged from 0.0338 to 0.0969.

We have carried out research and development on an earphone-type respiratory rate measuring device, earable POCER. The name earable POCER is a combination of “earable”, which is a word coined from “wearable” and “ear”, and “POCER”, which is an acronym for “point-of-care ear sensor for respiratory rate measurement”. The earable POCER calculates respiratory frequency, based on the measurement values over one minute, through the simple attachment of an ear sensor to one ear of the measured subject and displays these on a tablet terminal. The earable POCER irradiates infrared light using a light-emitting diode (LED) loaded on an ear sensor to the epidermis within the ear canal and, by receiving that reflected light with a phototransistor, it measures movement of the ear canal based on respiration. In an evaluation experiment, eight healthy subjects first breathed through the nose 12 times per minute, then 16 times per minute, and finally 20 times per minute, in accordance with the flashing of a timing instruction LED. The results of these evaluation tests showed that the accuracy of the respiratory frequency was 100% for nose breathing 12 times per minute, 93.8% at 16 times, and 93.8% at 20 times.

Single-incision laparoscopic surgery (SILS) brings cosmetic benefits for patients, but this procedure is more difficult than laparoscopic surgery. In order to reduce surgeons’ burden, we have developed a master-slave robot system which can provide robot-assisted SILS as if it were performing conventional laparoscopic surgery and confirmed the feasibility of our proposed system. The proposed system is composed of an input device (master side), a surgical robot system (slave side), and a control PC. To perform SILS in the same style as regular laparoscopic surgery, input instruments are inserted into multiple incisions, and the tip position and pose of the left-sided (right-sided) robotic instrument on the slave side follow those of the right-sided (left-sided) input instruments on the master side by means of a control command from the PC. To validate the proposed system, we defined four operating conditions and conducted simulation experiments and physical experiments with surgeons under these conditions, then compared the results. In the simulation experiments, we found learning effects between trials (P = 0.00013 < 0.05). Our proposed system had no significant difference from a condition simulating classical laparoscopic surgery (P = 0.23 > 0.1), and the task time of our system was significantly shorter than the simulated SILS (P = 0.011 < 0.05). In the physical experiments, our system performed SILS more easily, efficiently, and intuitively than the other operating conditions. Our proposed system enabled the surgeons to perform SILS as if they were operating conventionally with laparoscopic techniques.