Yoko Yamakata

Prof. Yoko Yamakata

orcid

Research Focus & Metrics

Academic Career Length

12Years (2015-Present)

(Calculated once Scilit publication data is synced: current year − year of first publication + 1)

Representative Publications

View All Publications
10 October 2022
Verified
Conference Paper
Open access
YYYoko Yamakata
Yoko Yamakata
AIAkihisa Ishino
Akihisa Ishino
ASAkiko Sunto
Akiko Sunto
SASosuke Amano
Sosuke Amano
KAKiyoharu Aizawa
Kiyoharu Aizawa
We propose a recipe-oriented food logging method that records food by recipe, unlike the ordinary food logging method that records food by name. We also develop an application RecipeLog for this purpose. RecipeLog can create a "skeleton recipe," which is a standardized recipe representation suitable for estimating the nutritional value of a dish. This is represented by a list of ingredients linked to a Nutrition Facts table and a flow graph consisting of cooking actions such as cutting, mixing, baking, simmering, and frying the ingredients. The recipe log allows recipes to be written with fewer operations by editing only the differences from the already registered base recipe. Experiments have confirmed that the recipe log can effectively identify differences in recipes from household to household. The future work is to construct a multimedia recipe dataset consisting of structured recipes and their images using RecipeLog.

6 December 2023
Verified
Conference Paper
Open access
SPSatayu Parinayok
Satayu Parinayok
YYYoko Yamakata
Yoko Yamakata
KAKiyoharu Aizawa
Kiyoharu Aizawa
Nutrition plays a vital role in overall health and well-being. With a highly accurate nutrient estimation model, we develop a tool that displays nutritional values from food images, thereby reducing the labor-intensiveness of dietary assessment. We propose a method that uses depth data with RGB images and incorporates an open-vocabulary segmentation process that separates food from non-food instances, coupled with two-stage self-attention Transformer decoder. Our model outperforms the current state-of-the-art method, with an average percent MAE of 17.2% on Nutrition5k, an RGB-D food image dataset with calories, mass, and three macronutrients annotated. Our study also focuses on the significance of the food and background regions for calorie, mass, and nutrient estimation. We analyze the impact of non-food regions on each estimation task, with results suggesting that background information is crucial for calorie, mass, and carbohydrate estimation but not as essential for protein and fat estimation. The qualitative results also show that the model attends to regions with a high corresponding nutritional value. Implementation codes and pre-trained models are provided at https://github.com/Oatsty/nutrition5k.

1 June 2015
Verified
Conference Paper
Closed access
TKTakuya Kadowaki
Takuya Kadowaki
YYYoko Yamakata
Yoko Yamakata
KTKatsumi Tanaka
Katsumi Tanaka
We propose a method for finding such foods that yield good results to a user based on the user's situation and showing the recommending foods with the evidence of the foods yielding good results so that the user is convinced to choose the food. We focus on the following problems: (1) existing recommendation systems only focus on “who chooses what” but people is not always able to select the best one which yields good result; (2) even though the proposed method finds the suitable foods, it is not sufficient to simply recommend them because users cannot understand why the foods are good. To address these problems, we construct a model by analyzing food related tweets on the Twitter. In our experiments, we demonstrate that the proposed method successfully avoided recommending a food which yields a bad result and providing evidence in addition to the recommendation foods is beneficial for decision making of food.

21 August 2021
Verified
Conference Paper
Open access
ARAli Rostami
Ali Rostami
ZXZhouhang Xie
Zhouhang Xie
AIAkihisa Ishino
Akihisa Ishino
YYYoko Yamakata
Yoko Yamakata
KAKiyoharu Aizawa
Kiyoharu Aizawa
RJRamesh Jain
Ramesh Jain
A coronavirus pandemic is forcing people to be "at home" all over the world. In a life of hardly ever going out, we would have realized how the food we eat affects our bodies. What can we do to know our food more and control it better? To give us a clue, we are trying to build a World Food Atlas (WFA) that collects all the knowledge about food in the world. In this paper, we present two of our trials. The first is the Food Knowledge Graph (FKG), which is a graphical representation of knowledge about food and ingredient relationships derived from recipes and food nutrition data. The second is the FoodLog Athl and the RecipeLog that are applications for collecting people's detailed records about food habit. We also discuss several problems that we try to solve to build the WFA by integrating these two ideas.

10 October 2022
Verified
Conference Paper
Open access
KNKei Nakamoto
Kei Nakamoto
SASosuke Amano
Sosuke Amano
HKHiroaki Karasawa
Hiroaki Karasawa
YYYoko Yamakata
Yoko Yamakata
KAKiyoharu Aizawa
Kiyoharu Aizawa
Diet is a very important factor in people's health management. Applications that record photos of meals and help people manage their diets are used by many users every day. In many cases, such applications use images just to estimate meals and calories. We propose a further use of diet images. The new idea is to read changes in mental health, such as stress and well-being, from the diet image over some period of time. If the applications can recognize the signs of mental health changes that dietary records give, they will be more useful as health management applications. The two contributions of this paper are that we have created a dataset consisting of 24,644 meal items dietary record and mental health records for the same time period(over a 3-month period), and that we have shown that changes in mental health are correlated with changes in diet, and especially, the correlation is stronger in groups with greater change. The potential and goal of this study are to extract features from the images of meals related to mental health.

28 October 2024
Verified
Conference Paper
Open access
LWLiangyu Wang
Liangyu Wang
YYYoko Yamakata
Yoko Yamakata
RMRyoma Maeda
Ryoma Maeda
KAKiyoharu Aizawa
Kiyoharu Aizawa
We developed an application that can easily calculate the nutritional content of a meal by utilizing our multimedia recipe dataset tied to the Nutrition Facts table and an ingredient estimation model. A CLIP-based image recognition model and an ingredient co-occurrence graph assist a user in selecting the appropriate ingredient from over 2,500 ingredients. Unlike traditional food applications, ours calculates nutrition from a list of ingredients, allowing the user to see how each ingredient affects the overall nutrition. The user adjusts the amount of each ingredient and knows how to change their meal to meet their body's needs.