Ayaka Sato
Jun Rekimoto
ABSTRACT
Referring to documents is common when making things, but there is a difficulty caused by the gap between a written description and the actual context of making. For example, when cooking following a recipe, people may lose their current position in the recipe, misunderstand the required amount of ingredients because of complicated measuring units, or skip steps by mistake. We address these problems by selecting cooking as our domain. Our proposed cooking support system, MimiCook, embodies a recipe in a real kitchen counter and directly navigates a user. The system consists of a computer, a depth camera, a projector, and a scaling device. It displays step-by-step instructions directly onto the utensils and ingredients, and controls the guidance display in accordance with the user's situations. The integrated scaling device also helps users to avoid mistakes with measuring units. Results of our user study shows participants found it easier to cook with the system and even subjects who had never cooked the assigned recipe did not make any mistakes.
- Chi, P.-Y., Chen, J.-H., Chu, H.-H., Lo, J.-L. Enabling calorie-aware cooking in a smart kitchen. In Proc. PERSUASIVE '08 (2008), 116--127. Google Scholar
Digital Library
- Doman, K., Kuai, C.-Y., Takahashi, T., Ide, I., Murase, H. Video cooking: towards the synthesis of multimedia cooking recipes. In Proc. MMM '11 (2011), 135--145. Google ScholarDigital Library
- Hamaoka, R., Okabe, J., Ide, I., Satoh, S., Sakai, S., Tanaka, H. Cooking navi: assistant for daily cooking in kitchen. In Proc. ACM Multimedia (2005), 371--374. Google ScholarDigital Library
- Hooper C, J. Preston, A., Balaam, M., Seedhouse, P., Jackson, D., Pham, C., Ladha, C., Ladha, K., Plötz, T., Olivier, P. The French Kitchen: Task-Based Learning in an Instrumented Kitchen, In Proc. UbiComp '12, ACM Press (2012), 193--202. Google ScholarDigital Library
- Ikeda, S., Asghar, Z., Hyry, J., Pulli, P., Pitkanen, A., Kato, H. Remote assistance using visual prompts for demented elderly in cooking. In Proc. ISABEL '11. ACM Press (2011), 1--5. Google ScholarDigital Library
- Ji, Y., Ko, Y., Shimada, A., Nagahara, H., Taniguchi, R. Cooking gesture recognition using local feature and depth image, In Proc. CEA '12, ACM Press (2012), 34--42. Google ScholarDigital Library
- Ju, W. Hurwitz, R., Judd, T., Lee, B. Counteractive: An Interactive Cookbook for the Kitchen Counter. In Proc. CHI EA '01 (2011), 269--270. Google ScholarDigital Library
- Lei, J., Ren, X. and Fox, D. Fine-grained kitchen activity recognition using RGB-D, In Proc. UbiComp '12, AMC Press (2012), 208--211. Google ScholarDigital Library
- Mennicken, S., Karrer, T., Russell, P., Borchers, J. First-person cooking: a dual-perspective interactive kitchen counter. In CHI EA '10 (2010), 3403--3408. Google ScholarDigital Library
- Siio, I., Mima, N., Frank, I., Ono, T., Weintraub, H. Making recipes in the kitchen of the future. In Proc. CHI EA '01, ACM Press (2004), 1554--1554. Google ScholarDigital Library
- Suzuki, Y., Morioka, S., Ueda, H, Cooking Support with Information Projection onto Ingredient. In Proc. APCHI '12, ACM Press (2012), 193--198. Google ScholarDigital Library
- Terrenghi, L., Hilliges, O., Butz, A. Kitchen stories: sharing recipes with the Living Cookbook. Personal and Ubiquitous Computing, June 2007, Volume 11, Issue 5, 409--414. Google ScholarDigital Library
- Tran, Q. T., Calcaterra, G., Mynatt, E. D. Cook's Collage: Deja vu display for a home kitchen. In Proc. HOIT 2005, 15--32.Google Scholar
- Uriu, D., Namai, M., Tokuhisa, S., Kashiwagi, S., Inami, M., Okude, N. Experience "panavi,": challenge to master professional culinary arts. In Proc. CHI '12, ACM Press (2012), 1445--1446. Google ScholarDigital Library
- Ziola, R., Grampurohit, S., Nate, L., Fogarty, J., Harrison, B. OASIS: Creating Smart Objects with Dynamic Digital Behavior, Workshop at IUI 2011.Google Scholar
Index Terms
- MimiCook: a cooking assistant system with situated guidance
Recommendations
Shadow Cooking: Situated Guidance for a Fluid Cooking Experience
Proceedings of the 8th International Conference on Universal Access in Human-Computer Interaction. Aging and Assistive Environments - Volume 8515Cooking is one of the most popular activities at home; however, preparing a new dish by reading a recipe is not a trivial task. People might lose their current position in the recipe, misunderstand the required amount of ingredients, and generally ...
Digital Gastronomy: Methods & Recipes for Hybrid Cooking
UIST '16: Proceedings of the 29th Annual Symposium on User Interface Software and TechnologySeveral recent projects have introduced digital machines to the kitchen, yet their impact on culinary culture is limited. We envision a culture of Digital Gastronomy that enhances traditional cooking with new interactive capabilities, rather than ...
CookTab: smart cutting board for creating recipe with real-time feedback
UbiComp '12: Proceedings of the 2012 ACM Conference on Ubiquitous ComputingAlthough many cooking recipes have been shared in the world, there are still many homemade meals that are never written down as recipes. The difficulty to create recipes of such homemade meals lies on (1) experienced cookers might not have accurate ...
Comments