Smart Kitchen: A Multi-Modal AR System

Serge Belongie, Andrew Mendez, Zexi Liu, Eric Jui-Chun Chien

Publikation: AndetUdgivelser på nettet - Net-publikationForskningpeer review

Abstract

Augmented Reality(AR) is a novel technology that will revolutionize how we work, learn, and play. AR utilizes computer vision, computer graphics, spatial and tangible interaction to augment our perception and understanding of the environment. As academia and industry are improving computer vision and computer graphics methods to facilitate better AR use, current display technologies, such as mobile and projector-camera (Pro-Cam) hinder its widespread adoption and usefulness due to considerable usability challenges. We propose a novel multi-modal AR system that combines both mobile and pro-cam display technologies. By combining mobile and pro-cam systems will not only remove each displays limitations, but complement each others usability strengths to provide longer, higher fidelity AR usage. We apply this contribution in the form of a smart kitchen application, that allows users to be provided instant cooking recommendations and intuitive instructions to prepare dishes. We evaluate our system on several participants, and discuss the potential this system brings for widespread adoption of AR.
OriginalsprogEngelsk
Publikationsdato2017
Antal sider10
StatusUdgivet - 2017
Udgivet eksterntJa

Citationsformater