The WizARd and Apprentice: An Augmented Reality Expert Capture System

/in /by

Publication Date: 10/25/2024

Event: The 23rd IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2024), Bellevue, WA

Reference: pp. 1-2, 2024

Authors: Ada Yi Zhao, University of Colorado Boulder; Suibi Che-Chuan Weng, University of Colorado Boulder; Ella Grace Finstuen, University of Colorado Boulder; Haifeng Chen, NEC Laboratories America, Inc.; Lu-An Tang, NEC Laboratories America, Inc.; Kai Ishikawa, NEC Corporation; Ellen Yi-Luen Do, University of Colorado Boulder

Abstract: Learning to perform physical tasks is ubiquitous yet challenging without expert guidance. While Augmented Reality (AR) has been adopted to overlay instructions directly onto the physical context, the natural authoring of such content remains unexplored. To address this, we developed WizARd and Apprentice, an AR expert capture system for training novices using an AR headset. WizARd and Apprentice tracks and records expert demonstrations and moving objects, leveraging the natural synchronization of speech and action to identify key steps and automatically create spatial markers.

Publication Link: