Latest Research

Over the first three years at U-M, the lab has worked at the forefront of cross-device interfaces, multi-modal interaction, and AR/VR. Our systems research contributions include ProtoAR [CHI’18] and 360proto [CHI’19] for rapid prototyping of AR/VR interfaces using cross-device authoring, 360Anywhere [EICS’18] for 360 video based collaboration using mixed reality, GestureWiz [CHI’18] for using Wizard of Oz and crowdsourcing in gesture design and recognition tasks. Using the knowledge from building these systems, the lab has also been working on conceptual frameworks and new ways of thinking about future interfaces’ design through contributions such as What is Mixed Reality? [CHI’19 Best Paper Honorable Mention], The Trouble with AR/VR Authoring Tools [ISMAR’18 Adj.], Playing the Tricky Game of Toolkits Research [CHI’17 HCI.Tools Workshop], and studies on creating cross-device AR experiences resulting in XD-AR [EICS’18 Best Paper Award] as well as user-driven design principles for gesture representations [CHI’18].

Overview of our externally sponsored research projects:


Developing methods and tools to make prototyping of augmented reality and virtual reality experiences easier for non-technical designers

(2018-) Rethinking the web browser as an augmented reality application delivery platform

Investigating the use and usefulness of virtual reality visualizations for understanding future city traffic scenarios


Developing a conceptual framework and implementation of a cross-device augmented reality application platform


Creating augmented reality interfaces to configure and preview future kitchen designs