Intelligent Augmented Reality User Interfaces: Promises and Challenges of Delivering a Next-Gen AR User Experience
MIE Department Seminar
April 8, 2025
11:00 AM - 12:00 PM America/Chicago
Presenter: Joseph L. Gabbard, PhD, Virginia Tech
Location: ERF 1043
Abstract: As we see augmented reality (AR) applications move from research labs to commercial applications, the need for usable AR-based systems has become more and more evident. Despite the fact that AR technology fundamentally changes the way we visualize, use, and interact with computer-based information, we are only just recently starting to see real investment in the design and development of user interface (UI) designs that truly leverage AR’s promise. While traditional UX methods can be applied to determine what information should be presented to users, these approaches do not tell us how and when information should be presented to the user. Given the infancy of the AR UI design field, we mostly see smartphone, tablet and even desktop UI metaphors migrating to AR, in what we can consider first-gen AR user interfaces.
With recent advancements in computer vision and machine learning, we have a unique opportunity to consider intelligent next-generation AR user interfaces. In industrial settings for example, we can consider these next-gen AR interfaces to adapt to, the worker, their work progress and quality, as well as the overall work environment. In this talk, I discuss the implications for AI for next-generation AR user interfaces. Specifically, I provide examples of how AI-powered AR user interfaces could adapt to users’ contexts, and touch on both the promise and challenges associated with creating and fielding these next-gen UIs. I conclude with open questions regarding issues of inclusion, privacy and agency.
Speaker Bio: Dr. Joseph L. Gabbard is a professor of human factors and computer science (by courtesy) at Virginia Tech. He holds Ph.D., M.S. and B.S. degrees in computer science (HCI) and a B.A. in sociology from Virginia Tech. Gabbard’s work centers on human-computer interaction in augmented and virtual reality. For nearly 25 years, Gabbard has been researching new methods of design and evaluation for interactive virtual and augmented reality systems. Currently, Gabbard directs the COGnitive Engineering for Novel Technologies (COGENT) Lab, conducting basic and applied HCI and human factors research. His work focuses on the application of principles and theories from several disciplines to the design of augmented reality user interfaces, information presentation and user interaction. His research has been funded by the National Science Foundation, National Institute of Standards and Technology, Microsoft, Meta, the National Institutes of Health, the Office of Naval Research, and several automotive manufacturers.
Date posted
Mar 20, 2025
Date updated
Apr 3, 2025