August 12, 2026
Mizzou Engineering is discovering ways to enhance learning in immersive educational settings.
Researchers at the University of Missouri developed an augmented reality (AR) learning system that monitors students’ attention using real-time eye-tracking data and delivers personalized verbal reminders, or “nudges,” when attention begins to decline. The system analyzes pupil dilation and blinking patterns to identify when a learner may be disengaging and then provides a brief audio prompt encouraging them to refocus.
In a National Science Foundation-funded study involving 40 college students, researchers compared learning performance with and without these adaptive verbal nudges during AR-based biomechanics lessons. Students who received the nudges performed significantly better in the easier learning modules, suggesting that timely, personalized feedback can help learners stay engaged and avoid ending their learning process too soon.
Who is conducting the research?
The research was conducted by Jung Hyup Kim, Yi Wang and Ella Swaters, BS IE ’26, of the Department of Industrial and Systems Engineering along with Fang Wang of the Department of Electrical Engineering and Computer Science and Danielle Oprean of the School of Information Science Learning Technologies.
Why is this research important?
One of the biggest challenges in technology-based learning is maintaining student attention. In a traditional classroom, instructors can often recognize when students are losing focus and adjust their teaching accordingly. Most AR learning systems, however, lack real-time instructional support.
The Mizzou researchers addressed that gap by creating an AR system that can detect signs of disengagement and respond immediately with personalized encouragement at critical moments.
The study suggests that helping students remain attentive can improve learning outcomes and make AR experiences feel more engaging and interactive. The work also advances the field of human-computer interaction by showing how physiological data can be used to support learning in real time.
“The system described here uses real-time eye-tracking data, like pupil size and blink rate, to spot when attention fades and then gives students verbal reminders to help them refocus. This is a move toward smarter, more personalized and interactive AR learning tools.” – Jung Hyup Kim
Who benefits from this research?
Students are the primary beneficiaries because the technology may help them stay focused, complete learning activities more effectively, and achieve better results. Educators could also benefit from tools that provide automated support for learners, especially in self-paced or remote learning environments where instructors cannot continuously monitor attention.
In addition, instructional designers, educational technology developers, and organizations that use AR for workforce training may find value in incorporating adaptive feedback systems into their programs. Beyond education, the approach could be applied to professional training environments where maintaining attention is critical for performance and safety.
Where was the research presented?
The study, “An Experiment with Adaptive Verbal Nudges Based on Eye-Tracking Data for Preventing Premature Learning Termination in AR Environments,” was presented at the International Conference on Human-Computer Interaction (HCII), July 26-31 in Montreal, Canada.
Bottom line
AR learning systems can become more effective when they respond to learners’ attention in real time. By using eye-tracking data to identify moments of disengagement and delivering brief verbal reminders, researchers were able to improve student performance, particularly in less complex learning tasks.
In the future, AR learning environments may behave more like attentive instructors, helping students stay focused and engaged. Additional research is needed to test the approach with larger and more diverse populations, but the results provide promising evidence that adaptive verbal nudges can enhance learning in immersive educational settings.
“Real-time, adaptive verbal nudges based on eye-tracking data can help students pay attention and do better in AR learning. this kind of attention-aware feedback could be very useful in future AR education and training.” – Jung Hyup Kim
What can I study if I’m interested in this research?
Interested Mizzou Engineering students can pursue a bachelor’s degree in industrial engineering or earn a master’s in industrial engineering in as little as one additional year with the accelerated Bachelor of Science in industrial engineering and MS in industrial engineering. Additionally, the dual Bachelor of Science in industrial engineering and Master of Business Administration program allows students to earn an MBA in as little as one additional year.