Using Augmented Reality for Mental Thriving

A person using their phone

Biofeedback-enabled approaches to meditation have proven immediate and long-term benefits for anxiety. This approach focuses primarily on acute short-term interventions that, over time, develop skills that can be applied routinely.

Program Lead: Kevin Shoemaker, acting Associate Vice-President (Research) and Professor of Kinesiology
Project Status: In progress

In partnership with Bell, Western is the first university in Canada testing 5G capability using 3.5 GHz 5G spectrum in pre-commercial mode. It is the beginning of a $2.7-million project to deploy 5G network infrastructure throughout the Western campus. The first 5G site on campus is designated for research now and by summer, a full network is expected to be available across campus.

Kevin Shoemaker, acting Associate Vice-President (Research) and Professor of Kinesiology, has created a new device that takes advantage of a platform with our London-based partner, EXAR Studios, that utilizes the speed, responsiveness, and the edge computing processing capabilities of the 5G network to develop an app designed to gauge and guide student mental wellness. The app uses biofeedback, such as a visual representation of the user’s heartbeat, to help them learn mindfulness and relaxation skills such as deep breathing to manage anxiety and stress.

In our model, undergraduate and graduate students are engaged in the process of product development and testing. The visualization and gamification features are improved in real-time through the 5G network, making Western the only place in Canada where this device can be developed to its full potential.

Once rolled out for first-year Western students, the product could be accessible to other institutions or adapted for other susceptible groups. The device can be developed as a personal treatment model or as a research device.

The device includes an arm band and a student’s mobile phone. The arm band detects the heart’s rhythm and transmits this information to the phone. Our Augmented Reality Biofeedback (ARBF) app is downloaded to the phone. Once activated, the app detects the arm band and guides the user through the experience, encouraging the participant to focus on breathing while watching the augmented image. In this case, the image is butterflies flying around a tree. The number of butterflies increases and decreases in concert with the magnitude of the user’s heart rate variability, that is, the variations in heart rate from one beat to the next: more variability is better. The participant learns how to modify the number of butterflies which has a calming effect and can be improved over time. Each experience lasts about three minutes. The effect of the experience on the user’s mental state is the key outcome. Other data of the rapid changes in heart rate variability are available to the research team for offline analysis

  • Beta-testable device was available in June 2021
  • A small group of students (about 50) were chosen to pilot the device in September 2022. Data collection will be done and includes how the students like the device and whether it provides relief.
  • The device will then be verified for data privacy etc. after which we will pursue ethics to begin the research phase

Watch the prototype demo now