Augmented Reality Transforming Medical Processes CI MED Research Shows

Digital holograms of a person’s anatomy are set to become powerful tools for physicians when preparing for surgery.  Holograms along with other mixed reality tools in medicine are predicted to become more routine over the next decade, transforming medical processes ranging from surgical planning and practice to physician training, according to new Carle Illinois College of Medicine (CI MED) research.

The research team – including several CI MED experts in augmented, mixed, and virtual reality – surveyed the current use of these tools and their impact on medical practice and medical education. 

“I think the biggest change we see in the next ten years will be the shift from mixed reality in medicine as an exciting idea to something that is being implemented across the field,” said CI MED student Alexa Lauinger, who is co-author of the study. “These technologies will benefit every stage of medicine from improving training and access to training to direct patient care,” Lauinger said.

The three R's: XR, VR, AR

Extended reality (XR) is a broad term for technology that alters the user’s view of reality with virtual displays, projections, or experiences and includes both augmented reality and virtual reality. Augmented reality (AR) supplements the real-world experience by overlaying it with virtual media, while virtual reality (VR) uses headsets or goggles to create a more immersive experience of a virtual environment. All are used in facets of medicine and medical training, but technology costs and other barriers have limited adoption.

“It requires partnerships between medical and engineering school experts, health systems, and industry to break down barriers for adoption as well as develop more cost-effective solutions,” Carle Illinois College of Medicine Dean Mark Cohen said. He is senior author on the article.

Extended and mixed reality tools are increasingly used for pre-surgery planning. But CI MED’s researchers also found reason to expect more widespread adoption to improve in-surgery efficiency. “I believe we can expect these technologies to become a regular part of surgical workflows. They will also provide enhanced visualization and facilitate real-time guidance during surgery to reduce errors and improve patient outcomes,” said CI MED student and study co-author Meagan McNicholas.

VR has enjoyed wide acceptance in medical schools as part of physician training, including at CI MED’s Jump Simulation Center, which allows medical students to gain skills and practice procedures in a safe, low-risk environment. It’s a trend that McNicholas and her collaborators expect to grow. “Some of the most promising areas of growth for MR in medical training are in the practice of high-acuity, high-risk situations,” McNicholas said. “In the coming years, XR technologies may revolutionize medicine by expanding access to high-quality training around the world, improving modalities for continuous learning and skill development, and broadening access to care,” she said.

CI MED: Leading the Way 

Both Lauinger and McNicholas see CI MED, as the world’s first engineering-based college of medicine, leading the adoption of new mixed reality technologies. “We already see this institution getting involved through the MIXR (the Center for Medical Innovation in Extended Reality) where a large group of physicians and scientists can directly communicate. You won’t find an environment like this anywhere else, and it allows us to lead this field by testing new technologies in our operating rooms and prototyping a lot of these devices in our labs. And being in a more rural region of Illinois, we also see a lot of students discuss how this can impact areas will less access to medicine,” Lauinger said.

Editor’s note: The article, “Applications of Mixed Reality with Medical Imaging for Training and Clinical Practice,” was published in the December 2024 issue of the Journal for Medical Imaging. In addition to Lauinger and McNicholas, contributing authors include; Matthew Bramlet, (Carle Health); Maria Bederson (MD Candidate); CI MED Health Innovation Professors Bradley Sutton and Caroline G. L. Cao; Irfan S. Ahmad; Carlos Brown, MD (CI MED and Carle Health); Shandra Jamison, (CI MED Jump Simulation Center); from U. of I. Sarita Adve, John Vozenilek, Jim Rehg; and Mark S. Cohen, MD (CI MED and Carle Health). DOI: 10.1117/1.JMI.11.6.062608