A groundbreaking advancement in surgical oncology is revolutionizing the precision and safety of complex cancer surgeries. The work integrates cutting-edge visualization and artificial intelligence (AI) technologies to transform how surgeons approach the removal of tumors in the liver, pancreas, and bile ducts—some of the most challenging and high-stakes procedures in medicine.
The pioneering work is being led by Dr. Claudius Conrad, Associate Dean for Research and Innovation at Carle Illinois College of Medicine, through a $750,000 technology grant from FujiFilm.
Conrad’s work harnesses FujiFilm’s state-of-the-art “Vincent” technology – an advanced visualization system – to redefine surgical planning and execution. “This technology combines high-resolution imaging and AI-driven analytics to tackle longstanding challenges in surgery,” said Conrad, a globally renowned surgical oncologist specializing in hepatobiliary cancers. “It has the potential to fundamentally reshape how we approach complex cancer surgeries, improving safety and outcomes for patients.”
Revolutionizing Precision Surgery with AI-Driven Virtual Models
Fujifilm’s Vincent system employs sophisticated AI algorithms to convert standard CT scans into detailed, patient-specific 3D models. These models provide an unprecedented view of the intricate spatial relationships between tumors, blood vessels, and bile ducts, enabling surgeons to visualize and strategize with unparalleled accuracy. Surgical removal of liver and pancreatic tumors without these advanced tools can be particularly complex, in part due to obstructions that can limit the surgeon’s view of the whole tumor and the surrounding tissues. “Rather than relying solely on mental representations of a procedure, we now have an interactive, virtual roadmap that the entire surgical team can utilize in real time,” Conrad said. “This deeper understanding fosters precision in tumor removal while minimizing risks to critical surrounding structures.”
Going a step further, Conrad’s research team is exploring AI integration to optimize surgical planning and facilitate real-time decision-making during operations. The combination of virtual modeling, real-time imaging, and AI-based guidance represents a leap forward in patient-centered precision medicine, with the potential to not only improve individual outcomes but also significantly reduce complications across the health care system.
Transforming Surgical Education with Virtual Reality
Beyond the operating room, the project advances medical education at CI MED. Leveraging virtual reality (VR) technology, medical students will gain hands-on experience with hepatobiliary anatomy and procedures. “Through interactive 3D reconstructions, students can explore patient-specific anatomy in ways that were previously unimaginable,” Conrad explained. “This immersive learning experience not only deepens their understanding of complex surgeries but also equips them with the skills to leverage advanced technologies in their future practices.”
A Vision for the Future of Surgery
Conrad envisions a future where this integrated approach becomes the standard for planning and executing complex surgeries. “This initiative underscores our commitment to innovation and patient-centered care,” he said. “By making surgeries safer, more effective, and personalized, we are not just improving outcomes—we’re transforming the field of surgical oncology.” Conrad sees his team’s work as part of a paradigm shift in precision medicine that will set a new benchmark for surgical excellence.
The collaborative project unites experts from across the University of Illinois Urbana-Champaign, including imaging specialists from the Beckman Institute, bioengineering innovators, and computational scientists from the National Center for Supercomputing Applications. Together, they are refining AI algorithms and enhancing the utility of 3D virtual models for intraoperative use.