San Diego-based Sharp HealthCare has launched the Spatial Computing Center of Excellence, an initiative aimed at changing how clinicians interact with technology.
Spatial computing, which blends physical and digital worlds through technologies like augmented reality, is gaining traction in healthcare. According to Tommy Korn, MD, an ophthalmologist and chief physician evangelist of mobile-first for Sharp HealthCare, it has the potential to eliminate friction in technology use.
"Surprisingly, the industry most excited about spatial computing is healthcare," Dr. Korn told Becker's. "The way we interact with technology today is often filled with friction—it can sometimes hinder rather than help us. But with spatial computing, doctors, surgeons and clinicians gain what feels like superpowers, enabling them to achieve levels of precision and insight we've never had before."
Sharp HealthCare's investment in spatial computing began with the purchase of a fleet of Apple Vision Pro devices. These headsets, according to Dr. Korn, are being used to streamline workflows, reduce screen clutter and enhance patient care with immersive, real-time data visualization.
For example, Dr. Korn's team collaborated with Zeiss, a medical technology company, to explore the potential of spatial computing in ophthalmology. Zeiss developed the first ophthalmology spatial computing app for the Apple Vision Pro, allowing surgeons to review, prepare for and analyze eye surgeries in 3D. Dr. Korn, who was involved in the testing phase, has used the device to review eye surgery footage captured through a 3D microscope. The integration of AI into the app provides analytics on surgery speed and performance, helping physicians refine their techniques.
"We were the first to test this app at Sharp HealthCare, and the results have been phenomenal," Dr. Korn said. "The integration of spatial computing and AI allows me to analyze how I perform surgeries, offering insights I never had before."
The impact of this work earned recognition at Apple's 2023 keynote, where CEO Tim Cook highlighted Sharp HealthCare's efforts in spatial computing.
But the initiative doesn’t stop with ophthalmology. Dr. Korn said spatial computing is transforming other areas of medicine, including surgery, radiology and medical education. In the operating room, for example, surgeons can access vital information and patient data in 3D, allowing them to focus on the patient rather than toggling between multiple monitors. This reduces both physical and cognitive strain, improving efficiency and outcomes, according to Dr. Korn.
In one example, an orthopedic surgeon at Sharp HealthCare used an Apple Vision Pro instead of traditional monitors, saving both space and time. The device, which costs far less than traditional medical monitors, allows the surgeon to stay focused on the patient without constantly shifting his gaze between screens. Similarly, a cardiologist no longer needs to work with multiple monitors—one Apple Vision Pro is all it takes.
Medical education is another area where spatial computing is showing promise.
"With spatial computing, we can simulate real-world environments and allow students to interact with 3D models of human anatomy, including the ability to walk around and explore them," Dr. Korn said. "The potential for medical education is incredible."
However, widespread adoption of spatial computing in healthcare faces challenges. One primary barrier is the development of standards and software. While hardware such as the Apple Vision Pro is readily available, many applications needed for clinical and educational use are still in development. To address this, Sharp HealthCare hosted a Spatial Computing Health Care Summit, bringing together clinicians, software developers and industry leaders to collaborate on the future of spatial computing in healthcare.
At the summit, more than 300 attendees from 10 countries explored firsthand how spatial computing could be applied in hospital and healthcare settings. Experts from Apple, Epic, Zeiss and major health systems such as Rochester, Minn.-based Mayo Clinic and Atlanta-based Emory Healthcare participated in panel discussions on developing safe, effective spatial computing applications for healthcare.
"One of the key takeaways from the summit was realizing that we don’t need to reinvent the wheel—we just need to focus on building the tools and infrastructure to support these innovations," Dr. Korn said. "By bringing everyone together, we can create software that meets the needs of clinicians and ultimately serves the patient."
The event also featured a demonstration of how spatial computing could enhance care in a neonatal intensive care unit. Nurses could use the technology to access real-time data about a simulated baby, such as heart rate and temperature, without switching between multiple screens.
As the technology continues to evolve, Dr. Korn is optimistic about its potential to disrupt traditional medical practices. He envisions a future where spatial computing not only enhances clinician productivity but also improves access to care, particularly in underserved regions. By enabling remote education and virtual simulations, spatial computing could help address the global shortage of healthcare professionals.
"The healthcare crisis is real, and we need to train more doctors and clinicians," Dr. Korn said. "Spatial computing can help us do that faster and more effectively, bridging gaps in care worldwide."