George Washington University Hospital, in partnership with Novarad, have announced what they say is the country’s first implementation of an augmented reality (AR) medical solution in a surgical setting.
The OpenSight Augmented Reality System, powered by Microsoft HoloLens, renders 2D, 3D and 4D images of patients interactively, while accurately overlaying them directly onto the patient’s body. The partnership will enable a new era of pre-operative planning, overcoming critical pre-surgical and surgical obstacles to minimize patient morbidity and mortality.
“OpenSight allows the surgeon to overlay the medical image onto the patient’s body, so not only do I see the patient laying on top of the table, but I can see the CT hologram,” said Dr. Babak Sarani, Professor Of Surgery And Emergency Medicine And Director Of The Center For Trauma And Critical Care At George Washington University, “Us having this technology meets the endpoint of our mission as an academic hospital.”
While some earlier technology was limited in both scope and efficacy, OpenSight, co-created by Dr. Wendell Gibby, Novarad CEO and Dr. Steve Cvetko of OpenSight, was designed to visualize 3D imaging holograms of the patient, on the patient, for pre-operative localization and planning of surgical options. The 3D holograms are created by a refractory system in the device using a combination of the Microsoft HoloLens hardware and OpenSight technology.
The infrared camera within the headset has ranging and localizing technology, which maps the surrounding environment – including the patient. It determines where objects are and creates mesh surface maps to determine 3D positioning. Placing visual tracking tags on the patient follows movement and allows for even higher accuracy. Image capabilities include virtual incisions to guide the surgeon, shunts, and needle placement; finding the optimal entrance and trajectory for pedicle screws, ACL tunnels and other instrumentation; finding and resecting masses; interventional biopsies, and more.
The technology available through this partnership will make it possible to highlight relevant anatomical and critical structures to avoid and more accurately plan a surgical approach. Multiple headsets can be shared among users improving the training of less experienced residents. A teaching version of the software is also available that allows medical students to perform virtual dissections on cadavers.
“A revolution in surgery is beginning and George Washington University is leading the charge,” said Dr. Gibby. “Using the OpenSight augmented reality device from Novarad, doctors can literally see the patient and see into them at the same time. High resolution advanced holographic imaging is merged in 3D onto the patient with optical precision. This transformative technology promises to improve outcomes in a world of more precise medicine.”
