Using Microsoft’s HoloLens platform, researchers in Oslo have developed a way of turning traditional two-dimensional medical images into 3D augmented-reality models for planning surgery and navigating around organs during operations.
The project was recently awarded a Microsoft Health Innovation Award.
The data that the 3D models use comes from the hospital’s various image-generating scanning CT and MR machines. These scanners provide detailed views of the human body, but present these images in the form of two-dimensional picture ‘slices’.
When planning surgical procedures, the surgeons have to flip back and forth through a potentially large number of these slices, when using them directly from the scanning machines. The Intervention Centre has been working on combining data from such 2D slices into a 3D model for more than a decade.