This is the official implementation of the ISMAR 2024 demo.
Jonas Hein, Jan Grunder, Lilian Calvet, Fédéric Giraud, Nicola Alessandro Cavalcanti, Fabio Carrillo, Philipp Fürnstahl
After cloning this repository, download the point cloud animation data from here. Extract the archive into the pointclouds directory. The final directory structure should look as follows:
SurgTwinVR/Assets/pointclouds/animation/004140.ply
- Install Unity 2022.3.28f1 with Android Build Support, OpenJDK, Android SDK & NDK Tools
- Run using either Meta XR Simulator or via Meta Quest Link on physical hardware
- Basic VR Locomotion and interaction with a medical drill
- Real time rendering of dynamic Point clouds based on the method from Markus Schütz
- Rasterization using a Compute Shader
- Executed as custom post-processing step in the Universal Render Pipeline
- Asynchronous loading of animation data
For further details see Technical overview.pdf.
@InProceedings{Hein_2024_ISMAR,
author = {Hein, Jonas and Grunder, Jan and Calvet, Lilian and Giraud, Fr\'ed\'eric and Cavalcanti, Nicola Alessandro and Carrillo, Fabio and F\"urnstahl, Philipp},
booktitle = {2024 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)},
title = {Virtual Reality for Immersive Education in Orthopedic Surgery Digital Twins},
year = {2024},
volume = {},
number = {},
pages = {},
keywords = {Virtual Reality;Surgery Digital Twin;Surgical Training;Medical Simulation;Spinal Surgery},
}
The VR app was created during a stay at the Research in Orthopedic Computer Science Group (ROCS) at Balgrist Hospital Zurich. This is a demo submission to ISMAR 2024 "Virtual Reality for Immersive Education in Orthopedic Surgery Digital Twins". This work has been supported by the OR-X - a swiss national research infrastructure for translational surgery - and associated funding by the University of Zurich and University Hospital Balgrist.