How 3D modelling and virtual reality can benefit patients and staff ahead of surgery

19 Sep 2019, 10:17 a.m.

​Joe, aged 15, who features on Paul O’Grady’s Little Heroes, is being treated at GOSH for Marfan Syndrome, a genetic disorder that affects the body’s connective tissue, which plays an important role in helping the body grow and develop properly. Joe has an associated heart condition and required surgery to replace his aorta, the body’s main artery.

The medical and research team involved in his care share how they have used pioneering 3D Heart Modelling and Virtual Reality to aid understanding of his heart condition ahead of surgery.

Using virtual reality (VR) in research

Research played a key part in the preparation for Joe’s cardiac surgery, with a 3D model image of his heart being captured and then looked at via Virtual Reality software. Dr Claudio Capelli and Endrit Pajaziti, research fellows based at GOSH, explain the process:

“When a patient has a CT or MRI scan we take the images and then transform these into a 3D model of the heart. This 3D model can be then be 3D printed or imported in our VR software, which was designed and developed in house by our team.

“Our group have published several studies showing how 3D printed models can be beneficial to all the people involved in the care of our patients. Our current research focuses on the long-term benefit that young teenagers, such as Joe, might have in engaging with their heart condition also by means of 3D printed models.”

How VR and 3D models are helping patients and staff

Claudio explains: “VR is a fantastic way of being immersed into a patient’s heart. The overall aim of using VR in our research projects is to help us to explore the cardiac anatomy in an immersive way, providing more detail than ever before.

“Firstly, it can help the clinicians during their decision phase. A VR model can enhance the understanding of a patient’s anatomy so that the clinical team can plan a surgical procedure in the virtual world prior to theatre. The surgeon can see the heart from any perspective (including the inside), take detailed measurements and virtually plan and practice procedures.

“Secondly, we aim to improve the education of congenital heart disease. In this case, we are building a virtual library of models of the most common congenital heart diseases for medical students and young trainees, to help them understand more about the condition.

“Finally, we believe that VR can be a tool to engage with our patients. For Joe, VR not only stimulated curiosity in understanding his condition, but helped in entertaining and distracting him before his surgery.”

Elena Cervi, Joe’s Cardiology Consultant at GOSH, adds “3D models are proving very useful to explain diseases and procedures in a more visual and understandable way to patients and parents. They are usually thrilled to keep the model (when it is 3D printed) as it is made from their own imaging. Unlike a standard prop for teaching this is the anatomy specific to the single patient which makes it unique.”

See the software in action:

The VR project at GOSH has been initially funded by La Fondation Dassault Systemes. The 3D printed model research projects have been funded by British Heart Foundation. The 3D printer was funded by GOSH Charity. 

Find out more about Research and innovation at GOSH. 

Important step forward in stem cell therapy for rare bowel disease

A new study led by researchers at UCL Great Ormond Street Institute of Child Health (UCL GOS ICH) and the Centre for Stem Cell Biology, University of Sheffield, has demonstrated the potential of stem cell therapy to treat those with Hirschsprung disease.

First UK trial of Deep Brain Stimulation for children with epilepsy begins at GOSH

Discover how Oran became the first UK patient in a clinical trial using deep brain stimulation (DBS) for epilepsy. Learn about his 80% reduction in daytime seizures thanks to this innovative DBS treatment.

Studying the impact of environments on child health by linking big data

At GOSH we know that we're not caring for children if we're not caring for the environment. We spoke to Professor Pia Hardelid, who told us about a project which is helping us to understand the impacts of local environments on children’s health.

Blood test and AI could predict Parkinson’s seven years before symptoms

International researchers have developed a simple blood test that uses artificial intelligence to predict Parkinson’s up to seven years before the onset of symptoms, part-supported by the NIHR GOSH BRC