How 3D modelling and virtual reality can benefit patients and staff ahead of surgery

19 Sep 2019, 10:17 a.m.

​Joe, aged 15, who features on Paul O’Grady’s Little Heroes, is being treated at GOSH for Marfan Syndrome, a genetic disorder that affects the body’s connective tissue, which plays an important role in helping the body grow and develop properly. Joe has an associated heart condition and required surgery to replace his aorta, the body’s main artery.

The medical and research team involved in his care share how they have used pioneering 3D Heart Modelling and Virtual Reality to aid understanding of his heart condition ahead of surgery.

Using virtual reality (VR) in research

Research played a key part in the preparation for Joe’s cardiac surgery, with a 3D model image of his heart being captured and then looked at via Virtual Reality software. Dr Claudio Capelli and Endrit Pajaziti, research fellows based at GOSH, explain the process:

“When a patient has a CT or MRI scan we take the images and then transform these into a 3D model of the heart. This 3D model can be then be 3D printed or imported in our VR software, which was designed and developed in house by our team.

“Our group have published several studies showing how 3D printed models can be beneficial to all the people involved in the care of our patients. Our current research focuses on the long-term benefit that young teenagers, such as Joe, might have in engaging with their heart condition also by means of 3D printed models.”

How VR and 3D models are helping patients and staff

Claudio explains: “VR is a fantastic way of being immersed into a patient’s heart. The overall aim of using VR in our research projects is to help us to explore the cardiac anatomy in an immersive way, providing more detail than ever before.

“Firstly, it can help the clinicians during their decision phase. A VR model can enhance the understanding of a patient’s anatomy so that the clinical team can plan a surgical procedure in the virtual world prior to theatre. The surgeon can see the heart from any perspective (including the inside), take detailed measurements and virtually plan and practice procedures.

“Secondly, we aim to improve the education of congenital heart disease. In this case, we are building a virtual library of models of the most common congenital heart diseases for medical students and young trainees, to help them understand more about the condition.

“Finally, we believe that VR can be a tool to engage with our patients. For Joe, VR not only stimulated curiosity in understanding his condition, but helped in entertaining and distracting him before his surgery.”

Elena Cervi, Joe’s Cardiology Consultant at GOSH, adds “3D models are proving very useful to explain diseases and procedures in a more visual and understandable way to patients and parents. They are usually thrilled to keep the model (when it is 3D printed) as it is made from their own imaging. Unlike a standard prop for teaching this is the anatomy specific to the single patient which makes it unique.”

See the software in action:

The VR project at GOSH has been initially funded by La Fondation Dassault Systemes. The 3D printed model research projects have been funded by British Heart Foundation. The 3D printer was funded by GOSH Charity. 

Find out more about Research and innovation at GOSH. 

Fourth Annual NIHR GOSH BRC Image Competition - A Moment of Discovery

The Research and Innovation Communications team at GOSH and the NIHR GOSH Biomedical Research team invite you to enter our Research and Innovation Showcase: A Moment of Discovery.

GOSH pilots AI tool to give clinicians more quality-time with patients

Patients and clinicians at GOSH have been taking part in the first NHS trial of a bespoke healthcare AI assistant, TORTUS, to help increase face-to-face time during appointments.

New hope to prevent blindness in children with rare genetic disease

A new treatment that could prevent blindness in children with the CLN2 type Batten disease has been trialled by Clinicians at GOSH and University College London Great Ormond Street Institute of Child Health (UCL GOS ICH).

GOSH only hospital outside of North America to receive innovation funding award for AI

GOSH has been awarded the Amazon Web Services IMAGINE Grant: Children’s Health Innovation Award, to support artificial intelligence (AI) development and drive progress for children’s healthcare.