Could touchless computers be used at Great Ormond Street Hospital?

1 Apr 2022, 2:30 p.m.

An illustration shows two hand, one palm facing and one showing the back of the hand. They are black against a white background, which dark blue fingernails.

A group of researchers investigate touch-free computer technologies with the Digital Research, Innovation and Virtual Environments (DRIVE) unit at Great Ormond Street Hospital for Children (GOSH).

Why are touchless computers needed in hospitals?

In hospitals, there are several settings that require sterile environments. But shared computers are often the only way that clinical professionals can access information that is essential for some treatments. Touch-free computers could offer an easier and safer way to access this information.

How has the touchless computer software been developed?

A photo of Sheena Visram, Co-Supervisor for UCL MotionInput, with a library behind her.

Sheena Visram, Co-Supervisor for UCL MotionInput

Sheena Visram is the Co-Supervisor for UCL MotionInput. Sheena worked with a team of researchers at University College London in partnership with Microsoft to understand how touch-free computers could be made and used at GOSH.

They also worked with clinical professionals from the very beginning including the Clinical Simulation Team who support skills training, radiologists and cardiac surgeons. This meant that the project focused on making touch-free computer technology work for the people who would use it, rather than solely what the technology could do.

How does this touchless computer software work?

The touchless computer software is called UCL MotionInput. It uses a regular webcam and a computer software that is programmed to recognise different types of gestures.

The team have now developed a whole suite of touch-free computer instructions including hand and head movements, and eye tracking.

The team spent significant time listening to clinical professionals and used more collaborative ways of developing computer features so that people were put front-and-centre.

You can watch the video below to see how UCL MotionInput works:

The roles and experiences of staff at GOSH are very complex and their expertise, alongside that of patients, academics and technology companies is required to find new technical solutions that can support them and their patients.

Sheena’s research focuses on up-take of technologies, grounded by her experience in innovation over twenty years and as an Allied Health Professional. In developing helpful and exciting new technologies, she wants to ensure that the voice and perspective of people using the technology is at the fore.

I often find myself as a conduit between clinical teams and technical teams, each who are quite nervous about entering into a new type of conversation to try and understand concepts that fall outside of their primary training.

That’s why these demonstrations and early-stage prototypes are so important, to translate concepts into experiences in a simulated environment and show clinical teams what is possible.

Sheena Visram, Co-Supervisor for UCL MotionInput

Extra information about this research

Sheena is part of the Computational Informatics Research Programme at GOSH DRIVE, where researchers are working to understand how we can improve patient outcomes and experiences at the hospital using data and technology. You can read more about this project here.

MotionInput is publicly downloadable and available to anyone who wants to use it. Making the technology available at this early-stage means that the community can get involved and provide feedback to increase the likelihood that touch-free computers can be helpful to clinicians and patients, but also in other settings such as care homes and schools.

This article is from an original interview conducted by BCS, the Chartered Institute for IT.

Fourth Annual NIHR GOSH BRC Image Competition - A Moment of Discovery

The Research and Innovation Communications team at GOSH and the NIHR GOSH Biomedical Research team invite you to enter our Research and Innovation Showcase: A Moment of Discovery.

GOSH pilots AI tool to give clinicians more quality-time with patients

Patients and clinicians at GOSH have been taking part in the first NHS trial of a bespoke healthcare AI assistant, TORTUS, to help increase face-to-face time during appointments.

New hope to prevent blindness in children with rare genetic disease

A new treatment that could prevent blindness in children with the CLN2 type Batten disease has been trialled by Clinicians at GOSH and University College London Great Ormond Street Institute of Child Health (UCL GOS ICH).

GOSH only hospital outside of North America to receive innovation funding award for AI

GOSH has been awarded the Amazon Web Services IMAGINE Grant: Children’s Health Innovation Award, to support artificial intelligence (AI) development and drive progress for children’s healthcare.