Close
UCL MotionInput is breaking new ground in touchless computing. A collaborative project between UCL, Intel, Microsoft, IBM, and the NHS, academics tasked students to build this innovative technology.
Hundreds of students have participated in successive iterations of UCL MotionInput. The project is part of the UCL Industry Exchange Network (UCL IXN), a programme that provides industry experience for students as a critical part of their studies.
Five women, who were appointed in senior positions on the project in 2021 and 2022, talk about their experience of UCL MotionInput and being women leading teams in computer science.
Building revolutionary software
UCL MotionInput v3 (2021-2022) allows people to use facial expressions, voice commands and gestures to interact with Windows-based computers. It removes the need to use a mouse, joystick or even to touch a screen and only requires a computer's webcam.
The suite of software combines machine learning, natural language processing and computer vision in new combinations that users configure based on their physical capabilities.
UCL MotionInput is designed and led by UCL Computer Science husband and wife team, Prof Dean Mohamedally and Dr Atia Rafiq, with colleagues Prof Graham Roberts and Sheena Visram.
They came together to develop the project during the pandemic to minimise frontline staff's contact with shared computers. But the software has many other applications. It can help people with limited fine motor skills perform everyday tasks, such as sending an email.
Future research directions are healthcare, including rehabilitation, population health, social interactions and education.
The software has been endorsed by charities, including Great Ormond Street Hospital for Children (GOSH) and the International Alliance of ALS/MND Associations, which supports people with Motor Neurone Disease (MND).
UCL MotionInput v3 is UCL's first software published on the Microsoft Store.
Women leaders in tech
Sinead Tattan, Lead Student Project Architect, final year student
What led you to study computer science at UCL?
I've always been into computers and have been coding since I was ten. When I was younger, I wanted to work in the cool offices with free food, but that grew into something more substantial.
I'm Irish and decided to study in London. I'd heard so many good things about UCL, especially when it came to computer science, so I applied.
What was it like to work on UCL MotionInput?
It was an incredible opportunity. MotionInput allowed me to meet the very top people in my fields of study, including Dave Crawford (Windows 11 Product Design Director at Microsoft) and Chris Patnoe (EMEA Lead for Accessibility and Disability Inclusion at Google).
For a literature review, I read a lot of Prof Bill Buxton's work (he's one of the fathers of UI and UX) and the inventor of multitouch - then I met him! To have people in such high positions review my work was amazing. I think this is something you would only get from an IXN project!
Of course, it was a great honour to get feedback from Cathy Cummings (Executive Director of the International Alliance of ALS/MND Associations). You can't get anyone better to review a product that's designed to help people with motor disabilities.
I definitely had access to great people and resources. I also loved that we were coming up with practical solutions to real problems. Everything was checked by Dr Atia Rafiq, who, as a GP and Honorary Lecturer in Computer Science, validated our measures, approaches and logical workflows.
What did you learn from working on UCL MotionInput?
I not only learned skills that were so useful for the world of work, but it also helped me identify the sort of computing job that I wanted to do. I know now that software engineering manager jobs are available at graduate level - and that I can do them!
I loved being a woman leading a team. I received so much assurance from UCL and the partners that I felt empowered to do the role, even though it was tough. The experience boosted my confidence and was proof that I could be a strong leader in IT.
What is it like being a woman in computing?
I did coding classes when I was 12, and there were a lot of girls in those classes, but gradually girls seemed to fall out of it, which is such a shame.
I think being a woman in tech, specifically computer science, you will always have difficult moments. UCL are very good about dealing with that and creating role models. On MotionInput, I never felt I had to prove myself because I was a woman.
What's next for you?
I am taking a year out to travel before I start a job. Looking back, I didn't have enough confidence in my abilities over the three years. The imposter syndrome was strong! I knew I was a pretty good performer, but I didn't have much confidence, even compared to some of the weaker-performing men.
I've become much more confident and tenacious. I've made such good friends, the course has changed me for the better, and I am excited for the future with my degree under my belt.
Fawziyah Hussain, led in-air depth interaction of Windows Inking, year 2 student
What led you to study computer science at UCL?
I didn't know what I wanted to do until year 10 or 11 when I was doing my GCSEs. I knew I enjoyed maths, but I didn't have much experience of computer science as my school didn't really teach it.
I found a few courses online: a cybersecurity course funded by the government, which I really enjoyed, and then I went on to teach myself Python. As maths is a big part of computer science, I wanted to keep that passion too.
So, in the sixth form, I applied for computer science degrees. When I started my first year at UCL and began the programming modules, I realised that I loved it.
What was it like to work on UCL MotionInput?
I won't lie; the project was difficult. Most of my programming experience was with Python or Java, and this was using computer vision, which I hadn't studied before. I had to do a lot of research, and it took a lot of time and effort to make the code work.
But I now really appreciate what I have achieved. I learnt about computer vision itself, and my programming skills improved. MotionInput was one of my favourite projects during my degree so far.
One of the best parts about MotionInput was working with the industry partners, Microsoft, IBM and Intel. We presented to them, and they mentored us and gave us feedback.
What did you learn from working on UCL MotionInput?
Besides the technical skills, I learned softer skills. My team working and communication skills improved as we worked closely in a group. We also had to plan how to deliver our part of the project. Over the summer, I did an internship with the digital consultancy Publicis Sapient, and I was able to use all these skills.
What is it like being a woman in computing?
When I applied, I was aware of how few women study computer science degrees, and I was a bit worried about that. It was great to work on a project like MotionInput, where women were super big players.
I'm pleased that the number of women computer science students is increasing, and I'm looking forward to the day when it becomes more even.
My internship was a surprise as there was an even split between women and men on the computer science side, and the company had a really diverse workforce. I don't think that's representative of the wider world, though.
What's next for you?
I still have my final year of study at UCL, but I received a job offer from Publicis Sapient.
Anelia Gaydardzhieva, Team Lead Architect for version 3.1, Master's student
Anelia's team took over from Sinead's team to work on version 3.1. They worked on systems integration and speech components over the summer of 2022. The team also developed further features for UCL MotionInput version 3.1.
One example that looks at whole-body movement is Pseudo-VR, an application for gaming. Pseudo-VR enables a user to walk, run and navigate with hands and speech in existing games, all without leaving their living room.
What led you to study computer science at UCL?
I have always been interested in technology and innovation. As a child in Bulgaria, my parents often found me taking apart mechanical objects and rebuilding them. I also worked for a software company when I came to the UK to study for my undergraduate degree in International Business.
This encouraged me to explore computer science. The company then supported me with my MSc in Computer Science at UCL, for which I am eternally grateful.
What was it like to work on UCL MotionInput?
It's a huge software application, the scale of which most students had never seen before. I supported a team of over 20 Master's and undergraduate students while developing my MotionInput modules, and this called for proactiveness, creative problem solving and resilience.
Working on MotionInput has been as rewarding as it was challenging. I could see the difference this software can make to people's lives. I also had the honour of presenting to Steven Bathiche, Microsoft VP of Windows (Global), Karen Walker, the Intel VP of Marketing, and the UK CEO and General Manager of IBM, Sreeram Visvanathan.
What did you learn from working on UCL MotionInput?
I gained invaluable knowledge and skills. I increased my technical understanding and developed my leadership abilities. My confidence and ambition have grown thanks to my role and the support of the teaching team.
What is it like being a woman in computing?
Based on my and other women's experiences, being female in a male-dominated industry occasionally presents subtle challenges. Any bias is not necessarily explicit and is, to some extent, subconscious. Regardless of a person's background and gender, competence and a strong work ethic can generally overcome any bias.
UCL really cares about integration and diversity, and these topics are frequently raised in class. Working on MotionInput, I felt respected, understood and trusted to make decisions. I was given so many opportunities. Women had led the teams before me, and their work was fantastic.
What's next for you?
I am finishing my thesis for my Master's. I am also working in a research assistant role with UCL in collaboration with a charity. I want to do a PhD as I'm interested in finding new ways of using technology to solve big problems, which is what MotionInput does.
Sheena Visram, Clinical Lead for UCL MotionInput, and Researcher
Sheena is at UCLIC (UCL's Centre of Excellence in Human-Computer Interaction) researching the adoption of emerging technologies. She works closely with the DRIVE centre at GOSH. GOSH DRIVE uses technology and data to bring about innovation in clinical and patient care.
Sheena is also a TEDxNHS curator, the Chair of IXN for Good, and sits on the UCL Computer Science Athena Swan committee. UCL has been dedicated to the Athena Swan principles of advancing gender equality for over ten years. UCL Computer Science now has one of the highest numbers of women academics among the Russell Group universities and more women students than the average at Russell Group universities.
Alongside Athena Swan, UCL Computer Science has an equity, diversity and inclusion (EDI) committee. There is an EDI action plan to address barriers to the recruitment, progression and retention of ethnic minority students and staff.
So, Sheena, how did you get into computer science?
I have degrees in clinical research, and nutrition and dietetics and have worked in healthcare for 20 years. I have always been drawn to healthcare innovation. I believe we can create a more intelligent and technologically driven healthcare system through partnership between clinicians, industry and academia.
I am now working on my PhD in human-computer interaction. I want well-designed technologies to be used to deliver the best possible care and safety for patients. Computer science for healthcare is exciting and advancing fast, and I'm encouraging clinicians along with the next generation of computer scientists to understand that.
What is it like being a woman in computer science?
UCL Computer Science and GOSH DRIVE are supportive environments with incredible people. They trust me to push forward new ideas like UCL MotionInput. The UCL Computer Science department doesn't campaign for women in engineering; it acts.
Academics like myself and my colleagues, Prof Dean Mohamedally, Dr Atia Rafiq and Prof Graham Roberts, want to create role models by putting women in positions, such as in the MotionInput team, where they thrive.
The UCL motivation tracking solution, built by Prof Mohamedally and team, is applied to the IXN programme. It's an amazing methodology that matches students' interests with their work experience projects and enables women to become more visible.
This then directly ties into Athena Swan, where we seek out initiatives that ensure that women students coming into engineering, especially those of an ethnic background, have the best chance of becoming the best version of themselves.
We want them to have incredible university careers, to be role models for other women and go on to fantastic jobs.
Tell us more about inclusivity
As is the case in many sectors, there are aspects of healthcare originally designed for the male anatomy. A good example of this is cardiopulmonary resuscitation (CPR) which, over the years, has led to more men surviving CPR than women.
We need to design differently. With UCL MotionInput, our technical teams are diverse by default which means systems are built and developed by a cross section of males and females. As a result, varying hand sizes, skin colours and movement preferences determine how well a gesture is recognised.
The future of computer science is more inclusive and diverse. It will feature many more women and capitalise on the range of skills from people coming from different fields.
Dr Atia Rafiq, Co-supervisor for UCL MotionInput
Atia is a GP, GP trainer and Clinical Safety Officer. She is also an advisor for IXN for the NHS and an Honorary Lecturer at UCL Computer Science, specialising in computer science with healthcare.
Atia is also the co-founder of IXN for the NHS, a programme that accepts over 150 students on NHS projects a year.
What was it like working on UCL MotionInput v3?
With my healthcare experience, my role was to lead on requirements modelling: to determine what the end user needs from the software. We worked closely with the International Alliance of ALS/MND Associations to understand the challenges posed by MND and how we could attempt to overcome them.
It was inspiring to be working with women leaders on this project, each highly competent in their field. Compared with other computer science settings, I found the level of empathy exceptionally high.
There was a keen desire to relate to the user, and I feel that the team brought a range of experiences to the table. One team member, for example, had worked in a residential home, and her knowledge helped inform the software.
How is UCL MotionInput helping to advance healthcare technology?
Covid was, of course, terrible, but as a result, we were able to innovate faster than we would have otherwise. With technology like MotionInput, we can reach people who may not have easy access to health provision.
Constraints in the NHS mean one-on-one support can be limited, so we can use technology to reach people at home. We are planning to use MotionInput in physical rehabilitation projects, which could include following up on the Fizzyo research study.
Fizzyo is measuring the effect of remote monitoring and gaming technology on children with cystic fibrosis. These children are encouraged to do breathing exercises by using an airway clearance device to control a computer game.
Many of the public health benefits focus on prevention. We don't want people to become immobile, for older people to lose fitness, so MotionInput can help keep people active.
How would you encourage women and girls to study and work in computer science?
I would love them to get into engineering by thinking about a problem and how they can solve it. In the NHS, we need to design products for different sorts of people - young, elderly, those with disabilities, everyone - so it's vital we have people from varied backgrounds creating these solutions. Don't feel you must leave behind your experience to be a computer scientist.
Interviews have been edited for length and clarity.