MotionInput Games: Using AI to Make Gaming More Accessible for Autistic Children

A school student using arm movement to control a computer game on screen

Games designed for accessibility and fun

MotionInput Superhero Sportsday and MotionInput Watersports are the first two games from MotionInput Games to launch on the Microsoft Store, developed for autistic players. Theyallow players to control the action using body movements captured by a standard webcam, removing the need for a mouse, keyboard or controller. The games were co-tested with teachers and their pupils from two specialist schools run by the National Autistic Society.

Players can take part in activities such as swimming, cycling, kayaking, jetpack flying and windsurfing across a colourful, fictional island inspired by Mauritius. The games are now freely available to download from the Microsoft Store and run on any Windows gaming laptop.

The games, part of the UCL Computer Science spinout, MotionInput Games Ltd, use software such as computer vision, artificial intelligence and machine learning to interpret movement in real time, turning physical gestures into gameplay.

Image of navigation screen for Superhero Sportsday game

Collaboration with schools

The project was developed in collaboration with Sybil Elgar School in West London and Helen Allison School in Kent. Teachers, occupational therapists and students contributed feedback on the project ideas from the start, helping to shape how the games looked, felt and responded to movement.The project was developed in collaboration with Sybil Elgar School in West London and Helen Allison School in Kent. Teachers, occupational therapists and students contributed feedback on the project ideas from the start, helping to shape how the games looked, felt and responded to movement.

Our ongoing partnership with UCL Computer Science and MotionInput Games has sparked new ways for us to think about how our autistic students can engage with learning and personal development through technology. It's incredible to think about what the future holds for technology and autism.

Marius Byleveld, Accessibility and Innovation Coordinator at Sybil Elgar School

Feedback from teachers and their students helped the Computer Science students to understand how the swimming levels should move and how sensory preferences could be supported in each environment. This collaborative approach continues as the schools remain partners in future IXN projects.

A young school student using hand gestures to navigate a game on screen

The impact

These games demonstrate how inclusive solutions can open up new ways to learn, play and participate. They show the potential of AI and computer vision to make everyday technology more accessible and enjoyable for users with diverse needs.

“Some of the movements we modelled were based on what the children found most engaging. They loved the swimming levels where they got to 'swim' along using their arms, so it was really special to develop those for them." - Professor Dean Mohamedally, UCL Computer Science and CEO of MotionInput Games.

A young school student using body movements to play a game on screen

Staff from the National Autistic Society’s schools also described the collaboration as “revolutionary”, noting how students who don’t use traditional input devices can now take part fully in digital activities.

Looking ahead

Work is already underway on new developments, including:

a winter edition of Superhero Sportsday
an augmented reality reading tool that summarises text and generates 3D visualisations
a sensory room app linking light and sound
additional AI-powered learning games shaped by ongoing feedback from students and teachers

Through MotionInput Games and the National Autistic SocietyUCL Computer Science is connecting autism friendly practices together with AI in education. Combining AI, human–computer interaction and inclusive systems development will encourage accessibility in technology and equitable computing for all.