Ultraleap and UCL Computer Science to create Distributed and Interactive touchless applications

The project aims to build on the UK’s world-leading role in the creation of interactive applications, created through the manipulation of acoustic waves by a computer, that allow you to ‘feel’ virtual objects.

For example, Ultraleap is currently combining hand-tracking and ultrasonic mid-air haptic feedback solutions for applications ranging from VR training simulators and interfaces in cars and other vehicles, to gaming machines and digital signage.

Similarly, the Multi-sensory devices group within UCL Computer Science, led by Prof. Subramanian and including Dr. Martinez Plasencia, Prof. Obrist and Prof. Arridge is leading the way in creating multimodal 3D displays that use levitation techniques based on the same technology championed by Ultraleap.

A significant constraint to scaling these solutions has been our reliance on a physical device that has a large footprint. While each application requires a custom device, to date there is no simple way to create such custom hardware; we have so far relied on a one size fits all approach.

Dr. Orestis (Ultraleap Lead):

Inspired by current 5G and 6G innovations found in wireless communication, in this project we will create a swarm of small and cost-effective devices that can coordinate and self-organize. Through these swarms we will offer scalable and customizable solutions that become cost effective for many applications.

Prof. Subramanian:

“ We are a diverse, energetic and passionate team who are very excited about this project. This partnership will make a real impact not only for the company involved but for UK as a whole. We want to mobilise the innovation potential all around us in the UK; and make UK a very exciting place for disruptive innovation in spatial interactions and the creative sector

The project would have a wide range of potential uses, from VR training simulators and interfaces in cars and other vehicles, to gaming machines and digital signage. These could be used in vehicles to reduce distraction when drivers need take their eyes off the road to use a touchscreen. Instead, mid-air haptics would enable the controls to find the driver, who could hold their hand out and feel the buttons, dials, switches to change the audio or climate control settings, answer a phone call or check the navigation

Further Reading
 

Multi-Sensory Devices website: https://www.ucl.ac.uk/computer-science/research/research-groups/multi-sensory-device

Ultraleap website: https://www.ultraleap.com/