MSTRMND consists of eight different-coloured light beams that have accompanying synesthetic sounds. The object of the game is to correctly repeat the computer’s randomly generated sequence of sound and light signals, increasing in complexity as the player progresses. MSTRMND is a single or multi-player logic game that tests complex skills and strategies in trials of experimentation and evaluation. Each colour, encoded to a corresponding synesthetic sound, creates a cross-sensory associations within the mind/brain. Through this new embodied method, the player’s entire body becomes the controller of the game. This approach to more embodied sound and colour associations is intended to enhance memory by incorporating visual-spatial associations with multi-sensory processing.
The installation is a synesthetic ear training device that brings musical training to a wider audience, through the creation of a learning system that is intuitively understood. Through mapping multiple sensory modalities, MSTRMND supports a more natural approach to incorporated cognition, perception and the development of multi-sensory integration.
Image: MSTERMND, by Alexandra Yagliowich