“The sci-fi touch interface of the future”Extremetech
“Mogees turns any surface into an interactive board”Wired UK
“Mogees will blow your mind: watch it and be amazed”Fastcodesign
“Will touch interfaces of the future rely on sounds?”MIT Technology Review
“Create music on any surface”Engadget
“With Just One Contact Mic, Any Surface Magically Becomes a Gestural Instrument”CreateDigitalMusic

Mogees is a project that uses microphones to turn any surface into an interactive board, which associates different gestures with different sounds. This means that desktop drummers could transform their finger taps and hand slaps into the sound of a marimba or xylophone.

Users plug any contact microphone onto a surface — be it a tree, a cupboard, a piece of glass or even a balloon. They can then record several different types of touch using their hands or any objects that cause a sound — so one sound could be a hand slap, another could be a finger tap and another could be hitting the surface with a drumstick. Users can train the system to detect new types of touch recording them just once.

The different gestures can then be associated with different sounds. Then when the user wants to perform, the Mogees software will recognise which of these types of touch is closest to the one that the user is doing and then enable the corresponding sound engine or synthesiser. The tone of the synthesised sound is influenced by the actual sound picked up on the microphone. So you could use the same gesture — for example a tap — in different places on the surface and it would create the sound in a different key.

Mogees currently uses two audio synthesis techniques — the first is physical modelling, which consists of generating the sound by simulating the propagation of the sound wave through different physical materials such as strings, membranes, or tubes using a piece of software called Modalys. The second technique is mosaicing, where the user loads a sound folder and then the audio coming form the contact microphone is analysed and the software looks for the closest segment within the sound folder. So if a sound folder of voices is loaded, touching the surface gently would provoke a whispering while scratching it will cause a sound similar to screaming voices.

The idea of using contact microphones comes from the desire to turn ordinary objects into percussive instruments. The goal is to allow musicians and performers to take full advantage of electronic music without losing the feeling of touching a real surface.

- From an article that appeared on Wired.co.uk
- Video filmed and edited by Cristina Picchi –

Mogees has been developed in collaboration with Lorenzo Pagliei, Frederic Bevilacqua and Norbert Schnell at the IRCAM IMTR team. Uses Corpus Based Synthesis research by Diemo Schwarz. Thanks to Nicolas Rasamimanana and Julien Bloit @ Phonotonic.