Shimon is a robot that plays the marimba alongside a human musician. Using visual cues to anticipate each other’s musical input, Shimon and the musician play an improvised song, responding to each other in real time. Together, Shimon and a human musician can create improvised musical performances.
‘The visual connection between sound and motion can allow humans to anticipate, coordinate, and synchronize their gestures with the robot. To create intuitively as well as inspiring social collaboration with humans, Shimon analyses music based on computational models of human perception and generates algorithmic responses that are unlikely to be played by humans… The robot combines computational modelling of music perception, interaction, and improvisation, with the capacity to produce melodic acoustic responses in physical and visual manners.’
HB, CB, HBF, CBF
Hoffman, G., & Weinberg, G. (2011). Interactive improvisation with a robotic marimba player. In Musical robots and interactive multimodal systems (pp. 233-251). Springer Berlin Heidelberg.