P.I.A.N.O.: Faster Piano Learning with Interactive Projection

Learning to play the piano is a prolonged challenge for novices. It requires them to learn sheet music notation and its mapping to respective piano keys, together with articulation details. Smooth playing further requires correct finger postures. The result is a slow learning progress, often causing frustration and strain. To overcome these issues, we propose P.I.A.N.O., a piano learning system with interactive projection that facilitates a fast learning process. Note information in form of an enhanced piano roll notation is directly projected onto the instrument and allows mapping of notes to piano keys without prior sight-reading skills. Three learning modes support the natural learning process with live feedback and performance evaluation. We report the results of two user studies, which show that P.I.A.N.O. supports faster learning, requires significantly less cognitive load, provides better user experience, and increases perceived musical quality compared to sheet music notation and non-projected piano roll notation. 

Implementation and Visualization

Selected Press


New Scientist


TechCrunchEngadget, Huffington Post, Gizmodo, Uebergizmo, BBC




Katja Rogers

Jan Gugenheimer

Bastian Könings

Enrico Rukzio

Michael Weber


Rogers, Katja; Röhlig, Amrei; Weing, Matthias; Gugenheimer, Jan; Könings, Bastian; Klepsch, Melina; Schaub, Florian; Rukzio, Enrico; Seufert, Tina; Weber, Michael P.I.A.N.O.: Faster Piano Learning with Interactive Projection Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces aus ITS '14 , Seite 149--158. Herausgeber: ACM, New York, NY, USA 2014

DOI: 10.1145/2669485.2669514


Weing, Matthias; Röhlig, Amrei; Rogers, Katja; Gugenheimer, Jan; Schaub, Florian; Könings, Bastian; Rukzio, Enrico; Weber, Michael P.I.A.N.O.: Enhancing Instrument Learning via Interactive Projected Augmentation Proceedings of UbiComp '13 Adjunct (2013 ACM Conference on Pervasive and Ubiquitous Computing), ACM, 4 pages 2013

DOI: 10.1145/2494091.2494113