The expanded paper on CosmoNote is now available in the Journal of the Audio Engineering Society’s Special Issue on Expanding Frontiers of Web Audio edited by Frederic Font, Ariane Stolfi, and Franziska Schroeder. The special issue focuses on advanced Web Audio–based tools, frameworks, and applications; all articles were submitted to a JAES open call and underwent a thorough review process.
Our paper introduces the design decisions in CosmoNote and shows how the citizen science platform exploits web audio technologies to enable large-scale collection of annotations of performed music. A case study is presented that examines listener and performer annotations of Beethoven’s 32 Variations.
Fyfe, L., D. Bedoya, E. Chew (2022). Annotation and Analysis of Recorded Piano Performances on the Web. Journal of the Audio Engineering Society, 70(11): 962–978. doi: 10.17743/jaes.2022.0057.
Annotation and Analysis of Recorded Piano Performances on the Web
Abstract: Advancing knowledge and understanding about performed music is hampered by a lack of annotation data for music expressivity. To enable large-scale collection of annotations and explorations of performed music, the authors have created a workflow that is enabled by CosmoNote, a Web-based citizen science tool for annotating musical structures created by the performer and experienced by the listener during expressive piano performances. To enable annotation tasks with CosmoNote, annotators can listen to the recorded performances and view synchronized music visualization layers including the audio waveform, recorded notes, extracted audio features such as loudness and tempo, and score features such as harmonic tension. Annotators have the ability to zoom into specific parts of a performance and see visuals and listen to the audio from just that part. The annotation of performed musical structures is done by using boundaries of varying strengths, regions, comments, and note groups. By analyzing the annotations collected with CosmoNote, performance decisions will be able to be modeled and analyzed in order to aid in the understanding of expressive choices in musical performances and discover the vocabulary of performed musical structures.
Download: PDF (HIGH Res) (10.7MB)
Download: PDF (LOW Res) (1.5MB)
