{"id":5047,"date":"2024-03-26T03:31:05","date_gmt":"2024-03-26T03:31:05","guid":{"rendered":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047"},"modified":"2024-04-02T19:37:27","modified_gmt":"2024-04-02T18:37:27","slug":"automatic-extraction-of-phrase-boundary-credences-and-interpretation-comparisons","status":"publish","type":"post","link":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047","title":{"rendered":"Automatic Extraction of Phrase Boundary Credences and Interpretation Comparisons"},"content":{"rendered":"\n

Our paper on scalable, nuanced detection of phrase boundary credences from music tempo and\/or loudness, and its application to a comparative analysis of Mazurka interpretations, is now available on Music & Science<\/a> and is part of the collection on Explaining music with AI: Advancing the scientific understanding of music through computation<\/em> guest edited by David Meredith, Anja Volk & Tom Collins.<\/p>\n\n\n\n

Why study phrasing?<\/em> Phrasing in performed music, analogous to making phrases and sentences in speech, provides a trace of a performer’s unique way of organising music material into coherent segments. Performers influence listeners’ perception of phrases by modulating tempo and loudness. Phrase boundaries are also closely tied to breathing, especially for wind players and vocalists. Being able to automatically extract phrase boundaries at scale allows us to study diversity in musical interpretations.<\/p>\n\n\n\n

The method described in this Music & Science article is the latest in a series of papers on extracting phrase boundaries beginning with dynamic programming (Ching-Hua Chuan & Chew ISMIR 2007) and maximum a priori estimation (Dan Stowell & Chew 2013). The MazurkaBL dataset (Kosta, Bandtlow, Chew 2018), score-aligned loudness, beat, expressive markings for 2000 Chopin Mazurka recordings on which the method was tested was part of Katerina’s PhD.<\/p>\n\n\n\n

Guichaoua, C., Lascabettes, P., & Chew, E. (2024). End-to-End Bayesian Segmentation and Similarity Assessment of Performed Music Tempo and Dynamics without Score Information. Music & Science, 7. doi.org\/10.1177\/20592043241233411<\/a><\/p>\n\n\n\n

End-to-End Bayesian Segmentation and Similarity Assessment of Performed Music Tempo and Dynamics without Score Information<\/strong><\/p>\n\n\n\n

Corentin Guichaoua, Paul Lascabettes, Elaine Chew<\/p>\n\n\n\n

Abstract:<\/strong> Segmenting continuous sensory input into coherent segments and subsegments is an important part of perception. Music is no exception. By shaping the acoustic properties of music during performance, musicians can strongly influence the perceived segmentation. Two main techniques musicians employ are the modulation of tempo and dynamics. Such variations carry important information for segmentation and lend themselves well to numerical analysis methods. In this article, based on tempo or loudness modulations alone, we propose a novel end-to-end Bayesian framework using dynamic programming to retrieve a musician’s expressed segmentation. The method computes the credence of all possible segmentations of the recorded performance. The output is summarized in two forms: as a beat-by-beat profile revealing the posterior credence of plausible boundaries, and as expanded credence segment maps, a novel representation that converts readily to a segmentation lattice but retains information about the posterior uncertainty on the exact position of segments\u2019 endpoints. To compare any two segmentation profiles, we introduce a method based on unbalanced optimal transport. Experimental results on the MazurkaBL dataset show that despite the drastic dimension reduction from the input data, the segmentation recovery is sufficient for deriving musical insights from comparative examination of recorded performances. This Bayesian segmentation method thus offers an alternative to binary boundary detection and finds multiple hypotheses fitting information from recorded music performances.<\/p>\n\n\n\n

Code and data availability:<\/strong> Code for performing the probabilistic segmentation and its visualization is available at github.com\/erc-cosmos\/probabilistic-segmentation<\/a>. The MazurkaBL data set is available at github.com\/katkost\/MazurkaBL<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

Finding plausible phrase boundaries from tempo and\/or loudness data applied to analysis of Mazurka interpretations now out on Music & Science<\/p>\n","protected":false},"author":2,"featured_media":5049,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[102],"tags":[131,167],"class_list":["post-5047","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-research-publications","tag-interpretation","tag-musical-structures"],"yoast_head":"\nAutomatic Extraction of Phrase Boundary Credences and Interpretation Comparisons - COSMOS<\/title>\n<meta name=\"description\" content=\"Finding plausible phrase boundaries from tempo and\/or loudness data applied to analysis of Mazurka interpretations now out on Music & Science\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Automatic Extraction of Phrase Boundary Credences and Interpretation Comparisons - COSMOS\" \/>\n<meta property=\"og:description\" content=\"Finding plausible phrase boundaries from tempo and\/or loudness data applied to analysis of Mazurka interpretations now out on Music & Science\" \/>\n<meta property=\"og:url\" content=\"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047\" \/>\n<meta property=\"og:site_name\" content=\"COSMOS\" \/>\n<meta property=\"article:published_time\" content=\"2024-03-26T03:31:05+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-04-02T18:37:27+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cosmos.isd.kcl.ac.uk\/wp-content\/uploads\/2024\/04\/boundary-credence-a4-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"1810\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"E C\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"E C\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047\"},\"author\":{\"name\":\"E C\",\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/#\\\/schema\\\/person\\\/5c853492b3f70d07c67a26de366563cd\"},\"headline\":\"Automatic Extraction of Phrase Boundary Credences and Interpretation Comparisons\",\"datePublished\":\"2024-03-26T03:31:05+00:00\",\"dateModified\":\"2024-04-02T18:37:27+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047\"},\"wordCount\":511,\"publisher\":{\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/boundary-credence-a4-scaled.jpg\",\"keywords\":[\"interpretation\",\"musical structures\"],\"articleSection\":[\"Publications\"],\"inLanguage\":\"en-GB\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047\",\"url\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047\",\"name\":\"Automatic Extraction of Phrase Boundary Credences and Interpretation Comparisons - COSMOS\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/boundary-credence-a4-scaled.jpg\",\"datePublished\":\"2024-03-26T03:31:05+00:00\",\"dateModified\":\"2024-04-02T18:37:27+00:00\",\"description\":\"Finding plausible phrase boundaries from tempo and\\\/or loudness data applied to analysis of Mazurka interpretations now out on Music & Science\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047#primaryimage\",\"url\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/boundary-credence-a4-scaled.jpg\",\"contentUrl\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/wp-content\\\/uploads\\\/2024\\\/04\\\/boundary-credence-a4-scaled.jpg\",\"width\":2560,\"height\":1810},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?p=5047#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Automatic Extraction of Phrase Boundary Credences and Interpretation Comparisons\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/#website\",\"url\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/\",\"name\":\"COSMOS\",\"description\":\"Computational Shaping and Modeling of Musical Structures\",\"publisher\":{\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/#organization\",\"name\":\"COSMOS\",\"url\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/wp-content\\\/uploads\\\/2019\\\/06\\\/cosmos-logo-604x150.jpg\",\"contentUrl\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/wp-content\\\/uploads\\\/2019\\\/06\\\/cosmos-logo-604x150.jpg\",\"width\":604,\"height\":150,\"caption\":\"COSMOS\"},\"image\":{\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/#\\\/schema\\\/logo\\\/image\\\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/#\\\/schema\\\/person\\\/5c853492b3f70d07c67a26de366563cd\",\"name\":\"E C\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/23ed22220028c3ccd91fb97a07f5c65c81b6fe8041ae527fc611792435d43905?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/23ed22220028c3ccd91fb97a07f5c65c81b6fe8041ae527fc611792435d43905?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/23ed22220028c3ccd91fb97a07f5c65c81b6fe8041ae527fc611792435d43905?s=96&d=mm&r=g\",\"caption\":\"E C\"},\"url\":\"https:\\\/\\\/cosmos.isd.kcl.ac.uk\\\/?author=2\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Automatic Extraction of Phrase Boundary Credences and Interpretation Comparisons - COSMOS","description":"Finding plausible phrase boundaries from tempo and\/or loudness data applied to analysis of Mazurka interpretations now out on Music & Science","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047","og_locale":"en_GB","og_type":"article","og_title":"Automatic Extraction of Phrase Boundary Credences and Interpretation Comparisons - COSMOS","og_description":"Finding plausible phrase boundaries from tempo and\/or loudness data applied to analysis of Mazurka interpretations now out on Music & Science","og_url":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047","og_site_name":"COSMOS","article_published_time":"2024-03-26T03:31:05+00:00","article_modified_time":"2024-04-02T18:37:27+00:00","og_image":[{"width":2560,"height":1810,"url":"https:\/\/cosmos.isd.kcl.ac.uk\/wp-content\/uploads\/2024\/04\/boundary-credence-a4-scaled.jpg","type":"image\/jpeg"}],"author":"E C","twitter_card":"summary_large_image","twitter_misc":{"Written by":"E C","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047#article","isPartOf":{"@id":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047"},"author":{"name":"E C","@id":"https:\/\/cosmos.isd.kcl.ac.uk\/#\/schema\/person\/5c853492b3f70d07c67a26de366563cd"},"headline":"Automatic Extraction of Phrase Boundary Credences and Interpretation Comparisons","datePublished":"2024-03-26T03:31:05+00:00","dateModified":"2024-04-02T18:37:27+00:00","mainEntityOfPage":{"@id":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047"},"wordCount":511,"publisher":{"@id":"https:\/\/cosmos.isd.kcl.ac.uk\/#organization"},"image":{"@id":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047#primaryimage"},"thumbnailUrl":"https:\/\/cosmos.isd.kcl.ac.uk\/wp-content\/uploads\/2024\/04\/boundary-credence-a4-scaled.jpg","keywords":["interpretation","musical structures"],"articleSection":["Publications"],"inLanguage":"en-GB"},{"@type":"WebPage","@id":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047","url":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047","name":"Automatic Extraction of Phrase Boundary Credences and Interpretation Comparisons - COSMOS","isPartOf":{"@id":"https:\/\/cosmos.isd.kcl.ac.uk\/#website"},"primaryImageOfPage":{"@id":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047#primaryimage"},"image":{"@id":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047#primaryimage"},"thumbnailUrl":"https:\/\/cosmos.isd.kcl.ac.uk\/wp-content\/uploads\/2024\/04\/boundary-credence-a4-scaled.jpg","datePublished":"2024-03-26T03:31:05+00:00","dateModified":"2024-04-02T18:37:27+00:00","description":"Finding plausible phrase boundaries from tempo and\/or loudness data applied to analysis of Mazurka interpretations now out on Music & Science","breadcrumb":{"@id":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047#primaryimage","url":"https:\/\/cosmos.isd.kcl.ac.uk\/wp-content\/uploads\/2024\/04\/boundary-credence-a4-scaled.jpg","contentUrl":"https:\/\/cosmos.isd.kcl.ac.uk\/wp-content\/uploads\/2024\/04\/boundary-credence-a4-scaled.jpg","width":2560,"height":1810},{"@type":"BreadcrumbList","@id":"https:\/\/cosmos.isd.kcl.ac.uk\/?p=5047#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/cosmos.isd.kcl.ac.uk\/"},{"@type":"ListItem","position":2,"name":"Automatic Extraction of Phrase Boundary Credences and Interpretation Comparisons"}]},{"@type":"WebSite","@id":"https:\/\/cosmos.isd.kcl.ac.uk\/#website","url":"https:\/\/cosmos.isd.kcl.ac.uk\/","name":"COSMOS","description":"Computational Shaping and Modeling of Musical Structures","publisher":{"@id":"https:\/\/cosmos.isd.kcl.ac.uk\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/cosmos.isd.kcl.ac.uk\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Organization","@id":"https:\/\/cosmos.isd.kcl.ac.uk\/#organization","name":"COSMOS","url":"https:\/\/cosmos.isd.kcl.ac.uk\/","logo":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/cosmos.isd.kcl.ac.uk\/#\/schema\/logo\/image\/","url":"https:\/\/cosmos.isd.kcl.ac.uk\/wp-content\/uploads\/2019\/06\/cosmos-logo-604x150.jpg","contentUrl":"https:\/\/cosmos.isd.kcl.ac.uk\/wp-content\/uploads\/2019\/06\/cosmos-logo-604x150.jpg","width":604,"height":150,"caption":"COSMOS"},"image":{"@id":"https:\/\/cosmos.isd.kcl.ac.uk\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/cosmos.isd.kcl.ac.uk\/#\/schema\/person\/5c853492b3f70d07c67a26de366563cd","name":"E C","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/23ed22220028c3ccd91fb97a07f5c65c81b6fe8041ae527fc611792435d43905?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/23ed22220028c3ccd91fb97a07f5c65c81b6fe8041ae527fc611792435d43905?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/23ed22220028c3ccd91fb97a07f5c65c81b6fe8041ae527fc611792435d43905?s=96&d=mm&r=g","caption":"E C"},"url":"https:\/\/cosmos.isd.kcl.ac.uk\/?author=2"}]}},"_links":{"self":[{"href":"https:\/\/cosmos.isd.kcl.ac.uk\/index.php?rest_route=\/wp\/v2\/posts\/5047","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cosmos.isd.kcl.ac.uk\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cosmos.isd.kcl.ac.uk\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cosmos.isd.kcl.ac.uk\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/cosmos.isd.kcl.ac.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=5047"}],"version-history":[{"count":7,"href":"https:\/\/cosmos.isd.kcl.ac.uk\/index.php?rest_route=\/wp\/v2\/posts\/5047\/revisions"}],"predecessor-version":[{"id":5060,"href":"https:\/\/cosmos.isd.kcl.ac.uk\/index.php?rest_route=\/wp\/v2\/posts\/5047\/revisions\/5060"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cosmos.isd.kcl.ac.uk\/index.php?rest_route=\/wp\/v2\/media\/5049"}],"wp:attachment":[{"href":"https:\/\/cosmos.isd.kcl.ac.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=5047"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cosmos.isd.kcl.ac.uk\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=5047"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cosmos.isd.kcl.ac.uk\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=5047"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}