Melodic Search: Strategies and Formats CS 275B/Music 254.
-
Upload
marian-todd -
Category
Documents
-
view
225 -
download
2
Transcript of Melodic Search: Strategies and Formats CS 275B/Music 254.
![Page 1: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/1.jpg)
Melodic Search: Strategies and Formats
CS 275B/Music 254
![Page 2: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/2.jpg)
On melody What is a theme? What is an incipit? Are all themes incipits? Can you tell the key from a melody? Can you tell whether something you hear
begins at the beginning? Is melody one-dimensional? How can we isolate a melody algorithmically?
CS 275B Eleanor Selfridge-Field2
![Page 3: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/3.jpg)
On melody What is a theme? Significant content What is an incipit? Beginning phrase Are all themes incipits? Can you tell the key from a melody? Can you tell whether something you hear
begins at the beginning? Is melody one-dimensional? How can we isolate a melody algorithmically?
CS 275B Eleanor Selfridge-Field3
![Page 4: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/4.jpg)
Non-musical search strategies
CS 275B Eleanor Selfridge-Field
4
![Page 5: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/5.jpg)
Non-musical search strategies
Probability ranking
Sorting and categorization
String matching, edit distance
N-grams
Dynamic programming
Pattern detection
CS 275B Eleanor Selfridge-Field5
![Page 6: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/6.jpg)
Probability ranking
CS 275B Eleanor Selfridge-Field6
Example: MELDEX
“Query-by-humming”: work of Lloyd Smith et al, c. 1995.
![Page 7: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/7.jpg)
Melodic sorting (incipits)
CS 275B Eleanor Selfridge-Field7
Examples from RISM
John Howard, "Strategies for sorting melodic incipits," CM 11 (1998).
[Ranking??]
![Page 8: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/8.jpg)
Edit distance: text
CS 275B Eleanor Selfridge-Field8
1. Item-by-item comparison
2. Penalties for
• substitutions
• insertions
• deletions
Bag
Bat
Cat
Catch
![Page 9: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/9.jpg)
Edit distance (music)
CS 275B Eleanor Selfridge-Field9
Ambiguities-iteration (accent invariant)-polyphonic involvement-decoration (accent invariant)
![Page 10: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/10.jpg)
N-grams
CS 275B Eleanor Selfridge-Field
10
MethodPick a string lengthSeek all its permutations
Beethoven: Archduke Trio
![Page 11: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/11.jpg)
N-grams
CS 275B Eleanor Selfridge-Field
11
http://www.peachnote.com/datasets.html
Music n-gram viewer
![Page 12: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/12.jpg)
Dynamic programming
CS 275B Eleanor Selfridge-Field12
Examples: Jonathan Foote
Performance-based
self-similarity matricesRhythmic similarity
![Page 13: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/13.jpg)
Pattern detection
CS 275B Eleanor Selfridge-Field13
![Page 14: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/14.jpg)
Pattern detection
CS 275B Eleanor Selfridge-Field14
Nettheim: MuSearch (SCORE)Settings of the word "Liebe"
Pattern realms• Lyrics• Pitch• Duration• Phrase structure
![Page 15: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/15.jpg)
CS 275B Eleanor Selfridge-Field15
Vulnerabilities
Target (scale degree): 32123Query
Pitch (scale-degree) matching without rhythmic, metric invariance
![Page 16: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/16.jpg)
Vulnerabilities
CS 275B Eleanor Selfridge-Field16
Target: 3331
Pattern-matching without:• Rests• Register considerations• Repeated notes
Query
![Page 17: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/17.jpg)
Themefinder
A search application for melodic data
CS 275B Eleanor Selfridge-Field17
![Page 18: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/18.jpg)
Themefinder
CS 275B Eleanor Selfridge-Field18
Classical = themesFolk = incipitsRenaissance = incipits
![Page 19: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/19.jpg)
Search examples
CS 275B Eleanor Selfridge-Field19
…in decreasing order of precision
http://www.themefinder.org
![Page 20: Melodic Search: Strategies and Formats CS 275B/Music 254.](https://reader035.fdocuments.net/reader035/viewer/2022062422/56649f225503460f94c3ab7d/html5/thumbnails/20.jpg)
Thought for the day “The dictionary describes melody as a series of
notes strung together in a meaningful sequence.”
CS 275B Eleanor Selfridge-Field20
Source: U.S. Patent application 20060254411 (Nov. 16, 2006)