dace. · 2020. 11. 19. · P 1 5 detected 7 detected 4 detected 4 detected 3 detected 3 detected...

1
5 detected P 1 7 detected 4 detected 4 detected 3 detected 3 detected Iterative Corrections on a Corpus of Mendelssohn String Quartets and Implications for MIR Analysis DATA QUALITY MATTERS COMPUTATIONAL TONAL STUDY (CTS) GROUP Schulich School of Music, McGill University, Canada Jacob deGroot-Maggetti Timothy de Reuse Samuel Howes Yaolong Ju Suzuka Kokubu Sylvain Margot Néstor Nápoles López Finn Upham CRIStAL, UMR 9189, CNRS, Université de Lille Laurent Feisthauer TREE STRUCTURE OF REPOSITORY . !"" 1_op12 # !"" C0 # # !"" 1_op12_1_omr.musicxml # # !"" 1_op12_2_omr.musicxml # # !"" 1_op12_3_omr.musicxml # # %"" 1_op12_4_omr.musicxml # !"" C1 # # !"" 1_op12_1_corrected.musicxml # # !"" 1_op12_2_corrected.musicxml # # !"" 1_op12_3_corrected.musicxml # # %"" 1_op12_4_corrected.musicxml # !"" C2 # # !"" 1_op12_1_revised.musicxml # # !"" 1_op12_2_revised.musicxml # # !"" 1_op12_3_revised.musicxml # # %"" 1_op12_4_revised.musicxml # !"" C3 # # !"" 1_op12_1_aligned.musicxml # # !"" 1_op12_2_aligned.musicxml # # !"" 1_op12_3_aligned.musicxml # # %"" 1_op12_4_aligned.musicxml # !"" README.md # !"" source_pdfs # # !"" Breitkopf_und_Härtel.pdf # # %"" Ernst_Eulenberg.pdf # %"" source_pdfs_by_movement # !"" 1_op12_1.pdf # !"" 1_op12_2.pdf # !"" 1_op12_3.pdf # %"" 1_op12_4.pdf !"" 2_op13 # !"" [similar to 1_op12] !"" 3_op44i # !"" [similar to 1_op12] !"" 4_op44ii # !"" [similar to 1_op12] !"" 5_op44iii # !"" [similar to 1_op12] !"" 6_op80 # !"" C2 # # !"" 6_op80_1_revised.musicxml # # !"" 6_op80_2_revised.musicxml # # !"" 6_op80_3_revised.musicxml # # %"" 6_op80_4_revised.musicxml # !"" C3 # # !"" 6_op80_1_aligned.musicxml # # !"" 6_op80_2_aligned.musicxml # # !"" 6_op80_3_aligned.musicxml # # %"" 6_op80_4_aligned.musicxml # !"" README.md # !"" source_pdfs # # !"" Breitkopf_und_Härtel_1875.pdf # # !"" Breitkopf_und_Härtel_1877.pdf # # %"" Ernst_Eulenburg.pdf # %"" String_Quartet_No._6_in_F_Minor_-_F._Mendelssohn_Op._80.mxl !"" FP_op81 # !"" [similar to 1_op12] !"" get_latest_files.sh !"" LICENSE !"" Musescore_format # !"" Four_Pieces_for_String_Quartet,_Op._81-1_Tema_con_variazioni.mscz # !"" Four_Pieces_for_String_Quartet,_Op._81-2_Scherzo.mscz # !"" Four_Pieces_for_String_Quartet,_Op._81-3_Capriccio.mscz # !"" Four_Pieces_for_String_Quartet,_Op._81-4_Fuga.mscz # !"" Quartet_No.1_in_E-flat_Major,_Op.12-1_Adagio_non_troppo.mscz # !"" Quartet_No.1_in_E-flat_Major,_Op.12-2_Canzonetta.mscz # !"" Quartet_No.1_in_E-flat_Major,_Op.12-3_Andante_espressivo.mscz # !"" Quartet_No.1_in_E-flat_Major,_Op.12-4_Molto_allegro_e_vivace.mscz # !"" Quartet_No.2_in_A_Major,_Op.13-1_Adagio_-_Allegro_vivace.mscz # !"" Quartet_No.2_in_A_Major,_Op.13-2_Adagio_non_lento.mscz # !"" Quartet_No.2_in_A_Major,_Op.13-3_Intermezzo.mscz # !"" Quartet_No.2_in_A_Major,_Op.13-4_Presto.mscz # !"" Quartet_No.3_in_D_Major,_Op.44,_No.1-1_Molto_allegro_vivace.mscz # !"" Quartet_No.3_in_D_Major,_Op.44,_No.1-2_Menuetto.mscz # !"" Quartet_No.3_in_D_Major,_Op.44,_No.1-3_Andante_espressivo.mscz # !"" Quartet_No.3_in_D_Major,_Op.44,_No.1-4_Presto_con_brio.mscz # !"" Quartet_No.4_in_E_Minor,_Op._44,_No.2-1_Allegro_assai_appasionato.mscz # !"" Quartet_No.4_in_E_Minor,_Op._44,_No.2-2_Scherzo.mscz # !"" Quartet_No.4_in_E_Minor,_Op._44,_No.2-3_Andante.mscz # !"" Quartet_No.4_in_E_Minor,_Op._44,_No.2-4_Presto.mscz # !"" Quartet_No.5_in_E-flat_Major,_Op._44,_No.3-1_Allegro_vivace.mscz # !"" Quartet_No.5_in_E-flat_Major,_Op._44,_No.3-2_Scherzo.mscz # !"" Quartet_No.5_in_E-flat_Major,_Op._44,_No.3-3_Adagio_non_troppo.mscz # !"" Quartet_No.5_in_E-flat_Major,_Op._44,_No.3-4_Molto_allegro_con_fuoco.mscz # !"" Quartet_No.6_in_F_Minor_Op._80-1_Allegro_vivace_assai.mscz # !"" Quartet_No.6_in_F_Minor_Op._80-2_Allegro_assai.mscz # !"" Quartet_No.6_in_F_Minor_Op._80-3_Adagio.mscz # %"" Quartet_No.6_in_F_Minor_Op._80-4_Allegro_molto.mscz !"" README.md SCORE ELEMENTS MATCH REMOVE STANDARDIZATION C0 C1 Pitches M Rhythm - ties M Rhythm - tremolo M Rhythm - fermatta M Rhythm - tuplets/triplets M Stemming - orientation M Stemming - grouping M Grouping of rests M Slurs M Voices - correcting OMR encoding of voice number per staff M Voices - removing unnecessary voices M Grace note M Clef changes (esp. cello) M Tempo (Largo, Allegro, Andante) - System text M Time signature change M C1 C2 Articulation text (pizz., arco) M Articulation symbols (staccato, accents) M staccato R accents Ornamentation symbols (turns, trills) M trills R others Dynamics - levels (ff, f, mf, mp, p, pp) R Dynamics - text (cresc., dim.) R Dynamics - angles R Dynamics - accents (sfz) R Voices - one voice per staff R Courtesy accidentals (after barlines) R Expression - text (espress., con fuoco, dolce) R Tempo - text change (accel., ritard., a tempo) R C2 C3 Layout - system boundaries S Metadata formatting S DETAILS OF THE CORRECTIONS MUSICAL EXAMPLES C0 60 C1 60 Op. 44 n°3, iv, m. 60–62 PhotoScore C0 MusicXML PDF Scores C1 C2 C3 Expert correction and proofreading 75 - 110 hrs 25 hrs 30 hrs PROCESS OF THE PROJECT AUTOMATIC ANALYSIS OF MENDELSSOHNS STRING QUARTETS ROUNDS OF MANUAL CORRECTIONS MENDELSSOHN GOES DIGITAL Op. 12 in Eb major (1829) Op. 13 in A minor (1827) Op. 44 n°1 in D major (1838) Op. 44 n°2 in D major (1838) Op. 44 n°3 in D major (1837) Op. 80 in F minor (1847) Four Pieces Op. 81 COMPARISON PAIR Changes in Local Key Annotations median(%) [min(%), max(%)] Changes in Chord Labels median(%) [min(%), max(%)] Changes in Monophonic Pattern median(%) [min(%), max(%)] Changes in PAC Detection variation(%) number Num. Patterns Coverage Cardinality Changes in PACs detected New PACs detected PACs lost C0 C1 46.8% [9.9%, 71.1%] 69.1% [17.5%, 96.7%] 85% [16%, 2100%] 110% [21%, 1100%] 8.3% [-22%, 29%] 154.5% 22 to 56 177.3% 39 22.7% 5 C1 C2 + C1 proofreading 0.4% [0.0%, 9.8%] 0.7% [0.0%, 41.1%] 0.0% [-5.1%, 7.1%] 0.041% [0.85%, 9.8%] 0.0% [-3.4%, 3.5%] -3.6% 56 to 54 1.8% 1 5.4% 3 C2 C3 + C2 proofreading 0.0% [0.0%, 3.0%] 0.0% [0.0%, 12.5%] 0.0% [0.0%, 0.0%] 0.0% [0.0%, 0.0%] 0.0% [0.0%, 0.0%] 1.9% 54 to 55 3.7% 2 1.9% 1 MIR ANALYSES OMR MAIN ERRORS Key finding Chord labelling PAC detection Pattern discovery 195 at do _ _s(,pn at a 195 C0 C3 Op. 44 n°2, iv, m. 195–203 GENERAL RESULTS Op. 12, i, m. 11–13 C1 C2 11 . I I cresc. 11 97 pizz. 97 pizz. 11 C2 C3 Op. 44 n°1, iii, m. 97–105 Accidentals Articulations Tremolo Staccato Slur Tie Rests Missing Misplaced Extra Hidden Key signatures Clefs Fast passages Sixteenths Eighths Stems are troublesome B B 7 C A m 7 C F s °/ 7 B D s ° D s ° 7 D s ° C F s ° 7 C A m F s ° 7 D 7 E m A m 7 B B 7 E m G E m A m 7 F s ° A m F s ° A m D s ° 7 B B 7 C A m 7 C F s °/ 7 B B 7 C F s ° 7 C A m F s ° 7 D s ° 7 E m F s ° E m B 7 E m G E m A m 7 F s ° A m F s ° A m D s ° 7 P 3 P 3 P 2 P 2 P 1 e e B E e e a a e Key finding Chord labelling PAC detection Pattern discovery MOST COMMON ERRORS MOST IMPACTFUL ERRORS 104 Expert correction and proofreading Expert correction and proofreading

Transcript of dace. · 2020. 11. 19. · P 1 5 detected 7 detected 4 detected 4 detected 3 detected 3 detected...

  • 5 detectedP1

    7 detected

    4 detected

    4 detected

    3 detected3 detected

    Iterative Corrections on a Corpus of Mendelssohn String Quartets and Implications for MIR Analysis

    DATA QUALITY MATTERS

    COMPUTATIONAL TONAL STUDY (CTS) GROUP

    Schulich School of Music, McGill University, Canada Jacob deGroot-Maggetti Timothy de Reuse Samuel Howes Yaolong Ju Suzuka Kokubu Sylvain Margot Néstor Nápoles López Finn Upham

    CRIStAL, UMR 9189, CNRS, Université de Lille Laurent Feisthauer

    TREE STRUCTURE OF REPOSITORY

    .!"" 1_op12#   !"" C0#   #   !"" 1_op12_1_omr.musicxml#   #   !"" 1_op12_2_omr.musicxml#   #   !"" 1_op12_3_omr.musicxml#   #   %"" 1_op12_4_omr.musicxml#   !"" C1#   #   !"" 1_op12_1_corrected.musicxml#   #   !"" 1_op12_2_corrected.musicxml#   #   !"" 1_op12_3_corrected.musicxml#   #   %"" 1_op12_4_corrected.musicxml#   !"" C2#   #   !"" 1_op12_1_revised.musicxml#   #   !"" 1_op12_2_revised.musicxml#   #   !"" 1_op12_3_revised.musicxml#   #   %"" 1_op12_4_revised.musicxml#   !"" C3#   #   !"" 1_op12_1_aligned.musicxml#   #   !"" 1_op12_2_aligned.musicxml#   #   !"" 1_op12_3_aligned.musicxml#   #   %"" 1_op12_4_aligned.musicxml#   !"" README.md#   !"" source_pdfs#   #   !"" Breitkopf_und_Härtel.pdf#   #   %"" Ernst_Eulenberg.pdf#   %"" source_pdfs_by_movement#   !"" 1_op12_1.pdf#   !"" 1_op12_2.pdf#   !"" 1_op12_3.pdf#   %"" 1_op12_4.pdf!"" 2_op13#   !"" [similar to 1_op12]!"" 3_op44i#   !"" [similar to 1_op12]!"" 4_op44ii#   !"" [similar to 1_op12]!"" 5_op44iii#   !"" [similar to 1_op12]!"" 6_op80#   !"" C2#   #   !"" 6_op80_1_revised.musicxml#   #   !"" 6_op80_2_revised.musicxml#   #   !"" 6_op80_3_revised.musicxml#   #   %"" 6_op80_4_revised.musicxml#   !"" C3#   #   !"" 6_op80_1_aligned.musicxml#   #   !"" 6_op80_2_aligned.musicxml#   #   !"" 6_op80_3_aligned.musicxml#   #   %"" 6_op80_4_aligned.musicxml#   !"" README.md#   !"" source_pdfs#   #   !"" Breitkopf_und_Härtel_1875.pdf#   #   !"" Breitkopf_und_Härtel_1877.pdf#   #   %"" Ernst_Eulenburg.pdf#   %"" String_Quartet_No._6_in_F_Minor_-_F._Mendelssohn_Op._80.mxl!"" FP_op81#   !"" [similar to 1_op12]!"" get_latest_files.sh!"" LICENSE!"" Musescore_format#   !"" Four_Pieces_for_String_Quartet,_Op._81-1_Tema_con_variazioni.mscz#   !"" Four_Pieces_for_String_Quartet,_Op._81-2_Scherzo.mscz#   !"" Four_Pieces_for_String_Quartet,_Op._81-3_Capriccio.mscz#   !"" Four_Pieces_for_String_Quartet,_Op._81-4_Fuga.mscz#   !"" Quartet_No.1_in_E-flat_Major,_Op.12-1_Adagio_non_troppo.mscz#   !"" Quartet_No.1_in_E-flat_Major,_Op.12-2_Canzonetta.mscz#   !"" Quartet_No.1_in_E-flat_Major,_Op.12-3_Andante_espressivo.mscz#   !"" Quartet_No.1_in_E-flat_Major,_Op.12-4_Molto_allegro_e_vivace.mscz#   !"" Quartet_No.2_in_A_Major,_Op.13-1_Adagio_-_Allegro_vivace.mscz#   !"" Quartet_No.2_in_A_Major,_Op.13-2_Adagio_non_lento.mscz#   !"" Quartet_No.2_in_A_Major,_Op.13-3_Intermezzo.mscz#   !"" Quartet_No.2_in_A_Major,_Op.13-4_Presto.mscz#   !"" Quartet_No.3_in_D_Major,_Op.44,_No.1-1_Molto_allegro_vivace.mscz#   !"" Quartet_No.3_in_D_Major,_Op.44,_No.1-2_Menuetto.mscz#   !"" Quartet_No.3_in_D_Major,_Op.44,_No.1-3_Andante_espressivo.mscz#   !"" Quartet_No.3_in_D_Major,_Op.44,_No.1-4_Presto_con_brio.mscz#   !"" Quartet_No.4_in_E_Minor,_Op._44,_No.2-1_Allegro_assai_appasionato.mscz#   !"" Quartet_No.4_in_E_Minor,_Op._44,_No.2-2_Scherzo.mscz#   !"" Quartet_No.4_in_E_Minor,_Op._44,_No.2-3_Andante.mscz#   !"" Quartet_No.4_in_E_Minor,_Op._44,_No.2-4_Presto.mscz#   !"" Quartet_No.5_in_E-flat_Major,_Op._44,_No.3-1_Allegro_vivace.mscz#   !"" Quartet_No.5_in_E-flat_Major,_Op._44,_No.3-2_Scherzo.mscz#   !"" Quartet_No.5_in_E-flat_Major,_Op._44,_No.3-3_Adagio_non_troppo.mscz#   !"" Quartet_No.5_in_E-flat_Major,_Op._44,_No.3-4_Molto_allegro_con_fuoco.mscz#   !"" Quartet_No.6_in_F_Minor_Op._80-1_Allegro_vivace_assai.mscz#   !"" Quartet_No.6_in_F_Minor_Op._80-2_Allegro_assai.mscz#   !"" Quartet_No.6_in_F_Minor_Op._80-3_Adagio.mscz#   %"" Quartet_No.6_in_F_Minor_Op._80-4_Allegro_molto.mscz!"" README.md

    SCORE ELEMENTS MATCH REMOVE STANDARDIZATION

    C0 → C1

    Pitches M

    Rhythm - ties M

    Rhythm - tremolo M

    Rhythm - fermatta M

    Rhythm - tuplets/triplets M

    Stemming - orientation M

    Stemming - grouping M

    Grouping of rests M

    Slurs M

    Voices - correcting OMR encoding of voice number per staff M

    Voices - removing unnecessary voices M

    Grace note M

    Clef changes (esp. cello) M

    Tempo (Largo, Allegro, Andante) - System text M

    Time signature change M

    C1 → C2

    Articulation text (pizz., arco) M

    Articulation symbols (staccato, accents) M staccato R accents

    Ornamentation symbols (turns, trills) M trills R others

    Dynamics - levels (ff, f, mf, mp, p, pp) R

    Dynamics - text (cresc., dim.) R

    Dynamics - angles R

    Dynamics - accents (sfz) R

    Voices - one voice per staff R

    Courtesy accidentals (after barlines) R

    Expression - text (espress., con fuoco, dolce) R

    Tempo - text change (accel., ritard., a tempo) R

    C2 → C3Layout - system boundaries S

    Metadata formatting S

    DETAILS OF THE CORRECTIONS MUSICAL EXAMPLES

    C0

    60

    54

    53

    45

    siacc.

    cantabile

    stare,

    staec

    dace.

    3 3

    3

    dl'm.

    im.

    tm.

    4

    C1

    93

    87

    76

    71

    60

    3

    Op. 44 n°3, iv, m. 60–62

    PhotoScore

    C0

    MusicXMLPDF

    Scores C1 C2 C3Expert correction and proofreading

    75 - 110 hrs 25 hrs 30 hrs

    PROCESS OF THE PROJECT

    AUTOMATIC ANALYSIS OF MENDELSSOHN’S STRING QUARTETS

    ROUNDS OF MANUAL CORRECTIONS

    MENDELSSOHN GOES DIGITAL

    Op. 12 in Eb major (1829)

    Op. 13 in A minor (1827)

    Op. 44 n°1 in D major (1838)

    Op. 44 n°2 in D major (1838)

    Op. 44 n°3 in D major (1837)

    Op. 80 in F minor (1847)

    Four Pieces Op. 81

    COMPARISON PAIRChanges in Local Key Annotations

    median(%) [min(%), max(%)]

    Changes in Chord Labels


    median(%) [min(%), max(%)]

    Changes in Monophonic Pattern 



    median(%) [min(%), max(%)]

    Changes in PAC Detection 
variation(%) 


    number Num. Patterns Coverage Cardinality Changes in PACs detected New PACs detected PACs lost

    C0 → C1 46.8% [9.9%, 71.1%] 69.1% [17.5%, 96.7%] 85% [16%, 2100%] 110% [21%, 1100%] 8.3% [-22%, 29%]154.5%

    22 to 56

    177.3%

    39

    22.7%

    5

    C1 → C2
+


    C1 proofreading 0.4% [0.0%, 9.8%] 0.7% [0.0%, 41.1%] 0.0% [-5.1%, 7.1%] 0.041% [0.85%, 9.8%] 0.0% [-3.4%, 3.5%]

    -3.6%

    56 to 54

    1.8%

    1

    5.4%

    3

    C2 → C3
+


    C2 proofreading 0.0% [0.0%, 3.0%] 0.0% [0.0%, 12.5%] 0.0% [0.0%, 0.0%] 0.0% [0.0%, 0.0%] 0.0% [0.0%, 0.0%]

    1.9%

    54 to 55

    3.7%

    2

    1.9%

    1

    MIR ANALYSES

    OMR MAIN ERRORS

    Key

    finding

    Chord

    labelling

    PAC

    detection

    Pattern

    discovery

    204

    195

    186

    176

    atdo __s(,pn

    at

    ere

    a

    :0.

    crr _

    6

    207

    204

    195

    186

    6

    C0

    C3

    Op. 44 n°2, iv, m. 195–203

    GENERAL RESULTS

    Op. 12, i, m. 11–13

    C1 C2

    Quartet No.1 in E-flat Major, Op.12

    19

    11

    10

    Vc.

    Vc.

    Vc.

    Violoncello

    Vla

    Vla

    Vla

    Viola

    Vlo II

    Vlo II

    Vlo II

    Violino II

    Vlo I

    Vlo I

    Vlo I

    Violino I

    cresc.

    cresc.

    cresc.

    cresc.

    cresc.

    cresc.

    cresc.

    cresc.

    cresc.

    cresc.

    cresc.

    espress.

    Allegro non tardante

    cresc.

    espress.

    Adagio non troppo.

    Quartet No.1 in E-flat Major, Op.12

    31

    19

    11

    10

    Vc.

    Vc.

    Vc.

    Vc.

    Violoncello

    Vla

    Vla

    Vla

    Vla

    Viola

    Vlo II

    Vlo II

    Vlo II

    Vlo II

    Violino II

    Vlo I

    Vlo I

    Vlo I

    Vlo I

    Violino I

    3

    3

    Adagio non troppo.

    124

    115

    106

    97

    88

    arco

    pizz.

    4 CC BY 4.0 License

    97

    96

    pizz.

    11

    C2 C3

    Op. 44 n°1, iii, m. 97–105

    •Accidentals

    •Articulations ‣Tremolo ‣Staccato ‣Slur ‣Tie

    •Rests ‣Missing ‣Misplaced ‣Extra ‣Hidden

    •Key signatures •Clefs

    •Fast passages ‣Sixteenths ‣Eighths ‣Stems are troublesome

    B B7 C Am 7 C Fs°/7 B Ds° Ds°7 Ds° C Fs°7 C Am Fs°7 D7 Em Am7 B B7 Em G Em Am7 Fs° Am Fs° Am Ds°7

    B B7 C Am 7 C Fs°/7 B B7 C Fs°7 C Am Fs°7 Ds°7 Em Fs° Em B7 Em G Em Am7 Fs° Am Fs° Am Ds°7

    P3 P3

    P2

    P2

    P1

    e

    eB E e e a

    a e

    Key

    finding

    Chord

    labelling

    PAC

    detection

    Pattern

    discovery

    MOST COMMON ERRORS MOST IMPACTFUL ERRORS

    105

    104

    arco

    12

    Expert correction and proofreading

    Expert correction and proofreading