CompMusic: Current research and initial results...compmusic Research topics • “Intonation”:...

20
compmusic CompMusic: Current research and initial results Xavier Serra Music Technology Group Universitat Pompeu Fabra, Barcelona http://compmusic.upf.edu

Transcript of CompMusic: Current research and initial results...compmusic Research topics • “Intonation”:...

  • compmusic

    CompMusic: Current research and

    initial results

    Xavier Serra Music Technology Group

    Universitat Pompeu Fabra, Barcelona http://compmusic.upf.edu

  • compmusic

    CompMusic objectives

    •  Promote culture specific approaches in Music Computing research.

    •  Advance in the automatic description of music.

    •  Reduce the gap between audio signal descriptions and semantic/cultural music concepts.

    •  Develop information modeling techniques applicable to the art music traditions of: India (Hindustani, Carnatic), Turkey (Turkish-makam), Arab countries (Andalusi), China (Han).

  • compmusic

    CompMusic tasks

  • compmusic

    Research topics

    •  “Intonation”: Pitches used by a performer in a piece (~tuning).

    •  “Melody”: Temporal pitch variations performed in a piece, organized in “motifs” of different temporal scales.

    •  “Rhythm”: Arrangement of sounds and silences in time establishing patterns of strong and weak events.

    •  “Community”: Group of people sharing a cultural tradition and common aesthetic values.

    •  “Browsing”: Music discovery within a culture specific music collection.

  • compmusic

    Intonation

  • compmusic

    Intonation

  • compmusic

    Intonation

    Comparison between makam templates and measured histograms

  • compmusic

    Melody Turkish-makam notation:

    Pitch contour:

  • compmusic

    Melody

    Manual annotation of gamakas in Carnatic music

  • compmusic

    Rhythm

    Hierarchical structure of meter

  • compmusic

    Communities

    Community modeling and adaptation

    Free

    soun

    d re

    sour

    ces

    Impro

    ve so

    und

    samp

    le de

    scrip

    tions

    Reinf

    orce

    reuse

    , crea

    tivity

    Reinf

    orce

    socia

    l acti

    vity

    Tag cloud

  • compmusic

    Audio recordings

    (file server)

    Editorial metadata

    (MusicBrainz)

    Server

    Database

    Semantic information (Wikipedia,…)

    Browsing

    Audio features (computed)

  • CompMusic*browser*Culture'specific'music'discovery'

    Carna4c' Turkish8makam'

    Release Recording Artists Raga Tala

    Concert'For'Peace:'Royal'Albert'Hall'

    Raga'Mishra'Khamaj''Slow'and'fast'Gats'

    Ravi'Shankar'(Sitar)' Mishra'Khamaj' Teental'

    Ravi'Shankar8Raga'Mishra'Khamaj,'Slow'and'Fast'Gats'

    Hindustani'

    Andalusi' Han'

    Lead'performer'

    Lead'instrument'

    Form'

    Release'Title'

    Year'of'performance'

    Raga'

    Tala'Lay'

    Sec4on' Gharana'

    Year'of''release'

    Performer'accomp.'

    Instrument'accomp.'

    Composer'

    Lyricist'

    Raga'4me'

    Solo'

    Recordings' Details' Analysis' E8listen' Similarity'

    Raga'4me:'Evening'

    And Or Not !

    Raga:'Mishra'Khamaj'

    And Or Not !

    Solo:'Tabla'

    And Or Not !

  • CompMusic*browser*Culture'specific'music'discovery'

    Carna4c' Turkish8makam'

    Ravi'Shankar8Raga'Mishra'Khamaj,'Slow'and'Fast'Gats'

    Hindustani'

    Andalusi' Han'

    Release*Informa5on*

    Date* 1995'

    Country* India'

    Type* Live'Concert'

    Format* Audio'CD'

    Disks* 2'

    Label* Moment'

    Performers* Instrument* Gharana* Guru*

    Ravi'Shankar' Sitar' Maihar' Allauddin'Khan'

    Zakir'Hussain' Tabla' Punjab' Alla'Rakha'

    Partho'Sarathy' Sarod' Maihar' Ravi'Shankar'

    Editorial*Metadata*

    Ar5st* Ravi'Shankar'

    Concert* Concert'for'peace:'Royal'Albert'Hall'

    Place* London'

    Year* 1993'

    Raga* Mishra'Khamaj'

    Raga*5me* Evening'

    Tala* Teental'

    Laya* Vilambit,'Drut'

    Lead'performer'

    Lead'instrument'

    Form'

    Release'Title'

    Year'of'performance'

    Raga'

    Tala'Lay'

    Sec4on' Gharana'

    Year'of''release'

    Performer'accomp.'

    Instrument'accomp.'

    Composer'

    Lyricist'

    Raga'4me'

    Solo'

    Recordings' Details' Analysis' E8listen' Similarity'

    Raga'4me:'Evening'

    And Or Not !

    Raga:'Mishra'Khamaj'

    And Or Not !

    Solo:'Tabla'

    And Or Not !

    Recordings*in*the*release*

    Disk1*

    01'8'Raga'Jait'Alap8Jor8Jhala'

    02'8'Raga'Jait'Gat'

    03'8'Raga'Kirwani'Slow'And'Fast'Gats'

    Disk2*

    01'8'Raga'Mishra'Khamaj,'Slow'And'Fast'Gats'✔'

  • CompMusic*browser*Culture'specific'music'discovery'

    Carna4c' Turkish8makam'

    Ravi'Shankar8Raga'Mishra'Khamaj,'Slow'and'Fast'Gats'

    Hindustani'

    Andalusi' Han'

    Release*Informa5on*

    Date* 1995'

    Country* India'

    Type* Live'Concert'

    Format* Audio'CD'

    Disks* 2'

    Label* Moment'

    Performers* Instrument* Gharana* Guru*

    Ravi'Shankar' Sitar' Maihar' Allauddin'Khan'

    Zakir'Hussain' Tabla' Punjab' Alla'Rakha'

    Partho'Sarathy' Sarod' Maihar' Ravi'Shankar'

    Editorial*Metadata*

    Ar5st* Ravi'Shankar'

    Concert* Concert'for'peace:'Royal'Albert'Hall'

    Place* London'

    Year* 1993'

    Raga* Mishra'Khamaj'

    Raga*5me* Evening'

    Tala* Teental'

    Laya* Vilambit,'Drut'

    Lead'performer'

    Lead'instrument'

    Form'

    Release'Title'

    Year'of'performance'

    Raga'

    Tala'Lay'

    Sec4on' Gharana'

    Year'of''release'

    Performer'accomp.'

    Instrument'accomp.'

    Composer'

    Lyricist'

    Raga'4me'

    Solo'

    Recordings' Details' Analysis' E8listen' Similarity'

    Raga'4me:'Evening'

    And Or Not !

    Raga:'Mishra'Khamaj'

    And Or Not !

    Solo:'Tabla'

    And Or Not !

    Recordings*in*the*release*

    Disk1*

    01'8'Raga'Jait'Alap8Jor8Jhala'

    02'8'Raga'Jait'Gat'

    03'8'Raga'Kirwani'Slow'And'Fast'Gats'

    Disk2*

    01'8'Raga'Mishra'Khamaj,'Slow'And'Fast'Gats'✔'

  • CompMusic*browser*Culture'specific'music'discovery'

    Carna4c' Turkish8makam'

    Ravi'Shankar8Raga'Mishra'Khamaj,'Slow'and'Fast'Gats'

    Hindustani'

    Andalusi' Han'

    Lead'performer'

    Lead'instrument'

    Form'

    Release'Title'

    Year'of'performance'

    Raga'

    Tala'Lay'

    Sec4on' Gharana'

    Year'of''release'

    Performer'accomp.'

    Instrument'accomp.'

    Composer'

    Lyricist'

    Raga'4me'

    Solo'

    Recordings' Details' Analysis' E8listen' Similarity'

    Raga'4me:'Evening'

    And Or Not !

    Raga:'Mishra'Khamaj'

    And Or Not !

    Solo:'Tabla'

    And Or Not !

  • CompMusic*browser*Culture'specific'music'discovery'

    Carna4c' Turkish8makam'

    Recording Artist Makam Usul Form Work

    Pesendide'Saz'Semaisi'

    Necdet'Yaşar''Ruhi'Ayangil'

    Pesendide' Saz'Semaisi''Pesendîde'Saz'

    Semaisi''

    Pesendîde'Saz'Semaisi'

    İstanbul'Sazendeleri' Pesendide' Saz'Semaisi''Pesendîde'Saz'

    Semaisi''

    Pesendîde'Saz'Semâîsi'

    Murat'Aydemir'Derya'Türkan'

    Pesendide' Saz'Semaisi''Pesendîde'Saz'

    Semaisi''

    Pesendide'Peşrevi'

    Necdet'Yaşar''Ruhi'Ayangil''Ahmet'Şahin''Derya'Türkan''Serdar'Bişiren'

    Pesendide' Peşrev'Pesendide'Peşrevi'

    Müşterek'Pesendîde'ye'Geçiş'Taksimi'

    Murat'Aydemir''Derya'Türkan'

    Mahur'Pesendide'

    Serbest' Taksim'Müşterek'

    Pesendîde'ye'Geçiş'Taksimi'

    Hindustani'

    Andalusi' Han'

    Pesendide*Saz*Semaisi*8''Necdet'Yaşar,'Ruhi'Ayangil'

    Makam:'Pesendide'

    And Or Not !

    Recordings' Details' Analysis' E8listen' Similarity'Lead'

    performer'Lead'

    instrument'

    Form'

    Release'Title'

    Work'

    Year'of''release'

    Performer'accomp.'

    Instrument'accomp.'

    Composer' Lyricist'

    Makam'

    Usul' Velvele'

    Year'of'performance'

  • CompMusic*browser*Culture'specific'music'discovery'

    Carna4c' Turkish8makam'

    Lead'performer'

    Lead'instrument'

    Form'

    Release'Title'

    Work'

    Year'of''release'

    Performer'accomp.'

    Instrument'accomp.'

    Composer' Lyricist'

    Pesendide*Saz*Semaisi*8''Necdet'Yaşar,'Ruhi'Ayangil'

    Hindustani'

    Andalusi' Han'

    Related*Performances*

    Recording* Ar5sts* Makam* Usul* Form*

    Pesendide'Saz'Semaisi'

    Necdet'Yaşar'(tanbur)'Ruhi'Ayangil'(kanun)'

    Pesendide' Saz'Semaisi'

    Pesendîde'Saz'Semaisi'

    İstanbul'Sazendeleri' Pesendide' Saz'Semaisi'

    Pesendîde'Saz'Semâîsi'

    Murat'Aydemir'(tanbur)'Derya'Türkan'(kemenche)' Pesendide' Saz'Semaisi'

    Editorial*Metadata*

    Work* Pesendide'Saz'Semaisi'

    Score* '(1'Score)'

    Recordings* '(3'Recordings)''

    Composer* Sultan'III.'Selim'

    Lyricist*

    Date*

    Scores*

    Score*Title* Composer* Date*Notated*by*/*

    Source*Makam* Usul* Form*

    Pesendide'Saz'Semaisi'

    Sultan'III.'Selim'

    Murat'Aydemir' Pesendide'Saz'

    Semaisi'

    Makam'

    Usul' Velvele'

    Sultan*III.*Selim*

    Makam:'Pesendide'

    And Or Not !

    Work:'Pesendide'Peşrevi'

    And Or Not !

    Year'of'performance'

    Recordings' Details' Analysis' E8listen' Similarity'

  • CompMusic*browser*Culture'specific'music'discovery'

    Carna4c' Turkish8makam'

    Lead'performer'

    Lead'instrument'

    Form'

    Release'Title'

    Work'

    Year'of''release'

    Performer'accomp.'

    Instrument'accomp.'

    Composer' Lyricist'

    Pesendide*Saz*Semaisi*8''Necdet'Yaşar,'Ruhi'Ayangil'

    Hindustani'

    Andalusi' Han'

    Related*Performances*

    Recording* Ar5sts* Makam* Usul* Form*

    Pesendide'Saz'Semaisi'

    Necdet'Yaşar'(tanbur)'Ruhi'Ayangil'(kanun)'

    Pesendide' Saz'Semaisi'

    Pesendîde'Saz'Semaisi'

    İstanbul'Sazendeleri' Pesendide' Saz'Semaisi'

    Pesendîde'Saz'Semâîsi'

    Murat'Aydemir'(tanbur)'Derya'Türkan'(kemenche)' Pesendide' Saz'Semaisi'

    Editorial*Metadata*

    Work* Pesendide'Saz'Semaisi'

    Score* '(1'Score)'

    Recordings* '(3'Recordings)''

    Composer* Sultan'III.'Selim'

    Lyricist*

    Date*

    Scores*

    Score*Title* Composer* Date*Notated*by*/*

    Source*Makam* Usul* Form*

    Pesendide'Saz'Semaisi'

    Sultan'III.'Selim'

    Murat'Aydemir' Pesendide'Saz'

    Semaisi'

    Makam'

    Usul' Velvele'

    Sultan*III.*Selim*

    Makam:'Pesendide'

    And Or Not !

    Work:'Pesendide'Peşrevi'

    And Or Not !

    Year'of'performance'

    Available'in'English'and'Türkçe'

    Recordings' Details' Analysis' E8listen' Similarity'

  • CompMusic*browser*Culture'specific'music'discovery'

    Carna4c' Turkish8makam'

    Pesendide*Saz*Semaisi*8''Necdet'Yaşar,'Ruhi'Ayangil'

    Hindustani'

    Andalusi' Han'

    Lead'performer'

    Lead'instrument'

    Form'

    Release'Title'

    Work'

    Year'of''release'

    Performer'accomp.'

    Instrument'accomp.'

    Composer' Lyricist'

    Makam'

    Usul' Velvele'

    Year'of'performance'

    Onset'Func4on'

    Pitch'Track'

    2'komas'1'koma'

    Recordings' Details' Analysis' E8listen' Similarity'

    Makam:'Pesendide'

    And Or Not !

    Work:'Pesendide'Peşrevi'

    And Or Not !