Ontological description of Indian art music for knowledge-driven exploration of audio music collections

Gopala Krishna Koduri, Xavier Serra {gopala.koduri, xavier.serra}@upf.edu

Audio Database

Audio Features

Editorial Information

Semantic Information

Music Scores

Application Programming Interface (API)

Client

Web Server

Linked Data

Linking Open Data

Presentation Layer

Web/Mobile Browser

Data Sources

Processing Layer

Data Processing Audio mid- and

high-level descriptors Semantic descriptors

Information Processing

Ontology Definition Data Linking Similarity measures

Analysis of melodic and rhythmic aspects of music taking advantage of the domain knowledge obtained from musicological texts and from experts: http://compmusic.upf.edu/node/4

Knowledge-based similarity measures to navigate and explore the music collections using musically aware connections between entities [1].

System overview & goals

Ontologies for concepts and relationships coming from music theory [2].

Audio music collections with metadata and contextual information as complete as possible, linked to other sources: http://musicbrainz.org/user/compmusic/collections

Requirements

Ontologies for Indian art music

Raaga

Progression

Svara

Sequence

Gamaka

hasSequence

hasProgression

hasSvara

hasGamaka

hasSvaraisA

isA

OWLList isA

hasRendition

so:Segment tl:IntervalisA

Shadjama

Rishaba

GandharaMadhyama Panchama

Dhaivata

Nishada

Suddha Gandhara

Sadharana Gandhara

Antara Gandhara

Chatussruti Rishaba

.....

Suddha Rishaba

isA

isA

isA

isA isA

isA

isA

isA

isA

isAisA

precedes

disjointWith

disjointWith

disjointWith isA

Partial rāga ontology [2]

Three important aspects which need intologies for a complete description of Indian art music: Rāga (melodic framework), Tāla (rhythmic framework) and Forms (compositional and improvisatory categories).

Challenges relevant to most, if not all music traditions, such as melodic sequences, are modeled with appropriate semantics.

Used in conjuction with audio data analyses with mutual benefit.

Used in linking multiple sources of information.

Used to directly compute the relatedness/similarity measures between musical entities.

[1] Porter, A., Sordo, M., Serra, X.: Dunya: a system to browse audio music collections using cultural context. In: ISMIR. (2013) In press [2] Koduri, G. K., Serra, X.: A knowledge-based approach to computational analysis of melody in Indian art music, In: SMAM-ISWC. (2013) In press

Example queries

1. Which svaras are the most distinguishing ones between Tōḍi and Śankarābharaṇaṁ?. 2. List out the differences between phraseology for Kaḷyāṇi rāga in compositions of Tyāgarāja and Dīkṣitar 3. Which rāgas are similar to Bahudāri?