Ontological description of Indian art music for knowledge-driven exploration of audio music collections

Gopala Krishna Koduri, Xavier Serra{gopala.koduri, xavier.serra}@upf.edu

AudioDatabase

AudioFeatures

EditorialInformation

SemanticInformation

MusicScores

Application Programming Interface (API)

Client

Web Server

Linked Data

Linking Open Data

Presentation Layer

Web/Mobile Browser

Data Sources

Processing Layer

Data ProcessingAudio mid- and

high-level descriptorsSemantic descriptors

Information Processing

Ontology Definition

Data Linking Similarity measures

Analysis of melodic and rhythmic aspects of music taking advantage of the domain knowledge obtained from musicological texts and from experts:http://compmusic.upf.edu/node/4

Knowledge-based similarity measures to navigate and explore the music collections using musically aware connections between entities [1].

System overview & goals

Ontologies for concepts and relationships coming from music theory [2].

Audio music collections with metadata and contextual information as complete as possible, linked to other sources:http://musicbrainz.org/user/compmusic/collections

Requirements

Ontologies for Indian art music

Raaga

Progression

Svara

Sequence

Gamaka

hasSequence

hasProgression

hasSvara

hasGamaka

hasSvaraisA

isA

OWLListisA

hasRendition

so:Segment tl:IntervalisA

Shadjama

Rishaba

GandharaMadhyamaPanchama

Dhaivata

Nishada

SuddhaGandhara

SadharanaGandhara

AntaraGandhara

ChatussrutiRishaba

.....

SuddhaRishaba

isA

isA

isA

isAisA

isA

isA

isA

isA

isAisA

precedes

disjointWith

disjointWith

disjointWithisA

Partial rāga ontology [2]

Three important aspects which need intologies for a complete description of Indian art music: Rāga (melodic framework), Tāla (rhythmic framework) and Forms (compositional and improvisatory categories).

Challenges relevant to most, if not all music traditions, such as melodic sequences, are modeled with appropriate semantics.

Used in conjuction with audio data analyses with mutual benefit.

Used in linking multiple sources of information.

Used to directly compute the relatedness/similarity measures between musical entities.

[1] Porter, A., Sordo, M., Serra, X.: Dunya: a system to browse audio music collections using cultural context. In: ISMIR. (2013) In press[2] Koduri, G. K., Serra, X.: A knowledge-based approach to computational analysis of melody in Indian art music, In: SMAM-ISWC. (2013) In press

Example queries

1. Which svaras are the most distinguishing ones between Tōḍi and Śankarābharaṇaṁ?.2. List out the differences between phraseology for Kaḷyāṇi rāga in compositions of Tyāgarāja and Dīkṣitar3. Which rāgas are similar to Bahudāri?