AnKaS: Database of Annotations of Karelian Speech

Irina Kipyatkova, Ildar Kagirov, Mikhail Dolgushin, and Alexandra Rodionova
St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS)

TODO List

Abstract

The corpus includes transcripts from radio broadcasts, featuring samples from 17 speakers (7 males and 10 females). Covering about 4.5 hours of audio recordings, it contains 32037 words, thus being a valuable tool for linguistic research. Among the peculiarities of the presented corpus are instances of code-switching between Livvi-Karelian and Russian. The baseline experiments were carried out with the Kaldi toolkit. Hybrid DNN/HMMs with factorized time-delay neural networks were utilized for acoustic modeling, while trigram and LSTM-based models were used for language modeling. The proposed model allowed achieving the Word Error Rate (WER) of 26%.

AnKaS Database Key Information

Database of Annotations of Karelian Speech (AnKaS) includes timestamps, textual transcriptions, and code-switching marks of Livvi-Karelian radio broadcasts.

The database is represented in JSON format. A separate .json file was created for each speaker. The following keys are used:

  • "phrase_id" is the phrase number for this speaker;
  • "link" is a link to the audio recording;
  • "time_start" is start time of the phrase;
  • "time_end" is end time of the phrase;
  • "sentence" is textual transcription;
  • "sentence_rus" is textual transcription with code-switching, indicated with brackets and the tag "rus";

The files train.txt, dev.txt, and test.txt contains the lists of phrases for training, fine-tuning, and testing the system respectively, where the first number is the speaker's id, and the second number is the phrase's id.

Vocabulary Information

voc.txt contains list of words from textual transcriptions from AnKaS database with their phonemic representation. Vocabulary includes Karelian words as well as most frequent Russian words. Transcriptions for Russian words were made according to Russian transcribing rules.

Database Metadata

Database Features Value
Number of Speakers 17 (7 male, 10 female)
Total Duration 4.5h
Number of Utterances 4385
Word Occurrences 32,037
Unique Words 9,117