<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>The problem of varying length recordings is a well-known issue in paralinguistics. We investigated how to resolve this problem using the bag-of-audio-words feature extraction approach. The steps of this technique involve preprocessing, clustering, quantization and normalization. The bag-of-audio-words technique is competitive in the area of speech emotion recognition, but the method has several parameters that need to be precisely tuned for good efficiency. The main aim of our study was to analyse the effectiveness of bag-of-audio-words method and try to find the best parameter values for emotion recognition. We optimized the parameters one-by-one, but built on the results of each other. We performed the feature extraction, using openSMILE. Next we transformed our features into same-sized vectors with openXBOW, and finally trained and evaluated SVM models with 10-fold-crossvalidation and UAR. In our experiments, we worked with a Hungarian emotion database. According to our results, the emotion classification performance improves with the bag-of-audio-words feature representation. Not all the BoAW parameters have the optimal settings but later we can make clear recommendations on how to set bag-of-audio-words parameters for emotion detection tasks.</p>
</abstract>

The problem of varying length recordings is a well-known issue in paralinguistics. We investigated how to resolve this problem using the bag-of-audio-words feature extraction approach. The steps of this technique involve preprocessing, clustering, quantization and normalization. The bag-of-audio-words technique is competitive in the area of speech emotion recognition, but the method has several parameters that need to be precisely tuned for good efficiency. The main aim of our study was to analyse the effectiveness of bag-of-audio-words method and try to find the best parameter values for emotion recognition. We optimized the parameters one-by-one, but built on the results of each other. We performed the feature extraction, using openSMILE. Next we transformed our features into same-sized vectors with openXBOW, and finally trained and evaluated SVM models with 10-fold-crossvalidation and UAR. In our experiments, we worked with a Hungarian emotion database. According to our results, the emotion classification performance improves with the bag-of-audio-words feature representation. Not all the BoAW parameters have the optimal settings but later we can make clear recommendations on how to set bag-of-audio-words parameters for emotion detection tasks.

Using the Bag-of-Audio-Words approach for emotion recognition

Acta Universitatis Sapientiae, Informatica

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

{"article-title":"Using the Bag-of-Audio-Words approach for emotion recognition"}

The problem of varying length recordings is a well-known issue in paralinguistics. We investigated how to resolve this problem using the bag-of-audio-words...

Using the Bag-of-Audio-Words approach for emotion recognition

Data publikacji: 12 sie 2022

Zakres stron: 1 - 21

Otrzymano: 23 lis 2021

Przyjęty: 01 lut 2022

DOI: https://doi.org/10.2478/ausi-2022-0001

Słowa kluczowe
bag-of-audio-words, emotion detection, human voice, sound processing

© 2022 Mercedes Vetráb et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Using the Bag-of-Audio-Words approach for emotion recognition

Data publikacji: 12 sie 2022

Zakres stron: 1 - 21

Otrzymano: 23 lis 2021

Przyjęty: 01 lut 2022

DOI: https://doi.org/10.2478/ausi-2022-0001

Słowa kluczowebag-of-audio-words, emotion detection, human voice, sound processing

© 2022 Mercedes Vetráb et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Słowa kluczowe
bag-of-audio-words, emotion detection, human voice, sound processing