<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>Rhythm perception is becoming more and more important in the field of music information processing and music understanding. The study first adopts signal processing methods to extract musical features, then uses feature fusion techniques to integrate features of different modalities into a single feature vector. Based on this model, the study identifies the rhythmic activation function of music and combines it with the hidden Markov model to infer the rhythm of the music. One of the key points of the study is to perform rhythm recognition on music containing drums, to explore the recognition effect. One of the focuses of the study is to recognize the rhythm of music containing drums to explore the recognition effect.In addition, the study also analyzes the Softmax output values of the music and compares the recognition effect of different models. The results show that the rhythm recognition of music using the multimodal deep learning method performs the best in terms of the F-Measure value, the Cemgil value, the Goto value, and the P-score value, with the respective 65.65%, 66.76%, 36.75%, and 36.75%. 66.76%, 36.75%, and 75.68%.Especially in the drum music recognition, the position of each drum music is accurately recognized, proving the model’s effectiveness in this paper. The research provides a new feasible method for the recognition and understanding of music rhythms and a valuable reference for the research in this field.</p>
</abstract>

Rhythm perception is becoming more and more important in the field of music information processing and music understanding. The study first adopts signal processing methods to extract musical features, then uses feature fusion techniques to integrate features of different modalities into a single feature vector. Based on this model, the study identifies the rhythmic activation function of music and combines it with the hidden Markov model to infer the rhythm of the music. One of the key points of the study is to perform rhythm recognition on music containing drums, to explore the recognition effect. One of the focuses of the study is to recognize the rhythm of music containing drums to explore the recognition effect.In addition, the study also analyzes the Softmax output values of the music and compares the recognition effect of different models. The results show that the rhythm recognition of music using the multimodal deep learning method performs the best in terms of the F-Measure value, the Cemgil value, the Goto value, and the P-score value, with the respective 65.65%, 66.76%, 36.75%, and 36.75%. 66.76%, 36.75%, and 75.68%.Especially in the drum music recognition, the position of each drum music is accurately recognized, proving the model’s effectiveness in this paper. The research provides a new feasible method for the recognition and understanding of music rhythms and a valuable reference for the research in this field.

Pattern recognition study of musical rhythm perception based on multimodal deep learning

Applied Mathematics and Nonlinear Sciences

This work is licensed under the Creative Commons Attribution 4.0 International License.

Rhythm perception is becoming more and more important in the field of music information processing and music understanding. The study first adopts signal...

Pattern recognition study of musical rhythm perception based on multimodal deep learning

Data publikacji: 26 lut 2024

Zakres stron: -

Otrzymano: 12 sty 2024

Przyjęty: 19 sty 2024

DOI: https://doi.org/10.2478/amns-2024-0549

Słowa kluczowe
Deep learning, Feature fusion, Hidden Markov, Rhythm recognition, Music perception

© 2023 Wen Bai, published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Pattern recognition study of musical rhythm perception based on multimodal deep learning

Data publikacji: 26 lut 2024

Zakres stron: -

Otrzymano: 12 sty 2024

Przyjęty: 19 sty 2024

DOI: https://doi.org/10.2478/amns-2024-0549

Słowa kluczoweDeep learning, Feature fusion, Hidden Markov, Rhythm recognition, Music perception

© 2023 Wen Bai, published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Słowa kluczowe
Deep learning, Feature fusion, Hidden Markov, Rhythm recognition, Music perception