<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>This paper uses the BERT model for text feature extraction to capture semantic information more accurately. FBank feature extraction technique is applied for analyzing speech data to improve the accurate recognition of speech information. The 3D-CNN model is built and used to image feature extraction to obtain richer image information. The study combines long and short-term memory networks and attention mechanisms to enhance the interaction and integration between different modalities. The study results show that this multimodal teaching approach not only improves students’ motivation to learn, but also significantly enhances the classroom teaching effect. Especially in vocabulary teaching, using multimodal resources helps deepen students’ understanding and memorization of vocabulary. The model shows high accuracy in the empirical Analysis of pronunciation detection in noisy environments, especially after incorporating multimodal features. The study provides an effective multimodal fusion method for English-Chinese bilingual teaching, especially in improving students’ vocabulary learning efficiency. It has been proved that the multimodal teaching method can better mobilize students’ various senses and thus improve learning. Therefore, the methods and findings of this study are of great theoretical and practical significance to the field of bilingual education.</p>
</abstract>

This paper uses the BERT model for text feature extraction to capture semantic information more accurately. FBank feature extraction technique is applied for analyzing speech data to improve the accurate recognition of speech information. The 3D-CNN model is built and used to image feature extraction to obtain richer image information. The study combines long and short-term memory networks and attention mechanisms to enhance the interaction and integration between different modalities. The study results show that this multimodal teaching approach not only improves students’ motivation to learn, but also significantly enhances the classroom teaching effect. Especially in vocabulary teaching, using multimodal resources helps deepen students’ understanding and memorization of vocabulary. The model shows high accuracy in the empirical Analysis of pronunciation detection in noisy environments, especially after incorporating multimodal features. The study provides an effective multimodal fusion method for English-Chinese bilingual teaching, especially in improving students’ vocabulary learning efficiency. It has been proved that the multimodal teaching method can better mobilize students’ various senses and thus improve learning. Therefore, the methods and findings of this study are of great theoretical and practical significance to the field of bilingual education.

Diversified Teaching of English-Chinese Bilingual Courses Based on Integrating Multimodal Discourse Analysis

Applied Mathematics and Nonlinear Sciences

This work is licensed under the Creative Commons Attribution 4.0 International License.

This paper uses the BERT model for text feature extraction to capture semantic information more accurately. FBank feature extraction technique is applied for...

Diversified Teaching of English-Chinese Bilingual Courses Based on Integrating Multimodal Discourse Analysis

Data publikacji: 26 lut 2024

Zakres stron: -

Otrzymano: 10 sty 2024

Przyjęty: 15 sty 2024

DOI: https://doi.org/10.2478/amns-2024-0494

Słowa kluczowe
BERT model, Long and short-term memory network, Attention mechanism, Multimodal discourse analysis, English-Chinese bilingualism

© 2024 Xiaoxia Hao, published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Diversified Teaching of English-Chinese Bilingual Courses Based on Integrating Multimodal Discourse Analysis

Data publikacji: 26 lut 2024

Zakres stron: -

Otrzymano: 10 sty 2024

Przyjęty: 15 sty 2024

DOI: https://doi.org/10.2478/amns-2024-0494

Słowa kluczoweBERT model, Long and short-term memory network, Attention mechanism, Multimodal discourse analysis, English-Chinese bilingualism

© 2024 Xiaoxia Hao, published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Słowa kluczowe
BERT model, Long and short-term memory network, Attention mechanism, Multimodal discourse analysis, English-Chinese bilingualism