<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>In this paper, we first establish a multimodal knowledge graph and process the course teaching video using by PaddleOCR algorithm to distinguish and understand the teaching text. This paper also improves the traditional classroom behavior recognition method by using the skeletal covariance matrix extraction strategy to aggregate the skeletal sequence features while combining the courseware information features to jointly achieve the recognition of classroom behavior. Based on the above algorithms, this paper summarizes the English multimodal teaching system based on intelligent learning, which improves traditional English teaching methods in terms of learning environment, teaching method, and mode. Finally, this paper conducted an experimental test on the effects of a multimodal English teaching method. The results show that the class scores of the class applying the multimodal English teaching method have been cumulatively improved by 22.06 points, and the rankings have been improved from 4 or 5 to 1 or 2 among the six tested classes. Students’ satisfaction with the pedagogy increased from an initial score of 3.4 to 4.5. The results show that multimodal English teaching promotes the change of English classrooms in the smart era.</p>
</abstract>

In this paper, we first establish a multimodal knowledge graph and process the course teaching video using by PaddleOCR algorithm to distinguish and understand the teaching text. This paper also improves the traditional classroom behavior recognition method by using the skeletal covariance matrix extraction strategy to aggregate the skeletal sequence features while combining the courseware information features to jointly achieve the recognition of classroom behavior. Based on the above algorithms, this paper summarizes the English multimodal teaching system based on intelligent learning, which improves traditional English teaching methods in terms of learning environment, teaching method, and mode. Finally, this paper conducted an experimental test on the effects of a multimodal English teaching method. The results show that the class scores of the class applying the multimodal English teaching method have been cumulatively improved by 22.06 points, and the rankings have been improved from 4 or 5 to 1 or 2 among the six tested classes. Students’ satisfaction with the pedagogy increased from an initial score of 3.4 to 4.5. The results show that multimodal English teaching promotes the change of English classrooms in the smart era.

Research on Multimodal English Teaching Methods and Practices Leading to Intelligent Generation

Hainan Vocational University of Science and Technology

Applied Mathematics and Nonlinear Sciences

This work is licensed under the Creative Commons Attribution 4.0 International License.

In this paper, we first establish a multimodal knowledge graph and process the course teaching video using by PaddleOCR algorithm to distinguish and understand...

Research on Multimodal English Teaching Methods and Practices Leading to Intelligent Generation

Published Online: Jul 05, 2024

Page range: -

Received: Mar 08, 2024

Accepted: May 22, 2024

DOI: https://doi.org/10.2478/amns-2024-1654

Keywords
Multimodal knowledge mapping, PaddleOCR algorithm, Classroom behavior recognition, Multimodal teaching

© 2024 Xiaochao Yao., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Research on Multimodal English Teaching Methods and Practices Leading to Intelligent Generation

Published Online: Jul 05, 2024

Page range: -

Received: Mar 08, 2024

Accepted: May 22, 2024

DOI: https://doi.org/10.2478/amns-2024-1654

KeywordsMultimodal knowledge mapping, PaddleOCR algorithm, Classroom behavior recognition, Multimodal teaching

© 2024 Xiaochao Yao., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Keywords
Multimodal knowledge mapping, PaddleOCR algorithm, Classroom behavior recognition, Multimodal teaching