<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>This study introduces a novel approach by combining knowledge distillation and transfer learning to create a model that, despite its smaller size, approaches the accuracy of its much larger counterparts. It leverages a trained model from a source domain (teacher) to enhance an untrained model in a target domain (student) with significantly fewer parameters. Through transfer learning, we utilize pre-trained deep learning model parameters as initial values. This paper also explores integrating intangible cultural heritage (ICH) information with school curricula, transforming traditional knowledge presentation into intuitive, personalized displays. Our findings highlight that ICH visualization spans nine categories, with traditional arts and crafts leading with 25 items. Interestingly, only 22.58% of students understand Native American culture, pointing towards the potential for educational enhancement. The research suggests designing curriculum with varied teaching activities to improve students’ comprehensive skills.</p>
</abstract>

This study introduces a novel approach by combining knowledge distillation and transfer learning to create a model that, despite its smaller size, approaches the accuracy of its much larger counterparts. It leverages a trained model from a source domain (teacher) to enhance an untrained model in a target domain (student) with significantly fewer parameters. Through transfer learning, we utilize pre-trained deep learning model parameters as initial values. This paper also explores integrating intangible cultural heritage (ICH) information with school curricula, transforming traditional knowledge presentation into intuitive, personalized displays. Our findings highlight that ICH visualization spans nine categories, with traditional arts and crafts leading with 25 items. Interestingly, only 22.58% of students understand Native American culture, pointing towards the potential for educational enhancement. The research suggests designing curriculum with varied teaching activities to improve students’ comprehensive skills.

Knowledge Distillation and Transfer Learning Combined for Innovative Visualization Teaching of Non-Heritage Designs

Applied Mathematics and Nonlinear Sciences

This work is licensed under the Creative Commons Attribution 4.0 International License.

This study introduces a novel approach by combining knowledge distillation and transfer learning to create a model that, despite its smaller size, approaches...

Knowledge Distillation and Transfer Learning Combined for Innovative Visualization Teaching of Non-Heritage Designs

Published Online: May 03, 2024

Page range: -

Received: Apr 06, 2024

Accepted: Apr 22, 2024

DOI: https://doi.org/10.2478/amns-2024-1022

Keywords
Knowledge distillation, Transfer learning, Integration model, Non-heritage projects

© 2024 Yanjun Yang et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Knowledge Distillation and Transfer Learning Combined for Innovative Visualization Teaching of Non-Heritage Designs

Published Online: May 03, 2024

Page range: -

Received: Apr 06, 2024

Accepted: Apr 22, 2024

DOI: https://doi.org/10.2478/amns-2024-1022

KeywordsKnowledge distillation, Transfer learning, Integration model, Non-heritage projects

© 2024 Yanjun Yang et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Keywords
Knowledge distillation, Transfer learning, Integration model, Non-heritage projects