<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>Idioms have various compositions and are part of the long history and culture of the Chinese nation, with their unique ways of expression. In this paper, taking “Pictures of Idioms” as an example, we propose a strategy for designing illustrations for a related series of books on idioms using artificial intelligence technology. Using the LSTM model, the description of the given idiom text is realized to generate images. The generated images are processed by a decoder and fed into a neural network model to generate illustrations that match the description of the idiom text. Further, a diffusion model is proposed to improve the quality of illustration generation and diversify the illustrations by continuously adding conditions to the generation process. Taking “Picture Talking Idioms” as an example, we propose a design strategy for the illustrations of the Idioms series accompanying elementary school language textbooks and quantify the effect of practical application in terms of the design effect of the final product, the reading satisfaction, and the effect of the use of “Picture Talking Idioms.” Students were more satisfied with the use of blue-gray and blue colors in the illustrations in “Diagrams to Tell Idioms,” with ratings of 4.9 and 4.6, respectively. 52% of the students used the diagrammatic method of reading “Diagrams to Tell Idioms” and rated the knowledge content of the books in terms of idioms at 9.458, which is a high satisfaction rate of 98%. The use of diagramming idioms has been very effective in assisting with language text.</p>
</abstract>

Idioms have various compositions and are part of the long history and culture of the Chinese nation, with their unique ways of expression. In this paper, taking “Pictures of Idioms” as an example, we propose a strategy for designing illustrations for a related series of books on idioms using artificial intelligence technology. Using the LSTM model, the description of the given idiom text is realized to generate images. The generated images are processed by a decoder and fed into a neural network model to generate illustrations that match the description of the idiom text. Further, a diffusion model is proposed to improve the quality of illustration generation and diversify the illustrations by continuously adding conditions to the generation process. Taking “Picture Talking Idioms” as an example, we propose a design strategy for the illustrations of the Idioms series accompanying elementary school language textbooks and quantify the effect of practical application in terms of the design effect of the final product, the reading satisfaction, and the effect of the use of “Picture Talking Idioms.” Students were more satisfied with the use of blue-gray and blue colors in the illustrations in “Diagrams to Tell Idioms,” with ratings of 4.9 and 4.6, respectively. 52% of the students used the diagrammatic method of reading “Diagrams to Tell Idioms” and rated the knowledge content of the books in terms of idioms at 9.458, which is a high satisfaction rate of 98%. The use of diagramming idioms has been very effective in assisting with language text.

Illustration Design Strategies of Idioms Series Supporting Primary School Language Textbooks in the Context of Artificial Intelligence--Taking “Picture Idioms” as an Example

Applied Mathematics and Nonlinear Sciences

This work is licensed under the Creative Commons Attribution 4.0 International License.

Idioms have various compositions and are part of the long history and culture of the Chinese nation, with their unique ways of expression. In this paper,...

Illustration Design Strategies of Idioms Series Supporting Primary School Language Textbooks in the Context of Artificial Intelligence--Taking “Picture Idioms” as an Example

Published Online: Aug 05, 2024

Page range: -

Received: Mar 22, 2024

Accepted: Jun 18, 2024

DOI: https://doi.org/10.2478/amns-2024-2060

Keywords
LSTM model, Image decoder, Diffusion model, Illustration design strategy

© 2024 Kefei Shen et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Illustration Design Strategies of Idioms Series Supporting Primary School Language Textbooks in the Context of Artificial Intelligence--Taking “Picture Idioms” as an Example

Published Online: Aug 05, 2024

Page range: -

Received: Mar 22, 2024

Accepted: Jun 18, 2024

DOI: https://doi.org/10.2478/amns-2024-2060

KeywordsLSTM model, Image decoder, Diffusion model, Illustration design strategy

© 2024 Kefei Shen et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Keywords
LSTM model, Image decoder, Diffusion model, Illustration design strategy