<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>This study leverages web crawling techniques within the realm of text mining to collect text data from American literary sources. Given the presence of substantial extraneous information in the data, preprocessing is essential to refine the content. Once processed, the data is fed into a Long Short-Term Memory (LSTM) network to generate text vectors that encapsulate characteristics of American literature. Building on this, the Latent Dirichlet Allocation (LDA) topic model extracts salient features from these vectors. An illustrative analysis of American literature is conducted using these methods. Our findings indicate that a significant portion of novels, which mirror the societal life themes prevalent in the United States, aligned with the ideological currents of their time. Notably, these constituted a substantial majority—62.18%—of all American literary works during the period under review. This research not only facilitates the wider dissemination and exchange of American literary works but also contributes to elevating American literature to a new echelon of global recognition.</p>
</abstract>

This study leverages web crawling techniques within the realm of text mining to collect text data from American literary sources. Given the presence of substantial extraneous information in the data, preprocessing is essential to refine the content. Once processed, the data is fed into a Long Short-Term Memory (LSTM) network to generate text vectors that encapsulate characteristics of American literature. Building on this, the Latent Dirichlet Allocation (LDA) topic model extracts salient features from these vectors. An illustrative analysis of American literature is conducted using these methods. Our findings indicate that a significant portion of novels, which mirror the societal life themes prevalent in the United States, aligned with the ideological currents of their time. Notably, these constituted a substantial majority—62.18%—of all American literary works during the period under review. This research not only facilitates the wider dissemination and exchange of American literary works but also contributes to elevating American literature to a new echelon of global recognition.

Exploring Themes and Patterns in American Literature Using Text Analysis Techniques

Applied Mathematics and Nonlinear Sciences

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

This study leverages web crawling techniques within the realm of text mining to collect text data from American literary sources. Given the presence of...

Exploring Themes and Patterns in American Literature Using Text Analysis Techniques

Published Online: Jun 07, 2024

Page range: -

Accepted: May 11, 2024

DOI: https://doi.org/10.2478/amns-2024-1390

Keywords
Web crawler, LSTM, LDA topic modeling, American literature

© 2024 Yu Cao, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Exploring Themes and Patterns in American Literature Using Text Analysis Techniques

Published Online: Jun 07, 2024

Page range: -

Accepted: May 11, 2024

DOI: https://doi.org/10.2478/amns-2024-1390

KeywordsWeb crawler, LSTM, LDA topic modeling, American literature

© 2024 Yu Cao, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 License.

Keywords
Web crawler, LSTM, LDA topic modeling, American literature