<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>This paper analyzes the “encoder-decoder” framework in neural machine translation and clarifies that the task of natural language processing is sequence learning. Secondly, recurrent neural networks are used to combine the historical hidden layer output information with the current input information, which is specialized in processing sequence data to achieve good translation results. Applying the attention mechanism to the field of natural language processing, a Transformer model based on the full attention mechanism is constructed in order to achieve the purpose of translating the source language while also performing alignment operations on the target language. The evaluation and analysis of the Transformer model based on the full-attention mechanism concludes that the Transformer model has 0.0152 Pearson correlation coefficients higher than the Bilingual Expert model, which is also 2.92% higher than the Bilingual Expert model, with the participation of <italic>f</italic> feature in both models. This further proves the Transformer model’s ability to correctly and effectively translate English sentences. At the same time, it also shows that the application of natural language processing technology can improve the efficiency of English long-sentence translation and comprehensively improve the quality of long-sentence translation.</p>
</abstract>

This paper analyzes the “encoder-decoder” framework in neural machine translation and clarifies that the task of natural language processing is sequence learning. Secondly, recurrent neural networks are used to combine the historical hidden layer output information with the current input information, which is specialized in processing sequence data to achieve good translation results. Applying the attention mechanism to the field of natural language processing, a Transformer model based on the full attention mechanism is constructed in order to achieve the purpose of translating the source language while also performing alignment operations on the target language. The evaluation and analysis of the Transformer model based on the full-attention mechanism concludes that the Transformer model has 0.0152 Pearson correlation coefficients higher than the Bilingual Expert model, which is also 2.92% higher than the Bilingual Expert model, with the participation of f feature in both models. This further proves the Transformer model’s ability to correctly and effectively translate English sentences. At the same time, it also shows that the application of natural language processing technology can improve the efficiency of English long-sentence translation and comprehensively improve the quality of long-sentence translation.

Exploring English Long Sentence Translation Methods by Applying Natural Language Processing Techniques

Chengdu College of University of Electronic Science and Technology of China

Applied Mathematics and Nonlinear Sciences

This work is licensed under the Creative Commons Attribution 4.0 International License.

This paper analyzes the “encoder-decoder” framework in neural machine translation and clarifies that the task of natural language processing is sequence...

Exploring English Long Sentence Translation Methods by Applying Natural Language Processing Techniques

Data publikacji: 05 gru 2023

Zakres stron: -

Otrzymano: 02 mar 2023

Przyjęty: 15 cze 2023

DOI: https://doi.org/10.2478/amns.2023.2.01352

Słowa kluczowe
Natural language processing, Encoder-decoder, Recurrent neural network, Attention mechanism, English long sentence translation

© 2023 Fengmei Shang et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Exploring English Long Sentence Translation Methods by Applying Natural Language Processing Techniques

Data publikacji: 05 gru 2023

Zakres stron: -

Otrzymano: 02 mar 2023

Przyjęty: 15 cze 2023

DOI: https://doi.org/10.2478/amns.2023.2.01352

Słowa kluczoweNatural language processing, Encoder-decoder, Recurrent neural network, Attention mechanism, English long sentence translation

© 2023 Fengmei Shang et al., published by Sciendo

This work is licensed under the Creative Commons Attribution 4.0 International License.

Słowa kluczowe
Natural language processing, Encoder-decoder, Recurrent neural network, Attention mechanism, English long sentence translation