<abstract xmlns="http://www.w3.org/1999/xhtml">

<p>One of the important applications for which natural language processing (NLP) is used is the machine translation (MT) system, which automatically converts one natural language to another. It has witnessed various paradigm shifts since its inception. Statistical machine translation (SMT) has dominated MT research for decades. In the recent past, researchers have focused on developing MT systems based on artificial neural networks (ANN). In this paper, first, some important deep learning models that are mostly exploited in Neural Machine Translation (NMT) design are discussed. A systematic comparison was done between the performances of SMT and NMT concerning the English-to-Bangla and English-to-Hindi translation tasks. Most of the Indian scripts are morphologically rich, and the availability of a sufficient corpus is rare. We have presented and analyzed our work and a survey was conducted on other low-resource languages, and finally some useful conclusions have been drawn.</p>
</abstract>

One of the important applications for which natural language processing (NLP) is used is the machine translation (MT) system, which automatically converts one natural language to another. It has witnessed various paradigm shifts since its inception. Statistical machine translation (SMT) has dominated MT research for decades. In the recent past, researchers have focused on developing MT systems based on artificial neural networks (ANN). In this paper, first, some important deep learning models that are mostly exploited in Neural Machine Translation (NMT) design are discussed. A systematic comparison was done between the performances of SMT and NMT concerning the English-to-Bangla and English-to-Hindi translation tasks. Most of the Indian scripts are morphologically rich, and the availability of a sufficient corpus is rare. We have presented and analyzed our work and a survey was conducted on other low-resource languages, and finally some useful conclusions have been drawn.

Performance Comparison of Statistical vs. Neural-Based Translation System on Low-Resource Languages

Deparment of Mathematical and Computer Science

University of Petroleum and Energy Studies

International Journal on Smart Sensing and Intelligent Systems

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

One of the important applications for which natural language processing (NLP) is used is the machine translation (MT) system, which automatically converts one...

Performance Comparison of Statistical vs. Neural-Based Translation System on Low-Resource Languages

Article Category: Article

Published Online: Aug 12, 2023

Page range: -

Received: Feb 22, 2023

DOI: https://doi.org/10.2478/ijssis-2023-0007

Keywords
Neural machine translation, statistical machine translation, RNN, deep learning

© 2023 Goutam Datta et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Performance Comparison of Statistical vs. Neural-Based Translation System on Low-Resource Languages

Article Category: Article

Published Online: Aug 12, 2023

Page range: -

Received: Feb 22, 2023

DOI: https://doi.org/10.2478/ijssis-2023-0007

KeywordsNeural machine translation, statistical machine translation, RNN, deep learning

© 2023 Goutam Datta et al., published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Keywords
Neural machine translation, statistical machine translation, RNN, deep learning