A Model of Continual and Deep Learning for Aspect Based in Sentiment Analysis

Sentiment analysis is a useful tool in several social and business contexts. Aspect sentiment classification is a subtask in sentiment analysis that gives information about features or aspects of people, entities, products, or services present in reviews. Different deep learning models that have been proposed to solve aspect sentiment classification focus on a specific domain such as restaurant, hotel, or laptop reviews. However, there are few proposals for creating a single model with high performance in multiple domains. The continual learning approach with neural networks has been used to solve aspect classification in multiple domains. However, avoiding low, aspect classification performance in continual learning is challenging. As a consequence, potential neural network weight shifts in the learning process in different domains or datasets.

In this paper, a novel aspect sentiment classification approach is proposed. Our approach combines a transformer deep learning technique with a continual learning algorithm in different domains. The input layer used is the pretrained model Bidirectional Encoder Representations from Transformers. The experiments show the efficacy of our proposal with 78 % F1-macro. Our results improve other approaches from the state-of-the-art.