<abstract xmlns="http://www.w3.org/1999/xhtml"><sec id="j_jdis-2019-0021_s_006_w2aab3b7b5b1b6b1aab1c17b1Aa"><h3>Purpose</h3><p>Ever increasing penetration of the Internet in our lives has led to an enormous amount of multimedia content generation on the internet. Textual data contributes a major share towards data generated on the world wide web. Understanding people’s sentiment is an important aspect of natural language processing, but this opinion can be biased and incorrect, if people use sarcasm while commenting, posting status updates or reviewing any product or a movie. Thus, it is of utmost importance to detect sarcasm correctly and make a correct prediction about the people’s intentions.</p></sec><sec id="j_jdis-2019-0021_s_007_w2aab3b7b5b1b6b1aab1c17b2Aa"><h3>Design/methodology/approach</h3><p>This study tries to evaluate various machine learning models along with standard and hybrid deep learning models across various standardized datasets. We have performed vectorization of text using word embedding techniques. This has been done to convert the textual data into vectors for analytical purposes. We have used three standardized datasets available in public domain and used three word embeddings i.e Word2Vec, GloVe and fastText to validate the hypothesis.</p></sec><sec id="j_jdis-2019-0021_s_008_w2aab3b7b5b1b6b1aab1c17b3Aa"><h3>Findings</h3><p>The results were analyzed and conclusions are drawn. The key finding is: the hybrid models that include Bidirectional LongTerm Short Memory (Bi-LSTM) and Convolutional Neural Network (CNN) outperform others conventional machine learning as well as deep learning models across all the datasets considered in this study, making our hypothesis valid.</p></sec><sec id="j_jdis-2019-0021_s_009_w2aab3b7b5b1b6b1aab1c17b4Aa"><h3>Research limitations</h3><p>Using the data from different sources and customizing the models according to each dataset, slightly decreases the usability of the technique. But, overall this methodology provides effective measures to identify the presence of sarcasm with a minimum average accuracy of 80% or above for one dataset and better than the current baseline results for the other datasets.</p></sec><sec id="j_jdis-2019-0021_s_010_w2aab3b7b5b1b6b1aab1c17b5Aa"><h3>Practical implications</h3><p>The results provide solid insights for the system developers to integrate this model into real-time analysis of any review or comment posted in the public domain. This study has various other practical implications for businesses that depend on user ratings and public opinions. This study also provides a launching platform for various researchers to work on the problem of sarcasm identification in textual data.</p></sec><sec id="j_jdis-2019-0021_s_011_w2aab3b7b5b1b6b1aab1c17b6Aa"><h3>Originality/value</h3><p>This is a first of its kind study, to provide us the difference between conventional and the hybrid methods of prediction of sarcasm in textual data. The study also provides possible indicators that hybrid models are better when applied to textual data for analysis of sarcasm.</p></sec></abstract>

PurposeEver increasing penetration of the Internet in our lives has led to an enormous amount of multimedia content generation on the internet. Textual data contributes a major share towards data generated on the world wide web. Understanding people’s sentiment is an important aspect of natural language processing, but this opinion can be biased and incorrect, if people use sarcasm while commenting, posting status updates or reviewing any product or a movie. Thus, it is of utmost importance to detect sarcasm correctly and make a correct prediction about the people’s intentions.Design/methodology/approachThis study tries to evaluate various machine learning models along with standard and hybrid deep learning models across various standardized datasets. We have performed vectorization of text using word embedding techniques. This has been done to convert the textual data into vectors for analytical purposes. We have used three standardized datasets available in public domain and used three word embeddings i.e Word2Vec, GloVe and fastText to validate the hypothesis.FindingsThe results were analyzed and conclusions are drawn. The key finding is: the hybrid models that include Bidirectional LongTerm Short Memory (Bi-LSTM) and Convolutional Neural Network (CNN) outperform others conventional machine learning as well as deep learning models across all the datasets considered in this study, making our hypothesis valid.Research limitationsUsing the data from different sources and customizing the models according to each dataset, slightly decreases the usability of the technique. But, overall this methodology provides effective measures to identify the presence of sarcasm with a minimum average accuracy of 80% or above for one dataset and better than the current baseline results for the other datasets.Practical implicationsThe results provide solid insights for the system developers to integrate this model into real-time analysis of any review or comment posted in the public domain. This study has various other practical implications for businesses that depend on user ratings and public opinions. This study also provides a launching platform for various researchers to work on the problem of sarcasm identification in textual data.Originality/valueThis is a first of its kind study, to provide us the difference between conventional and the hybrid methods of prediction of sarcasm in textual data. The study also provides possible indicators that hybrid models are better when applied to textual data for analysis of sarcasm.

Identification of Sarcasm in Textual Data: A Comparative Study

Journal of Data and Information Science

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

{"article-title":"Identification of Sarcasm in Textual Data: A Comparative Study"}

PurposeEver increasing penetration of the Internet in our lives has led to an enormous amount of multimedia content generation on the internet. Textual data...

Identification of Sarcasm in Textual Data: A Comparative Study

Article Category: Research Paper

Published Online: Dec 27, 2019

Page range: 56 - 83

Received: Sep 06, 2019

Accepted: Nov 29, 2019

DOI: https://doi.org/10.2478/jdis-2019-0021

Keywords
Machine learning, Artificial neural networks, Word embedding, Text vectorization, Accuracy

© 2019 Pulkit Mehndiratta, Devpriya Soni, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Identification of Sarcasm in Textual Data: A Comparative Study

Article Category: Research Paper

Published Online: Dec 27, 2019

Page range: 56 - 83

Received: Sep 06, 2019

Accepted: Nov 29, 2019

DOI: https://doi.org/10.2478/jdis-2019-0021

KeywordsMachine learning, Artificial neural networks, Word embedding, Text vectorization, Accuracy

© 2019 Pulkit Mehndiratta, Devpriya Soni, published by Sciendo

This work is licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 License.

Keywords
Machine learning, Artificial neural networks, Word embedding, Text vectorization, Accuracy