Document Type : Original/Review Paper

Authors

1 Faculty of language and humanities, Bu Ali Sina University, Hamedan, Iran.

2 Department of Computer Engineering, Bu Ali Sina University, Hamedan, Iran.

Abstract

In the modern age, written sources are rapidly increasing. A growing number of these data are related to the texts containing the feelings and opinions of the users. Thus, reviewing and analyzing of emotional texts have received a particular attention in recent years. A System which is based on combination of cognitive features and deep neural network, Gated Recurrent Unit has been proposed in this paper. Five basic emotions used in this approach are: anger, happiness, sadness, surprise and fear. A total of 23,000 Persian documents by the average length of 24 have been labeled for this research. Emotional constructions, emotional keywords, and emotional POS are the basic cognitive features used in this approach. On the other hand, after preprocessing the texts, words of normalized text have been embedded by Word2Vec technique. Then, a deep learning approach has been done based on this embedded data. Finally, classification algorithms such as Naïve Bayes, decision tree, and support vector machines were used to classify emotions based on concatenation of defined cognitive features, and deep learning features. 10-fold cross validation has been used to evaluate the performance of the proposed system. Experimental results show the proposed system achieved the accuracy of 97%. Result of proposed system shows the improvement of several percent’s in comparison by other results achieved GRU and cognitive features in isolation. At the end, studying other statistical features and improving these cognitive features in more details can affect the results.

Keywords

[1] S. Provoost, J. Ruwaard, W. Breda, H. Riper, and T. Bosse, "Validating automated sentiment analysis of online cognitive behavioral therapy patient texts: an exploratory study", Frontiers in psychology, Vol. 10, pp. 1065, 2019.
[2] R. J. Lennox, , "Sentiment analysis as a measure of conservation culture in scientific literature", Conservation Biology, 2019.
[3] J. A. Morente-Molinera, "An automatic procedure to create fuzzy ontologies from users’ opinions using sentiment analysis procedures and multi-granular fuzzy linguistic modelling methods", Information Sciences, vol 476, pp. 222-238, 2019.
[4] A. Chatterjee, and G. Yasmin, "Human Emotion Recognition from Speech in Audio Physical Features", in Applications of Computing, Automation and Wireless Systems in Electrical Engineering, Springer, pp. 817-824, 2019.
[5] N. Samadiani, G Huang, B. Cai, W Lou, C. Chi, Y. Xiang, and J. He, "A review on automatic facial expression recognition systems assisted by multimodal sensor data",  Sensors, Vol. 19, No 8,  pp. 1863, 2019.
[6] F. Ghanbari-Adivi, F. and M. Mosleh, "Text emotion detection in social networks using a novel ensemble classifier based on Parzen Tree Estimator (TPE)", Neural Computing and Applications, pp. 1-13, 2019.
[7] C. Ma, H. Prendinger and M. Ishizuka, "Emotion estimation and reasoning based on affective textual interaction",in International Conference on Affective Computing and Intelligent Interaction. 2005.
[8] J. T. Hancock, C. Landrigan, and C. Silver, "Expressing emotion in text-based communication", in Proceedings of the SIGCHI conference on Human factors in computing systems, ACM, 2007.
[9] H. Li, N. Pang, S. Guo, and H. Wang, "Research on textual emotion recognition incorporating personality factor", in IEEE International Conference on Robotics and Biomimetics (ROBIO). 2007.
[10] M. Purver, M. and S. Battersby, "Experimenting with distant supervision for emotion classification", In Proceedings of the 13th Conference of the European Chapter of the Association for computational Linguistics. 2012.
[11] R. C. Balabantaray, M. Mohammad, and N. Sharma, "Multi-class twitter emotion classification: A new approach", International Journal of Applied Information Systems, vol. 4(1), pp. 48-53, 2012.
[12] H. Keshavarz, and M. Sanaiee Abadeh, "MHSublex: Using Mataheuristic Methods for Subjectivity Classification of Microblogs", Journal of AI and data mining, vol. .6(2), pp. 341-353, 2018.
[13] M. Hasan, E. Rundensteiner, and E. Agu, "Automatic emotion detection in text streams by analyzing Twitter data", International Journal of Data Science and Analytics, vol. 7(1), pp. 35-51, 2019.
[14] M. Polignano, P. Basile, M. Gemmis, and G. Semiraro, "A Comparison of Word-Embeddings in Emotion Detection from Text using BiLSTM, CNN and Self-Attention", in Adjunct Publication of the 27th Conference on User Modeling, Adaptation and Personalization. 2019.
[15] W. Ragheb, , "Attention-based Modeling for Emotion Detection and Classification in Textual Conversations", arXiv preprint arXiv: 1906.07020, 2019.
[16] P. Rathnayaka, S. Abeysinghe, C. Samarajeewa, I. Manchanayake, M. J. Walpola, R. Nawaratne, T. Bandaragoda, and D. Alahakoon "Gated Recurrent Neural Network Approach for Multilabel Emotion Detection in Microblogs", arXiv preprint arXiv: 1907.07653, 2019.
[17] S. M. Kim, A. Valitutti, and R. A. Calvo, "Evaluation of unsupervised emotion models to textual affect recognition", in Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text. 2010.
[18] A. Agrawal, and A. An, "Unsupervised emotion detection from text using semantic and syntactic relations", in Proceedings of the 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology-Volume 01. 2012.
[19] A. Lakizadeh, and Z. Zinaty,"A Novel Hierachical Attention-based Method for Aspect-level Sentiment Classification", Journal of AI and data mining, in Press, DOI 10.22044/jadm.2020.9579.2091, 2020.
[20] M. Garshasbi, A. Rais-Rohani, and M. Kabaranzadeh Ghadim, "Presenting a Text Mining Algorithm to Identify Emotion in Persian Corpus", Journal of Information Technology Management, vol. 10(2), pp. 375-389, 2018
[21] V. R. Atefeh Tavakoli-Garmase, "Presenting an Algorithm for Detection of Emotion in Reviews, in First National Conference on Interdisciplinary Research", in Computer Engineering, Electrical, Mechanical and Mechatronics 2016, Buin Zahra Engineering Technical Higher Education Center, Qazvin Science and Technology Park, 2016
[22] A. Arghiani, "Emotion Detection in Text using Artificial Intelligence Techniques", M.Sc. dissertation, Dept. Comp. Eng., Shahrood University of Technology, 2016.
[23] M. Bijan Khan,"The role of human corpus in writing Grammar: introducing a computer software", Journal of linguistic, vol. 19(2), pp. 48-67, 2005.
 [24] P. Ekman,"An argument for basic emotions", Cognition & emotion, vol. 6(3-4), pp. 169-200, 1992.
[25] Z. Kövecses, "Metaphor and emotion: Language, culture, and body in human feeling", Cambridge University Press, 2003.
[26] A. Foolen, "The relevance of emotion for language and linguistics. Moving ourselves, moving others: Motion and emotion in inter-subjectivity", Consciousness and language, pp. 349-369, 2012.
[27] F. Amiri, S. Scerri, and M. Khodashahi. "Lexicon-based sentiment analysis for Persian Text", in Proceedings of the International Conference Recent Advances in Natural Language Processing. 2015.
[28] A. Najafi, "Persian Popular Culture", Niloofar Press, 2006.
[29] C. McCormick,  "Word2vec tutorial-the skip-gram model", http://mccormickml.com/2016/04/19/word2vec-tutorial-the-skip-gram-model, 2016, Retrieved.
[30] J. Chung, C. Gulcehre, K. Cho, and Y. Bengio, "Empirical evaluation of gated recurrent neural networks on sequence modeling" arXiv preprint arXiv:1412.3555, 2014.
[31] N. Srivastava,  G. Hinton, A. Krizhevsky, I. Sutskever, and R. Salakhutdinov, "Dropout: a simple way to prevent neural networks from overfitting", The journal of machine learning research, vol. 15(1), pp. 1929-1958, 2014.