Document Type : Original/Review Paper
Authors
Department of Computer Engineering, University of Bojnord, Bojnord, Iran.
Abstract
The identification of emotions in short texts of low-resource languages poses a significant challenge, requiring specialized frameworks and computational intelligence techniques. This paper presents a comprehensive exploration of shallow and deep learning methods for emotion detection in short Persian texts. Shallow learning methods employ feature extraction and dimension reduction to enhance classification accuracy. On the other hand, deep learning methods utilize transfer learning and word embedding, particularly BERT, to achieve high classification accuracy. A Persian dataset called "ShortPersianEmo" is introduced to evaluate the proposed methods, comprising 5472 diverse short Persian texts labeled in five main emotion classes. The evaluation results demonstrate that transfer learning and BERT-based text embedding perform better in accurately classifying short Persian texts than alternative approaches. The dataset of this study ShortPersianEmo will be publicly available online at https://github.com/vkiani/ShortPersianEmo.
Keywords
- natural language processing
- emotion classification
- Persian text
- emotion detection benchmark
- deep learning
Main Subjects
[1] S. Peng et al., “A survey on deep learning for textual emotion analysis in social networks,” Digital Communications and Networks, vol. 8, no. 5, pp. 745-762, Oct. 2022.
[2] F. A. Acheampong, C. Wenyu, and H. Nunoo-Mensah, “Text-based emotion detection: Advances, challenges, and opportunities,” Engineering Reports, vol. 2, no. 7, p. e12189, 2020.
[3] B. Kratzwald, S. Ilić, M. Kraus, S. Feuerriegel, and H. Prendinger, “Deep learning for affective computing: Text-based emotion recognition in decision support,” Decision Support Systems, vol. 115, pp. 24-35, Nov. 2018.
[4] A. Lakizadeh and E. Moradizadeh, “Text Sentiment Classification based on Separate Embedding of Aspect and Context,” Journal of AI and Data Mining, vol. 10, no. 1, pp. 139-149, Jan. 2022.
[5] V. Balakrishnan and W. Kaur, “String-based Multinomial Naïve Bayes for Emotion Detection among Facebook Diabetes Community,” Procedia Computer Science, vol. 159, pp. 30-37, Jan. 2019.
[6] S. Ghosh, N. Froelich, and C. Aragon, “‘I Love You, My Dear Friend’: Analyzing the Role of Emotions in the Building of Friendships in Online Fanfiction Communities,” in Social Computing and Social Media, A. Coman and S. Vasilache, Eds., in Lecture Notes in Computer Science, vol. 14026. Cham: Springer Nature Switzerland, 2023, pp. 466-485.
[7] M. Nasiri and H. Rahmani, “DENOVA: Predicting Five-Factor Model using Deep Learning based on ANOVA,” Journal of AI and Data Mining, vol. 9, no. 4, pp. 451-463, Nov. 2021.
[8] M. Rasouli and V. Kiani, “A survey on deep learning methods for text-based emotion classification: Advances, challenges, and opportunities,” Soft Computing Journal, Sep. 2023, doi: 10.22052/scj.2023.248812.1126.
[9] P. Kumar and B. Raman, “A BERT based dual-channel explainable text emotion recognition system,” Neural Networks, vol. 150, pp. 392-407, Jun. 2022.
[10] S. Q. Suidong Qu, Y. Y. Yanhua Yang, and Q. Q. Qinyu Que, “Emotion Classification for Spanish with XLM-RoBERTa and TextCNN.,” in Iberian Languages Evaluation Forum 2021 & 37th International Conference of the Spanish Society for Natural Language Processing, 2021, pp. 94-100. [Online]. Available: https://ceur-ws.org/Vol-2943/emoeval_paper10.pdf
[11] A. Das, O. Sharif, M. M. Hoque, and I. H. Sarker, “Emotion Classification in a Resource Constrained Language Using Transformer-based Approach,” arXiv:2104.08613, Apr. 2021. [Online]. Available: https://arxiv.org/abs/2104.08613. [Accessed Oct. 20, 2023].
[12] E. Batbaatar, M. Li, and K. H. Ryu, “Semantic-Emotion Neural Network for Emotion Recognition From Text,” IEEE Access, vol. 7, pp. 111866-111878, 2019.
[13] A. Chatterjee, U. Gupta, M. K. Chinnakotla, R. Srikanth, M. Galley, and P. Agrawal, “Understanding Emotions in Text Using Deep Learning and Big Data,” Computers in Human Behavior, vol. 93, pp. 309-317, Apr. 2019.
[14] M. Abdullah, M. Hadzikadicy, and S. Shaikhz, “SEDAT: Sentiment and Emotion Detection in Arabic Text Using CNN-LSTM Deep Learning,” in 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, FL, 2018, pp. 835-840.
[15] H. Luo, “Emotion Detection for Spanish with Data Augmentation and Transformer-Based Models,” in Proceedings of the Iberian Languages Evaluation Forum (IberLEF 2021), Malaya, Spain, 2021, pp. 35-42.
[16] H. Q. Abonizio, E. C. Paraiso, and S. Barbon Junior, “Toward Text Data Augmentation for Sentiment Analysis,” IEEE Transactions on Artificial Intelligence, vol. 3, no. 5, pp. 657-668, 2021.
[17] X. Wu, S. Lv, L. Zang, J. Han, and S. Hu, “Conditional BERT Contextual Augmentation,” in Computational Science – ICCS 2019, J. Rodrigues et al., Eds., in Lecture Notes in Computer Science, vol. 11539. Cham: Springer International Publishing, 2019, pp. 84-95.
[18] J. Luo, M. Bouazizi, and T. Ohtsuki, “Data Augmentation for Sentiment Analysis Using Sentence Compression-Based SeqGAN With Data Screening,” IEEE Access, vol. 9, pp. 99922-99931, 2021.
[19] S. Y. Feng, V. Gangal, J. Wei, S. Chandar, S. Vosoughi, T. Mitamura, E. Hovy, “A Survey of Data Augmentation Approaches for NLP,” arXiv: 2105.03075, Dec. 2021. [Online]. Available: https://arxiv.org/abs/2105.03075. [Accessed Oct. 20, 2023].
[20] C. Shorten, T. M. Khoshgoftaar, and B. Furht, “Text Data Augmentation for Deep Learning,” Journal of Big Data, vol. 8, no. 1, Art. no. 1, Dec. 2021.
[21] S. G. Tesfagergish, J. Kapočiūtė-Dzikienė, and R. Damaševičius, “Zero-Shot Emotion Detection for Semi-Supervised Sentiment Analysis Using Sentence Transformers and Ensemble Learning,” Applied Sciences, vol. 12, no. 17, Art. no. 17, Jan. 2022.
[22] A. Khosravi, M. Kelarestaghi, and M. Purmohammad, “Emotion Detection in Persian Text: A Machine Learning Model,” Contemporary Psychology, Biannual Journal of the Iranian Psychological Association (BJCP), vol. 14, no. 1, pp. 42-48, Aug. 2019.
[23] S. S. Sadeghi, H. Khotanlou, and M. Rasekh Mahand, “Automatic Persian Text Emotion Detection using Cognitive Linguistic and Deep Learning,” Journal of AI and Data Mining, vol. 9, no. 2, pp. 169-179, Apr. 2021.
[24] H. Mirzaee, J. Peymanfard, H. H. Moshtaghin, and H. Zeinali, “ArmanEmo: A Persian Dataset for Text-based Emotion Detection,” arXiv:2207.11808, Jul. 2022. [Online]. Available: https://arxiv.org/abs/2207.11808. [Accessed Oct. 20, 2023].
[25] A. Abaskohi, N. Sabri, and B. Bahrak, “Persian Emotion Detection using ParsBERT and Imbalanced Data Handling Approaches,” arXiv:2211.08029, Nov. 2022. [Online]. Available: https://arxiv.org/abs/2211.08029. [Accessed Oct. 20, 2023].
[26] A. Khodaei, A. Bastanfard, H. Saboohi, and H. Aligholizadeh, “Deep Emotion Detection Sentiment Analysis of Persian Literary Texts,” Research Square, 2022. [Online]. Available: https://www.researchsquare.com/article/rs-1796157/v1. [Accessed Oct. 20, 2023].
[27] Y. Liu, P. Li, and X. Hu, “Combining context-relevant features with multi-stage attention network for short text classification,” Computer Speech & Language, vol. 71, p. 101268, Jan. 2022.
[28] J. Xu et al., “Incorporating context-relevant concepts into convolutional neural networks for short text classification,” Neurocomputing, vol. 386, pp. 42-53, Apr. 2020.
[29] T. Mikolov, E. Grave, P. Bojanowski, C. Puhrsch, and A. Joulin, “Advances in Pre-Training Distributed Word Representations.” arXiv: 1712.09405, Dec. 2017. [Online]. Available: https://arxiv.org/abs/1712.09405. [Accessed Oct. 20, 2023].
[30] M. Farahani, M. Gharachorloo, M. Farahani, and M. Manthouri, “ParsBERT: Transformer-based Model for Persian Language Understanding,” Neural Processing Letters, vol. 53, no. 6, pp. 3831-3847, Dec. 2021.
[31] R. E. Jack, W. Sun, I. Delis, O. G. B. Garrod, and P. G. Schyns, “Four not six: Revealing culturally common facial expressions of emotion,” Journal of Experimental Psychology: General, vol. 145, no. 6, pp. 708-730, Jun. 2016.
[32] N. Sabri, R. Akhavan, and B. Bahrak, “EmoPars: A Collection of 30K Emotion-Annotated Persian Social Media Texts,” in Proceedings of the Student Research Workshop Associated with RANLP 2021, 2021, pp. 167-173. [Online]. Available: https://aclanthology.org/2021.ranlp-srw.23/. [Accessed Oct. 20, 2023].
)