Document Type : Original/Review Paper
Authors
Computer Engineering Department, University of Qom, Qom, Iran.
Abstract
Aspect-level sentiment classification is an essential issue in sentiment analysis that intends to resolve the sentiment polarity of a specific aspect mentioned in the input text. Recent methods have discovered the role of aspects in sentiment polarity classification and developed various techniques to assess the sentiment polarity of each aspect in the text. However, these studies do not pay enough attention to the need for vectors to be optimal for the aspect. To address this issue, in the present study, we suggest a Hierarchical Attention-based Method (HAM) for aspect-based polarity classification of the text. HAM works in a hierarchically manner; firstly, it extracts an embedding vector for aspects. Next, it employs these aspect vectors with information content to determine the sentiment of the text. The experimental findings on the SemEval2014 data set show that HAM can improve accuracy by up to 6.74% compared to the state-of-the-art methods in aspect-based sentiment classification task.
Keywords
[1] C.Yang, H.Zhang, B.Jiang, and K.Li, “Aspect-based sentiment analysis with alternating coattention networks,” Information Processing & Management, vol. 56, no. 3, pp. 463-478, 2019.
[2] L.Zhang, and B.Liu, "Aspect and entity extraction for opinion mining,"Data mining and knowledge discovery for big data, pp. 1-40: Springer, 2014.
[3] B .Xing, L.Liao, D .Song, J. Wang, F.Zhang, Z.Wang, and H. Huang, “Earlier attention? aspect-aware LSTM for aspect-based sentiment analysis,” in Proceedings of the 28th International Joint Conference on Artificial Intelligence, Year, pp. 5313-5319.
[4] S. M. Rezaeinia, A.Ghodsi, and R. Rahmani, “Improving the accuracy of pre-trained word embeddings for sentiment analysis,” arXiv preprint arXiv:1711.08609, 2017.
[5] D. Ma, S.Li, X.Zhang, and H. Wang, “Interactive attention networks for aspect-level sentiment classification,” arXiv preprint arXiv:1709.00893, 2017.
[6] Y. Wang, M. Huang, and L. Zhao, “Attention-based lstm for aspect-level sentiment classification,” in Proceedings of the 2016 conference on empirical methods in natural language processing, 2016, pp. 606-615.
[7] Y.Tay, L.A.Tuan, and S.C. Hui, “Learning to attend via word-aspect associative fusion for aspect-based sentiment analysis,” in Thirty-Second AAAI Conference on Artificial Intelligence, 2018.
[8] P. Chen, Z.Sun, L.Bing, and W.Yang, “Recurrent attention network on memory for aspect sentiment analysis,” in Proceedings of the 2017 conference on empirical methods in natural language processing, 2017, pp. 452-461.
[9]X. Li, L.Bing, P.Li, and W.Lam, “A unified model for opinion target extraction and target sentiment prediction,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2019, pp. 6714-6721.
[10] L .Jiang, M.Yu, M.Zhou, X .Liu, and T. Zhao, “Target-dependent twitter sentiment classification,” in Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies-Volume 1, 2011, pp. 151-160.
[11] N. Kaji, and M.Kitsuregawa, “Building lexicon for sentiment analysis from massive collection of HTML documents,” in Proceedings of the 2007 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning (EMNLP-CoNLL), Year, pp. 1075-1083.
[12] Q. Zhang, and R.Lu, “A Multi-Attention Network for Aspect-Level Sentiment Analysis,” Future Internet, vol. 11, no. 7, pp. 157, 2019.
[13] B.Zeng, H.Yang, R.Xu, W.Zhou, and X.Han, “LCF: A Local Context Focus Mechanism for Aspect-Based Sentiment Classification,” Applied Sciences, vol. 9, no. 16, pp. 3389, 2019.
[14] N. Cai, C.Ma, W. Wang, and D.Meng, “Effective Self Attention Modeling for Aspect Based Sentiment Analysis,” in International Conference on Computational Science, Year, pp. 3-14.
[15] D.Tang, B.Qin, X.Feng, and T. Liu, “Effective LSTMs for target-dependent sentiment classification,” arXiv preprint arXiv:1512.01100, 2015.
[16] S.Gu, L.Zhang, Y.Hou, and Y.Song, “A position-aware bidirectional attention network for aspect-level sentiment analysis,” in Proceedings of the 27th International Conference on Computational Linguistics, Year, pp. 774-784.
[17] Q. Mao, J.Li, S.Wang, Y.Zhang, H.Peng, M.He, and L.Wang, “Aspect-based sentiment classification with attentive neural turing machines,” in Proceedings of the 28th International Joint Conference on Artificial Intelligence, Year, pp. 5139-5145.
[18] Y.Song, J.Wang, T.Jiang, Z.Liu, and Y.Rao, “Attentional encoder network for targeted sentiment classification,” arXiv preprint arXiv:1902.09314, 2019.
[19] J.Pennington, R.Socher, and C.Manning, “Glove: Global vectors for word representation,” in Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP), Year, pp. 1532-1543.
[20]J.Devlin, M.-W.Chang, K. Lee, and K.Toutanova, “Bert: Pre-training of deep bidirectional transformers for language understanding,” arXiv preprint arXiv:1810.04805, 2018.
[21] C.Szegedy, V.Vanhoucke, S.Ioffe, J. Shlens, and Z. Wojna, “Rethinking the inception architecture for computer vision,” in Proceedings of the IEEE conference on computer vision and pattern recognition, Year, pp. 2818-2826.
[22] M.Pontiki, D.Galanis, J.Pavlopoulos, H. Papageorgiou , I.Androutsopoulos, and S. Manandhar, “SemEval-2014 Task 4: Aspect Based Sentiment Analysis,” in Proceedings of the 8th International Workshop on Semantic Evaluation (SemEval 2014), Dublin,Ireland, August 23-24, 2014.
[23]S.Hochreiter, and J.Schmidhuber, “Long short-term memory,” Neural computation, vol. 9, no. 8, pp. 1735-1780, 1997.
[24] Y. LeCun,and Y.Bengio, “Convolutional networks for images, speech, and time series,” The handbook of brain theory and neural networks, vol. 3361, no. 10, pp. 1995, 1995.
[25] D.Tang, B.Qin, and T.Liu,“Aspect level sentiment classification with deep memory network,” arXiv preprint arXiv:1605.08900, 2016.
[26] P.Zhu, and T.Qian, “Enhanced aspect level sentiment classification with auxiliary memory,” in Proceedings of the 27th International Conference on Computational Linguistics, Year, pp. 1077-1087.
[27] N. Majumder, S. Poria, A. Gelbukh, M. S. Akhtar, E. Cambria, and A. kbal, “IARM: Inter-aspect relation modeling with memory networks in aspect-based sentiment analysis,” in Proceedings of the 2018 conference on empirical methods in natural language processing, Year, pp. 3402-3411
[28] J.Yang, R.Yang, H.Lu, C.Wang, and J.Xie, “Multi-Entity Aspect-Based Sentiment Analysis with Context, Entity, Aspect Memory and Dependency Information,” ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP), vol. 18, no. 4, pp. 47, 2019.
[29] S. Wu, Y. Xu, F. Wu, Z. Yuan, Y. Huang, and X. Li, “Aspect-based sentiment analysis via fusing multiple sources of textual knowledge,” Knowledge-Based Systems, vol. 183, pp. 104868, 2019.
[30] B.Huang, and K.M.Carley, “Parameterized convolutional neural networks for aspect level sentiment classification,” arXiv preprint arXiv: 1909.06276, 2019.
[31] B.Huang, and K.M.Carley, “Syntax-Aware Aspect Level Sentiment Classification with Graph Attention Networks,” arXiv preprint arXiv: 1909.02606, 2019.
[32] M.Hu, Y.Peng, Z. Huang, D.Li, and Y.Lv, “Open-Domain Targeted Sentiment Analysis via Span-Based Extraction and Classification,” arXiv preprint arXiv:1906.03820, 2019.
[33] M.Hu, S.Zhao, H.Guo, R.Cheng, and Z.Su, “Learning to Detect Opinion Snippet for Aspect-Based Sentiment Analysis,” arXiv preprint arXiv:1909.11297, 2019.
[34] A. Kumar, V.T. Narapareddy, V.A. Srikanth, L.B. M. Neti, and A. Malapati, “Aspect Based Sentiment Classification Using Interactive Gated Convolutional Network,” IEEE Access, 2020.
[35] Y.Song, J.Wang, Z. Liang, Z. Liu, and T. Jiang, “Utilizing BERT intermediate layers for aspect based sentiment analysis and natural language inference,” arXiv preprint arXiv:2002.04815, 2020.
[36] J. Zhou, J.X. Huang, Q. Chen, Q. V. Hu, T. Wang, and L. He, “Deep Learning for Aspect-Level Sentiment Classification: Survey, Vision and Challenges,” IEEE Access, 2019.
[37] Z. Chen, and T. Qian, “Transfer Capsule Network for Aspect Level Sentiment Classification,” in Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Year, pp. 547-556.
[38]H.Keshavarz,and M. Saniee Abadeh, “MHSubLex: Using metaheuristic methods for subjectivity classification of microblogs,” Journal of AI and Data Mining, vol. 6, no. 2, pp. 341-353, 2018.
)