Aspect-Based Sentiment Analysis on Indonesian Restaurant Review Using a Combination of Convolutional Neural Network and Contextualized Word Embedding

https://doi.org/10.22146/ijccs.67306

Putri Rizki Amalia(1*), Edi Winarko(2)

(1) Bachelor Program of Computer Science, FMIPA UGM, Yogyakarta
(2) Department of Computer Science and Electronics, FMIPA UGM, Yogyakarta
(*) Corresponding Author

Abstract


Someone's opinion on a product or service that is poured through a review is something that is quite important for the owner or potential customer. However, the large number of reviews makes it difficult for them to analyze the information contained in the reviews. Aspect-based sentiment analysis is the process of determining the sentiment polarity of a sentence based on predetermined aspects.

This study aims to analyze an Indonesian restaurant review using a combination of Convolutional Neural Network and Contextualized Word Embedding models. Then it will be compared with a combination of Convolutional Neural Network and Traditional Word Embedding models. The result of aspect-classification on three models; BERT-CNN, ELMo-CNN, and Word2vec-CNN give the best results on the ELMo-CNN model with micro-average precision of 0.88, micro-average recall of 0.84, and micro-average f1-score of 0.86. Meanwhile, the sentiment-classification gives the best results on the BERT-CNN model with a precision value of 0.89, a recall of 0.89, and an f1-score of 0.91. Classification using data without stemming have almost similar results, even better than using data with stemming.


Keywords


Aspect-based sentiment analysis; CNN; BERT; ELMo

Full Text:

PDF


References

[1]                A. Cahyadi, and M. Khodra, "Aspect-Based Sentiment Analysis Using Convolutional Neural Network and Bidirectional Long Short-Term Memory," 2018 5th International Conference on Advanced Informatics: Concept Theory and Applications (ICAICTA), pg.124-129, 2018.

[2]                A. Ilmania, Abdurrahman, S. Cahyawijaya, and A. Purwarianti, "Aspect Detection and Sentiment Classification Using Deep Neural Network for Indonesian Aspect-Based Sentiment Analysis," 2018 International Conference on Asian Language Processing (IALP), pg.62-67, 2018

[3]                A. Rahmah, "Analisis sentimen berdasarkan aspek pada ulasan restoran berbahasa indonesia menggunakan convolutional neural network (CNN) dan gated recurrent unit (GRU)," Skripsi. Program Studi Ilmu Komputer, FMIPA UGM, Yogyakarta, 2020.

[4]                B. Liu, "Sentiment Analysis and Opinion Mining," Cambridge: Cambridge University Press, 2015.

[5]                B. Talafha, M. Al-Ayyoub, A. Abuammar, and Y. Jararweh, "Outperforming State-of-the-Art Systems for Aspect-Based Sentiment Analysis," In 2019 IEEE/ACS 16th International Conference on Computer Systems and Applications (AICCSA), pg. 1-5, 2019.

[6]                B. Wilie, K. Vincentio, G. I. Winata, S. Cahyawijaya, X. Li, Z. Y. Lim, S. Soleman, R. Mahendra, P. Fung, S. Bahar, and A. Purwarianti. 2020. IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding. In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing.

[7]                D. Ekawati, and M. L. Khodra, "Aspect-based sentiment analysis for Indonesian restaurant reviews," In 2017 International Conference on Advanced Informatics, Concepts, Theory, and Applications (ICAICTA), pg. 1-6, 2017.

[8]                H. Do, P. Prasad, A. Maag, and A. Alsadoon, "Deep Learning for Aspect-Based Sentiment Analysis: A Comparative Review," Expert Systems with Applications, 118, pg.272-299, 2019.

[9]                J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, "Bert: Pre-training of deep bidirectional transformers for language understanding," arXiv preprint arXiv:1810.04805, 2018.

[10]            J. Han, J. Pei, and M. Kamber,"Data mining: concepts and techniques," Elsevier, 2011.

[11]            M. Bangsa, 2019. "Analisis sentimen berbasis aspek pada ulasan toko online menggunakan convolutional neural network," Tesis. Program Studi Ilmu Komputer, FMIPA UGM, Yogyakarta, 2019.

[12]            M. E. Peters, M. Neumann, M. Iyyer, M. Gardner, C. Clark, K. Lee, and L. Zettlemoyer, "Deep contextualized word representations," arXiv preprint arXiv:1802.05365, 2018.

[13]            M. Truşcǎ, D. Wassenberg, F. Frasincar, F. and R. Dekker, "A Hybrid Approach for Aspect-Based Sentiment Analysis Using Deep Contextual Word Embeddings and Hierarchical Attention," 2020 International Conference on Web Engineering, pg.365-380, 2020

[14]            N. Jihan, Y. Senarath, and S. Ranathunga, "Aspect Extraction from Customer Reviews Using Convolutional Neural Networks," 2018 18th International Conference on Advances in ICT for Emerging Regions (ICTer), pg.215-220, 2018.

[15]            R. Horev, "BERT Explained: State of the art language model for NLP," https://towardsdatascience.com/bert-explained-state-of-the-art-language-model-for-nlp-f8b21a9b6270, 2018. [accessed: 3-Dec-2020]

[16]            S. Wadekar, "Hyperparameter Tuning in Keras: TensorFlow 2: With Keras Tuner: RandomSearch, Hyperband, BayesianOptimization,". https://medium.com/swlh/hyperparameter-tuning-in-keras-tensorflow-2-with-keras-tuner-randomsearch-hyperband-3e212647778f, 2021. [accessed 14-Apr-2021]

[17]            T. O'Malley, E. Bursztein, J. Long, F. Chollet, H. Jin, L. Invernizzi, et al. "Keras Tuner," https://github.com/keras-team/keras-tuner, 2019.

[18]            W. Che, Y. Liu, Y. Wang, B. Zheng, and T. Liu, "Towards Better UD Parsing: Deep Contextualized Word Embeddings, Ensemble, and Treebank Concatenation," In Proceedings of the CoNLL 2018 Shared Task: Multilingual Parsing from Raw Text to Universal Dependencies, pg. 55–64. 2018.

[19]            X. Ouyang, P. Zhou, C. Li, and L. Liu, "Sentiment Analysis Using Convolutional Neural Network," 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing, pg.2359-2364, 2015.

[20]            Y. Kim, "Convolutional neural networks for sentence classification," arXiv preprint arXiv:1408.5882, 2014.



DOI: https://doi.org/10.22146/ijccs.67306

Article Metrics

Abstract views : 439 | views : 729

Refbacks

  • There are currently no refbacks.




Copyright (c) 2021 IJCCS (Indonesian Journal of Computing and Cybernetics Systems)

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.



Copyright of :
IJCCS (Indonesian Journal of Computing and Cybernetics Systems)
ISSN 1978-1520 (print); ISSN 2460-7258 (online)
is a scientific journal the results of Computing
and Cybernetics Systems
A publication of IndoCEISS.
Gedung S1 Ruang 416 FMIPA UGM, Sekip Utara, Yogyakarta 55281
Fax: +62274 555133
email:ijccs.mipa@ugm.ac.id | http://jurnal.ugm.ac.id/ijccs



View My Stats1
View My Stats2