Effect of Sentence Length in Sentiment Analysis Using Support Vector Machine and Convolutional Neural Network Method

Abstract

Based on Article 10 paragraph 1 of Law No. 14 of 2005, a teacher must have four competencies: pedagogical, personality, social, and professional. ICT training at Sunan Kalijaga State Islamic University involves instructors as educators who must have such competencies. An instructor's performance is assessed through students' learning evaluation system by giving comments to the instructions. These comments contain positive and negative sentiments that can be reviewed by conducting sentiment analysis. Research related to sentiment analysis in recent years has been widely done, but researchers rarely pay attention to the effect of sentence length from the dataset on the method's performance. This study tried to analyze sentiment related to sentence length effect on ICT training student comments using Support Vector Machine and Convolutional Neural Network methods.

This study concluded that the sentence length on the dataset would affect the SVM and CNN methods' performance when combined with Word2vec. While the SVM+TFIDF method performance is not affected by sentence length, this method has the fastest process time than other methods. The CNN+Word2vec method produced the best performance in this study with a value of 0.94% accuracy, 0.95% precision, 0.96% recall, and 0.95% f1-score.