Analisis Sentimen Ulasan EA FC 26 Di Steam: Perbandingan SVM Dan Multinomial Naïve Bayes

Rafi Adha Azhar; Wahyu Widodo

doi:10.47065/mis.v4i3.2977

Rafi Adha Azhar * STMIK El Rahma Yogyakarta, Indonesia
Wahyu Widodo STMIK EL RAHMA YOGYAKARTA, Indonesia

DOI: https://doi.org/10.47065/mis.v4i3.2977

Keywords: Analisis Sentimen, EA FC 26, Steam, Support Vector Machine, Multinomial Naïve Bayes, TF-IDF N-Gram

Abstract

User reviews on the Steam platform contain important information about player perceptions of EA FC 26. However, the large volume of reviews and their unstructured textual form make manual analysis difficult and prone to inconsistency. This study aims to identify user sentiment tendencies and compare the performance of Support Vector Machine (SVM) and Multinomial Naïve Bayes in classifying EA FC 26 reviews on Steam. The research follows the Knowledge Discovery in Database (KDD) stages, consisting of selection, preprocessing, transformation, data mining, and evaluation. A total of 5,000 recent English-language reviews were collected through the Steam Review API. After data processing, 4,988 valid reviews were obtained, consisting of 2,823 negative reviews and 2,165 positive reviews based on the voted_up recommendation status. The review texts were represented using TF-IDF N-Gram features consisting of unigrams and bigrams, then classified using SVM and Multinomial Naïve Bayes. The evaluation results show that SVM achieved an accuracy of 82.26% and a weighted F1-score of 0.8230, while Multinomial Naïve Bayes achieved an accuracy of 77.15% and a weighted F1-score of 0.7598. The McNemar test produced a p-value of 0.000421, indicating a statistically significant difference between the two models. This study contributes by providing a comparative evaluation based not only on general accuracy, but also on per-class performance, confusion matrix, prediction error patterns, and statistical significance.

References

M. Y. Febrianta, S. Widiyanesti, and S. Robbiansyah, “Analisis Ulasan Indie Video Game Lokal pada Steam Menggunakan Analisis Sentimen dan Pemodelan Topik Berbasis Latent Dirichlet Allocation,” Journal of Animation & Games Studies, vol. 7, no. 2, pp. 117–144, 2021, doi: 10.24821/jags.v7i2.5162.

A. Pangestu et al., “ANALISIS SENTIMEN REVIEW PUBLIK PENGGUNA GAME ONLINE PADA PLATFORM STEAM MENGGUNAKAN ALGORITMA NAÏVE BAYES,” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 7, no. 6, pp. 3106–3113, 2023, doi: 10.36040/jati.v7i6.8829.

A. Kho and F. F. Tampinongkol, “Analisis Sentimen Pengguna Aplikasi STEAM dengan Algoritma Naive Bayes,” Ranah Research : Journal Of Multidisciplinary Research and Development, vol. 7, no. 6, pp. 4620–4627, 2025, doi: 10.38035/rrj.v7i6.1803.

S. V. Tampubolon and D. A. Sulistyo, “Analisis Sentimen Ulasan Game Stardew Valley pada Steam dan Google Play,” JURNAL FASILKOM, vol. 16, no. 1, pp. 57–67, 2026, doi: 10.37859/jf.v16i1.11217.

N. Sabilly, Khadijah, and F. A. Nugroho, “SENTIMENT ANALYSIS OF LEAGUE OF LEGENDS: WILD RIFT REVIEWS ON GOOGLE PLAY USING NAÏVE BAYES CLASSIFIER,” Jurnal Ilmiah KURSOR, vol. 12, no. 1, pp. 23–30, 2023, doi: 10.21107/kursor.

A. Bachtiar, M. J. Hawali, N. C. Simbolon, D. A. Maulana, and R. A. Anggraini, “ANALISIS SENTIMEN ULASAN FREE FIRE MENGGUNAKAN NAIVE BAYES LOGISTIC REGRESSION,” Journal of Information System Management (JOISM, vol. 7, no. 2, 2026, doi: 10.24076/joism.2026v7i2.2433.

M. F. Fahrudillah and D. A. Sulistyo, “Analisis Sentimen Ulasan Pemain Genshin Impact Menggunakan Kombinasi TF-IDF , Lexicon , dan Support Vector Machine,” JURNAL FASILKOM, vol. 15, no. 3, pp. 580–593, 2025, doi: 10.37859/jf.v15i3.10553.

S. Aura and D. Novianto, “Comparative Sentiment Analysis of TheoTown Reviews on Steam and Google Play Store Using Support Vector Machine,” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 6, no. April, pp. 886–896, 2026, doi: 10.57152/malcom.v6i2.2661.

S. F. Riyadi, Y. H. Chrisnanto, and G. Abdillah, “Analisis Sentimen Komunitas Counter-Strike 2 ( CS2 ) Menggunakan Support Vector Machine ( SVM ),” JURIKOM (Jurnal Riset Komputer), vol. 12, no. 3, 2025, doi: 10.30865/jurikom.v12i3.8620.

A. K. Saputra, M. R. Handayani, N. Cahyo, H. Wibowo, and K. Umam, “Sentiment Analysis of User Reviews on the Game GTA V Using Support Vector Machine,” Jurnal SISFOKOM (Sistem Informasi dan Komputer), vol. 14, pp. 284–290, 2025, doi: 10.33884/jif.v13i01.9913.

N. Arifin, U. Enri, and N. Sulistiyowati, “PENERAPAN ALGORITMA SUPPORT VECTOR MACHINE ( SVM ) DENGAN TF-IDF N-GRAM UNTUK TEXT CLASSIFICATION,” STRING (Satuan Tulisan Riset dan Inovasi Teknologi), vol. 6, no. 2, 2021, doi: 10.30998/string.v6i2.10133.

P. R. Sari et al., “Comparison of Naive Bayes and SVM Algorithms for Sentiment Analysis of PUBG Mobile on Google Play Store,” Sistemasi: Jurnal Sistem Informasi Volume, vol. 13, pp. 2767–2779, 2024, doi: 10.32520/stmsi.v13i6.4814.

S. D. Parameswari, M. Lubis, S. Suakanto, Y. Z. Ramadhan, N. Amanah, and R. A. Dila, “Studi Perbandingan Naï ve Bayes dan Support Vector Machine ( SVM ) dalam Analisis Sentimen Pengguna Metaverse,” Jurnal Teknologi dan Manajemen Industri Terapan (JTMIT), vol. 4, no. 3, pp. 1059–1065, 2025, doi: 10.55826/jtmit.v4i3.1122.

R. Karsi, M. Zaim, and J. El Alami, “Assessing naive bayes and support vector machine performance in sentiment classification on a big data platform,” IAES International Journal of Artificial Intelligence (IJ-AI), vol. 10, no. 4, pp. 990–996, 2021, doi: 10.11591/ijai.v10.i4.pp990-996.

R. Nur, R. Abdul, and W. J. Pranoto, “Analisis Sentimen Ulasan Game eFootball 2024 Pada Playstore menggunakan Algoritma Naïve Bayes,” JURNAL ILMIAH INFORMATIKA, vol. 13, no. 15, 2025, doi: 10.33884/jif.v13i01.9913.

Muttaqin et al., Pengenalan Data Mining. Yayasan Kita Menulis, 2023.

GeeksforGeeks, “KDD Process in Databases,” Jun. 14, 2025, GeeksforGeeks. [Online]. Available: https://www.geeksforgeeks.org/dbms/kdd-process-in-data-mining/