Sentiment Analysis Of NTB Syariah Bank Application Services using The Naïve Bayes and Support Vector Machine Methods
DOI:
https://doi.org/10.26905/jtmi.v11i2.16311Keywords:
Sentiment Analysis, App Service Sentiment Analysis, NTB Syariah Bank, Naïve Bayes, Support Vector MachineAbstract
This research analyzed user sentiment toward the NTB Syariah application using Support Vector Machine (SVM) and Naïve Bayes classification methods. A dataset comprising 814 reviews was obtained via web scraping, with 245 allocated for testing. Preprocessing encompassed cleaning, case folding, tokenization, filtering, and stemming, while sentiment labeling employed a lexicon-based approach integrated with TF-IDF weighting, categorizing reviews as positive, neutral, or negative. Model performance was assessed through accuracy, precision, recall, and F1-score metrics. Results demonstrated SVM's superior performance (accuracy: 92.65%; precision: 0.9327; recall: 0.9265; F1-score: 0.9149) compared to Naïve Bayes (accuracy: 84.49%; precision: 0.8415; recall: 0.8449; F1-score: 0.8005). SVM exhibited greater robustness in managing high-dimensional, complex, and moderately imbalanced datasets, delivering consistent cross-class sentiment classification. Conversely, Naïve Bayes remained computationally efficient and suitable for rapid implementation scenarios. These findings underscore machine learning's efficacy in sentiment analysis for digital banking platforms.
Downloads
References
[1] F. M. Bagas, “Transformasi digital era industri 4.0 revolusi layanan yang mengubah lanskap perbankan syariah di Indonesia,” JICN: Jurnal Intelek dan Cendikiawan Nusantara., vol. 1, no. 5, pp. 7653–7665, 2024.
[2] M. R. Pratama, Y. R. Ramadha, and M. A. Komara, “Analisis Sentimen BRImo dan BCA Mobile Menggunakan Support Vector Machine dan Lexicon Based,” Jutisi : Jurnal Ilmiah Teknik Informatika dan Sistem Informasi, vol. 12, no. 3, p. 1439, 2023, doi: 10.35889/jutisi.v12i3.1431.
[3] A. Nadira, N. Y. Setiawan, and W. Purnomo, “Analisis Sentimen Pada Ulasan Aplikasi Mobile Banking Menggunakan Metode Naïve Bayes Dengan Kamus Inset,” Indexia, vol. 5, no. 01, p. 35, 2023, doi: 10.30587/indexia.v5i01.5138.
[4] E. Damayanti, A. V. Vitianingsih, S. Kacung, H. Suhartoyo, and A. Lidya Maukar, “Sentiment Analysis of Alfagift Application User Reviews Using Long Short-Term Memory (LSTM) and Support Vector Machine (SVM) Methods,” Decode: Jurnal Pendidikan Teknologi Informasi, vol. 4, no. 2, pp. 509–521, Jun. 2024, doi: 10.51454/decode.v4i2.478.
[5] R. Waluyo et al., “Jurnal Teknologi dan Manajemen Informatika User Satisfaction Level of Library System Using End User Computing Satisfaction and Importance Performance Analysis Methods Article Info ABSTRACT,” vol. 11, pp. 35–46, 2025, [Online]. Available: http://http://jurnal.unmer.ac.id/index.php/jtmi
[6] N. Meilani, Mhd. Furqan, and Suhardi, “Analisis sentimen pengguna aplikasi BSI mobile akibat ransomware menggunakan algoritma support vector machine,” INFOTECH : Jurnal Informatika & Teknologi, vol. 5, no. 1, pp. 42–51, 2024, doi: 10.37373/infotech.v5i1.1102.
[7] A. T. Dewi Septiani, A. P. Kuncoro, P. Subarkah, and R. Riyanto, “Perbandingan Kinerja Metode Naïve Bayes Classifier dan K-Nearest Neighbor pada Analisis Sentimen Ulasan Mobile Banking Jenius,” Jurnal Krisnadana, vol. 3, no. 2, pp. 67–77, 2024, doi: 10.58982/krisnadana.v3i2.516.
[8] S. A. S. Mola, D. L. B. Baun, I. O. Nunes, and M. M. A. R. Sani, “Analisis Sentimen Aplikasi Halo Bca Di Google Play Store Menggunakan Metode Naive Bayes, Support Vector Machine Dan Random Forest,” HOAQ (High Education of Organization Archive Quality) : Jurnal Teknologi Informasi, vol. 15, no. 2, pp. 69–79, Dec. 2024, doi: 10.52972/hoaq.vol15no2.p69-79.
[9] P. Amanda and O. Yudha Sudrajad, “International Journal of Current Science Research and Review Evaluation of Digital Banking Efficiency in Indonesian Banking Sector using Data Envelopment Analysis (DEA) Approach”, doi: 10.47191/ijcsrr/V6-i8-01.
[10] N. Firdausy, I. Yuadi, I. Puspitasari, P. Studi Magister Pengembangan Sumber Daya Manusia, and S. Pascasarjana, “Analisis Sentimen Evaluasi Reaksi E-Learning Menggunakan Algoritma Naïve Bayes Support Vector Machine dan Deep Learning Sentiment analysis of e-learning reaction evaluations using Naïve Bayes, Support Vector Machine, and Deep Learning algorithms.”
[11] G. Kusuma Putri, H. Sujaini, D. Isna Ulumi, J. H. Hadari Nawawi, and K. Barat, “Perbandingan Algoritma Support Vector Machine (SVM) dan Naive Bayes pada Analisis Sentimen Bahasa Jawa dan Sunda”, doi: 10.26418/justin.v13i2.88285.
[12] K. Kevin, M. Enjeli, and A. Wijaya, “Analisis Sentimen Pengunaaan Aplikasi Kinemaster Menggunakan Metode Naive Bayes,” Jurnal Ilmiah Computer Science, vol. 2, no. 2, pp. 89–98, Jan. 2024, doi: 10.58602/jics.v2i2.24.
[13] N. A. Maulana and D. Darwis, “Perbandingan Metode SVM dan Naïve Bayes untuk Analisis Sentimen pada Twitter tentang Obesitas di Kalangan Gen Z Sistem Informasi , Fakultas Teknik dan Ilmu Komputer , Universitas Teknokrat Indonesia , Indonesia Comparison of SVM and Naive Bayes Methods fo,” vol. 5, no. 3, pp. 655–666, 2025.
[14] “4213-Article Text-8771-1-10-20250626 (1)”.
[15] T. A. Wahyudi, A. Arifia, A. A. Suryanto, and A. History, “Jurnal Teknologi dan Manajemen Informatika Application of Text Mining and K-Medoids for Job Clustering Based on Job Description Analysis Article Info ABSTRACT,” vol. 11, pp. 100–109, 2025, [Online]. Available: http://http://jurnal.unmer.ac.id/index.php/jtmi
[16] F. Pradana Rachman, H. Santoso, and A. History, “Jurnal Teknologi dan Manajemen Informatika Perbandingan Model Deep Learning untuk Klasifikasi Sentiment Analysis dengan Teknik Natural Languange Processing Article Info ABSTRACT,” vol. 7, no. 2, pp. 103–112, 2021, [Online]. Available: http://http://jurnal.unmer.ac.id/index.php/jtmi
[17] A. Safira, A. S. Masyarakat…, and F. N. Hasan, “ANALISIS SENTIMEN MASYARAKAT TERHADAP PAYLATER MENGGUNAKAN METODE NAIVE BAYES CLASSIFIER,” Jurnal Sistem Informasi, vol. 5, no. 1, 2023.
[18] M. Maulidah, A. Ardiansyah, L. Putri Gemilang, and N. Fitria Indriarti, “Analisis Sentimen Pada Ulasan Aplikasi Superbank Dengan Metode Support Vector Machine Dan Naive Bayes,” Indonesian Journal on Software Engineering (IJSE), vol. 10, no. 2, pp. 147–155, 2024, [Online]. Available: http://ejournal.bsi.ac.id/ejurnal/index.php/ijse
[19] “4213-Article Text-8771-1-10-20250626 (2)”.
[20] H. P. Doloksaribu and Yusran Timur Samuel, “Komparasi Algoritma Data Mining Untuk Analisis Sentimen Aplikasi Pedulilindungi,” Jurnal Teknologi Informasi: Jurnal Keilmuan dan Aplikasi Bidang Teknik Informatika, vol. 16, no. 1, pp. 1–11, 2022, doi: 10.47111/jti.v16i1.3747.
[21] A. Agung, A. Daniswara, I. Kadek, and D. Nuryana, “Data Preprocessing Patterns in the Assessment of Teacher Education Program Students,” Journal of Informatics and Computer Science, vol. 05, pp. 97–100, 2023.
[22] W. P. Ramadhan and D. Juardi, “Analisis Sentimen Ulasan Aplikasi Btn Mobile Menggunakan Algoritma Naive Bayes,” Jurnal Informatika dan Teknik Elektro Terapan, vol. 13, no. 1, 2025, doi: 10.23960/jitet.v13i1.6002.
[23] H. Prasetya, Z. Situmorang, and R. Rosnelly, “SVM Optimization with Kernel Function for Sentiment Analysis on Social Media twitter (X) in AFC U23 Asian Cup Case Study,” 2024, doi: 10.30743/icst.
[24] Y. Darmayanti, F. Marisa, and A. Yuniar Rahman, “Analytical Comparison of Lung Cancer Classification Using K-Nearest Neighbor and Naïve Bayes Algorithms,” Inform : Jurnal Ilmiah Bidang Teknologi Informasi dan Komunikasi, vol. 9, no. 1, pp. 75–80, Feb. 2024, doi: 10.25139/inform.v9i1.7592.
[25] A. S. Rizkia, W. Wufron, and F. F. Roji, “Analisis Sentimen Coretax: Perbandingan Pelabelan Data Manual, Transformers-Based, dan Lexicon-Based pada Performa IndoBERT,” MALCOM: Indonesian Journal of Machine Learning and Computer Science, vol. 5, no. 3, Jul. 2025, doi: 10.57152/malcom.v5i3.2151.
[26] A. Rachmadana Ismail, R. Bagus, F. Hakim, and R. Artikel, “Implementasi Lexicon Based Untuk Analisis Sentimen Dalam Mengetahui Trend Wisata Pantai Di DI Yogyakarta Berdasarkan Data Twitter P-ISSN E-ISSN,” 2023.
[27] M. Theofany, A. Anwar, S. Hadi Wijoyo, W. Hayuhardhika, N. Putra, and P. Korespondensi, “Implementasi Metode Textrank Dan Named Entity Recognition Untuk Ekstraksi Kata Kunci Pada Media Online Berita,” 2024.
[28] M. Theofany, A. Anwar, S. Hadi Wijoyo, W. Hayuhardhika, N. Putra, and P. Korespondensi, “Implementasi Metode Textrank Dan Named Entity Recognition Untuk Ekstraksi Kata Kunci Pada Media Online Berita,” 2024.
[29] M. A. Yamin, K. Kusnadi, and L. Bayuaji, “Optimasi Algoritma Support Vector Machine (SVM) Dengan Menggunakan Feature Selection Gain Ratio Untuk Analisis Sentimen,” INOVTEK Polbeng - Seri Informatika, vol. 9, no. 1, pp. 326–340, 2024, doi: 10.35314/isi.v9i1.4197.
[30] S. Dyah Anggita and F. F. Abdulloh, “Optimasi Algoritma Support Vector Machine Berbasis PSO Dan Seleksi Fitur Information Gain Pada Analisis Sentimen,” JOURNAL OF APPLIED COMPUTER SCIENCE AND TECHNOLOGY (JACOST), vol. 4, no. 1, pp. 2723–1453, 2023, doi: 10.52158/jacost.524.
[31] M. M. Siregar, R. Hizria, and D. Pardede, “Perbandingan Kinerja Kernel SVM dalam Klasifikasi Kategori Kanker Kulit Menggunakan Transfer Learning,” Data Sciences Indonesia (DSI), vol. 4, no. 1, pp. 83–90, Sep. 2024, doi: 10.47709/dsi.v4i1.4665.
[32] E. Septiana Pane, C. Caroline, B. Diklat Industri Surabaya, and J. Gayung Kebonsari Dalam, “Optimalisasi Evaluasi Pelaksanaan Pelatihan Melalui Analisis Sentimen Otomatis Dengan Model Text Classification.”
[33] P. Ayuningtyas and S. Khomsah, “Pelabelan Sentimen Berbasis Semi-Supervised Learning menggunakan Algoritma LSTM dan GRU,” 2024.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish with this journal agree to the following terms:
(1)Â Copyright of the published articles will be transferred to the journal as the publisher of the manuscripts. Therefore, the author confirms that the copyright has been managed by the journal.
(2) Publisher of JTMI: Jurnal Teknologi dan Manajemen Informatika is University of Merdeka Malang.
(3) The copyright follows Creative Commons Attribution–ShareAlike License (CC BY SA): This license allows to Share — copy and redistribute the material in any medium or format, Adapt — remix, transform, and build upon the material, for any purpose, even commercially.
