Sentiment Analysis of WhatsApp User Reviews as Information Evaluation for Digital Services
Main Article Content
Abstract
This study examines user reviews of the WhatsApp application as digital information objects that reflect user perceptions of digital information service quality. The rapid growth of communication platforms has generated large volumes of user-generated content, which requires systematic analysis and functions as a form of digital documentation. This research aims to evaluate how machine learning and deep learning approaches can support information evaluation through sentiment analysis of user reviews. A publicly available dataset of WhatsApp user reviews obtained from Kaggle was used as the data source. The research methodology consisted of text preprocessing, feature representation, sentiment classification, and performance evaluation. Support Vector Machine (SVM) was employed as a baseline machine learning method, while Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN) models represented deep learning approaches. The experimental results show that deep learning models outperform the traditional approach, with CNN achieving the best performance across accuracy, precision, recall, and F1-score metrics. These findings indicate that deep learning-based sentiment analysis is effective in transforming large-scale user reviews into actionable information for evaluating digital information services. This study contributes to documentation and information science by demonstrating the role of artificial intelligence in analyzing user-generated digital documentation to support evidence-based decision-making in digital service development.
Downloads
Article Details

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
References
Achmad Saefuloh. (2025). Transformasi Media Komunikasi Dalam Menyebarkan Informasi Secara Efektif Di Era Digitalisasi Global. Journal Central Publisher, 1(12 SE-Artikel), 1404–1408. https://doi.org/10.60145/jcp.v1i12.317
Adawiyyah, V. R., Reffiansyah, N. A., & Anbiya, B. F. (2024). Teknologi Pembelajaran: Peran WhatsApp dalam Interaksi Pendidik dan Peserta Didik. Jurnal Edukasi, 2(2), 84–98. https://doi.org/10.60132/edu.v2i2.271
Agustin Fitriana, Lady, Sugiyarto, I., & Faddillah, U. (2026). Penerapan Model LSTM dan CNN Untuk Klasifikasi Sentimen Pada Ulasan Aplikasi Roblox. Infotek: Jurnal Informatika Dan Teknologi, 9(1 SE-Articles), 71–82. https://doi.org/10.29408/jit.v9i1.32848
Ahmad, S., Ridwan, A. M., & Setiawan, G. D. (2023). Analisis Sentimen Product Tools & Home Menggunakan Metode CNN Dan LSTM. Jurnal Teknologi Dan Rekayasa Sistem Komputer, 6(2), 133–140. https://doi.org/10.31943/teknokom.v6i2.154
Ahmar, A. S., Kurniasih, N., Irawan, D. E., Sutiksno, D. U., Napitupulu, D., Setiawan, M. I., Simarmata, J., Hidayat, R., Busro, Abdullah, D., Rahim, R., & Abraham, J. (2018). Lecturers’ Understanding on Indexing Databases of SINTA, DOAJ, Google Scholar, SCOPUS, and Web of Science: A Study of Indonesians. Journal of Physics: Conference Series, 954(1), 12026. https://doi.org/10.1088/1742-6596/954/1/012026
Ahmed, Z. H., Hameed, A. S., Mutar, M. L., Alrifaie, M. F., & Taresh, M. M. (2021). Experimental Study of Hybrid Genetic Algorithms for the Maximum Scatter Travelling Salesman Problem. International Journal of Advanced Computer Science and Applications(IJACSA), 12(8), 471–482. https://doi.org/10.14569/IJACSA.2021.0120855
Alaei, A. R., Becken, S., & Stantic, B. (2019). Sentiment analysis in tourism: capitalizing on big data. Journal of Travel Research, 58(2), 175–191. https://doi.org/10.1177/0047287517747753
Alam, M. S., Mrida, M. S. H., & Rahman, M. A. (2025). Sentiment Analysis In Social Media: How Data Science Impacts Public Opinion Knowledge Integrates Natural Language Processing (Nlp) With Artificial Intelligence (AI). American Journal of Scholarly Research and Innovation, 4(1), 63–100. https://doi.org/10.63125/r3sq6p80
Ali, N. M., Mostafa, M., El, A., & Youssif, A. (2019). Sentiment Analysis For Movies Reviews Dataset Using Deep Learning Models. International Journal of Data Mining & Knowledge Management Process (IJDKP), 9(2), 19–27. https://doi.org/10.5121/ijdkp.2019.9302
Amaliadanti, A. (2024). Mobile Apps WhatsApp Sebagai Media Komunikasi dan Informasi: Studi Literatur Sistematik. CoverAge: Journal of Strategic Communication, 15(1 SE-Articles), 35–57. https://doi.org/10.35814/coverage.v15i1.6238
Aminudin, N., Wantoro, A., & Saptasari, D. (2026). Sentiment Analysis of WhatsApp User Reviews as Information Evaluation for Digital Services. Zenodo. https://doi.org/10.5281/zenodo.19396605
Amiraslani, F., & Dragovich, D. (2022). A Review of Documentation: A Cross-Disciplinary Perspective. In World (Vol. 3, Issue 1, pp. 126–145). https://doi.org/10.3390/world3010007
Ariono, G. P. R., & Alrasyid, W. (2025). Ai-based sentiment analysis of social media to detect public opinion on government policies. Journal Basic Science and Technology, 14(2), 61–68.
Asri, Y., Kuswardani, D., Suliyanti, W. N., & Manullang, Y. O. (2025). Sentiment analysis based on Indonesian language lexicon and IndoBERT on user reviews PLN mobile application. Indonesian Journal of Electrical Engineering and Computer Science (IJEECS), 38(1), 677–688. https://doi.org/10.11591/ijeecs.v38.i1.pp677-688
Baj-rogowska, A. (2019). Do online reviews reveal mobile application usability and user experience? The case of WhatsApp. Federated Conference on Computer Science and Information Systems, 18, 747–754. https://doi.org/10.15439/2019F289
Bajaj, A., Sharma, T., & Sangwan, O. P. (2020). Information retrieval in conjunction with deep learning. In Handbook of research on emerging trends and applications of machine learning (pp. 300–311). IGI Global Scientific Publishing. https://doi.org/10.4018/978-1-5225-9643-1.ch014
Bezirci, P., & Biçen Aras, B. (2022). COVID-19 ve Üniversite Kütüphanelerinin Twitter Kullanımı TT - COVID-19 and University Libraries' Use of Twitter. Kütüphane Arşiv ve Müze Araştırmaları Dergisi, 3(1), 1–26. https://doi.org/10.29228/lamre.55065
Burzykowski, T., Geubbelmans, M., Rousseau, A.-J., & Valkenborg, D. (2023). Validation of machine learning algorithms. American Journal of Orthodontics and Dentofacial Orthopedics, 164(2), 295–297. https://doi.org/10.1016/j.ajodo.2023.05.007
Byun, H., Chiu, W., & Won, D. (2023). The Voice from Users of Running Applications: An Analysis of Online Reviews Using Leximancer. In Journal of Theoretical and Applied Electronic Commerce Research (Vol. 18, Issue 1, pp. 173–186). https://doi.org/10.3390/jtaer18010010
Cahyani, R. D., & Prasetyaningrum, P. T. (2026). Sentiment Analysis of User Reviews for AI Applications: Evaluating SVM, Logistic Regression, and Random Forest. Journal of Information Systems and Informatics, 8(1), 1–27. https://doi.org/10.63158/journalisi.v8i1.1366
Chai, C. P. (2023). Comparison of text preprocessing methods. Natural Language Engineering, 29(3), 509–553. https://doi.org/10.1017/S1351324922000213
Chaputula, A. H., Abdullah, H., & Mwale, B. (2020). Proliferation of social media in academic libraries: use of WhatsApp as a platform for providing library services. Library Management, 41(8–9), 717–729. https://doi.org/10.1108/LM-04-2020-0075
Chen, B. (2021). Sentiment Analysis From Machine Learning to Deep Learning. 2021 International Conference on Electronic Information Engineering and Computer Science (EIECS), 724–728. https://doi.org/10.1109/EIECS53707.2021.9587971
Dankolo, N., Ahmad Aliero, A., Sulaimon Adebayo, B., Olanrewaju Aliyu, H., Gogo Tafida, A., & Umar Kangiwa, B. (2023). Systematic Review on Text Normalization Techniques and its Approach to Non-Standard Words [Internet]. Vol. 185. International Journal of Computer Applications. https://doi.org/10.5120/ijca2023923106
Didi, Y., Walha, A., & Wali, A. (2022). COVID-19 Tweets Classification Based on a Hybrid Word Embedding Method. In Big Data and Cognitive Computing (Vol. 6, Issue 2, p. 58). https://doi.org/10.3390/bdcc6020058
Dwijaya, A., & Laksito, A. (2023). Sentiment Analysis of Pedulilindungi Application Reviews Using Machine Learning and Deep Learning. Jurnal Riset Informatika, 5, 187–194. https://doi.org/10.34288/jri.v5i2.505
Fanani, M. I. (2023). Tren Publikasi Jurnal Bidang Ilmu Perpustakaan dan Informasi Terindeks Sinta. Jurnal Perpustakaan Dan Informasi, 17(1), 108–129. https://doi.org/10.30829/iqra.v17i1.14540
Faridan, R., & Lawanda, I. I. (2024). Tren Penelitian Layanan Perpustakaan Melalui Pemanfaatan Repositori Institusi dengan Analisis Bibliometrik Berbasis Data Scopus. Media Informasi, 33(1 SE-Articles). https://doi.org/10.22146/mi.v33i1.13195
Fitroh, F., & Hudaya, F. (2023). Systematic Literature Review: Analisis Sentimen Berbasis Deep Learning. Jurnal Nasional Teknologi Dan Sistem Informasi, 9(2 SE-), 132–140. https://doi.org/10.25077/TEKNOSI.v9i2.2023.132-140
Handoko, H., Asrofiq, A., Junadhi, J., & Negara, A. S. (2024). Sentiment Analysis of Sirekap Tweets Using CNN Algorithm. INTENSIF: Jurnal Ilmiah Penelitian Dan Penerapan Teknologi Sistem Informasi, 8(2 SE-Article), 312–329. https://doi.org/10.29407/intensif.v8i2.23046
Harahap, N. H., Azzura, P. R., Yasmin, R., Ikram, R., Alfarisi, R., Maghfira, W. A., & Hsb, Z. L. S. (2025). Analisis Isi Pesan Komunikasi Interpersonal dalam Percakapan Digital Melalui Aplikasi WhatsApp Sebagai Bentuk Interaksi Sosial Modern. Fatih: Journal of Contemporary Research, 2(1), 433–444. https://doi.org/10.61253/dkjptn18
Hasanah, N., & Rachman, M. A. (2021). Trend of Library and Information Science Research on Library and Information Science Journals in Indonesia ( 2013-2019 ). Webology, 18(1), 233–246. https://doi.org/10.14704/WEB/V18I1/WEB18086
He, G., Xue, Z., Jiang, Z., Kang, Y., Zhao, S., & Lu, W. (2023). H2CGL: Modeling dynamics of citation network for impact prediction. Information Processing & Management, 60(6), 103512. https://doi.org/10.1016/j.ipm.2023.103512
Ilfa Minatika, R. A. (2025). Implementation of the Term Frequency-Inverse Document Frequency Method for Mental Health Classification Using Algorithm Support Vector Machine. Recursive Journal of Informatics, 3(2 SE-Articles), 93–98. https://doi.org/10.15294/rji.v3i2.1921
Irfan, L., Hussain, S., Ayoub, M., Yu, Y., & Khan, A. (2022). A Comparative Analysis of Social Communication Applications using Aspect Based Sentiment Analysis. Pakistan Journal of Engineering and Technology, 5(3 SE-Research Articles), 44–50. https://doi.org/10.51846/vol5iss3pp44-50
Juliana, S. A., Liza, T., Fatimahtuzzahra, F., & Hilmi Imel, M. A. (2023). Tantangan Sosial Di Era Digital Pada Interaksi Manusia. SIGNIFICANT : Journal Of Research And Multidisciplinary, 2(02 SE-), 245–261. https://doi.org/10.62668/significant.v2i02.912
Kamkarhaghighi, M., Gultepe, E., & Makrehchi, M. (2019). Deep learning for document representation. Handbook of Deep Learning Applications, 101–110. https://doi.org/10.1007/978-3-030-11479-4_5
Khader, M., & Zarzour, H. (2025). Enhancing Sentiment Analysis via Advanced Deep Learning Techniques. 2025 7th International Conference on Pattern Analysis and Intelligent Systems (PAIS), 1–6. https://doi.org/10.1109/PAIS66004.2025.11126468
Kharisudin, I., & Masri, H. (2022). Topic Modeling on WhatsApp User Reviews Using Latent Dirichlet Allocation. Scientific Journal of Informatics, 9(1), 51–62. https://doi.org/10.15294/sji.v9i1.34941
Kozlowski, D., Dusdal, J., Pang, J., & Zilian, A. (2021). Semantic and relational spaces in science of science: Deep learning models for article vectorisation. Scientometrics, 126(7), 5881–5910. https://doi.org/10.1007/s11192-021-03984-1
Kumar, A., & Garg, G. (2020). The multifaceted concept of context in sentiment analysis. In Cognitive Informatics and Soft Computing: Proceeding of CISC 2019 (pp. 413–421). Springer. https://doi.org/10.1007/978-981-15-1451-7_44
Kumar, A., Supra, G. S., Thakur, S., & Kaur, N. (2025). Navigating the Pitfalls of Current Methods and Challenges in Sentiment Analysis: Progress and Open Directions. Journal of Interdisciplinary Knowledge, 8, e01636–e01636. https://doi.org/10.37497/jik.v8iknowledge.1636
Ligthart, A., Catal, C., & Tekinerdogan, B. (2021). Systematic reviews in sentiment analysis: a tertiary study. Artificial Intelligence Review, 54(7), 4997–5053. https://doi.org/10.1007/s10462-021-09973-3
Malavade, V., & Sureshkumar, B. (2023). Comparative Analysis of Artificial Intelligence Techniques for Sentiment Analysis and its Challenges. 2023 7th International Conference on Intelligent Computing and Control Systems (ICICCS), 670–675. https://doi.org/10.1109/ICICCS56967.2023.10142264
Mauritsius, T., Saputra, A. R., Kafiar, A. L., Monica, G. G., Retnowardhani, A., & Miranda, E. (2026). Improving Sentiment Classification of Product Reviews in Bahasa Indonesia Using Kernel-Based SVM. 2026 International Seminar on Intelligent Business and Edge-Computing Research (ISIBER), 728–733. https://doi.org/10.1109/ISIBER68248.2026.11470559
More, K., Sapkal, S., Selote, A., Sarda, V., Sawant, A., & Shadab, H. (2025). SVM–Powered Sentiment Analysis for E-Commerce Reviews. 2025 IEEE 17th International Conference on Computational Intelligence and Communication Networks (CICN), 2106–2111. https://doi.org/10.1109/CICN67655.2025.11368294
Nafis, N. S. M., & Awang, S. (2021). An Enhanced Hybrid Feature Selection Technique Using Term Frequency-Inverse Document Frequency and Support Vector Machine-Recursive Feature Elimination for Sentiment Classification. IEEE Access, 9, 52177–52192. https://doi.org/10.1109/ACCESS.2021.3069001
Nayoan, R. A. N., Hidayatullah, A. F., & Fudholi, D. H. (2021). Convolutional Neural Networks for Indonesian Aspect-Based Sentiment Analysis Tourism Review. 2021 9th International Conference on Information and Communication Technology (ICoICT), 60–65. https://doi.org/10.1109/ICoICT52021.2021.9527518
Nguyen, B. X., Luczak-Roesch, M., Dinneen, J. D., & Larivière, V. (2022). Assessing the quality of bibliographic data sources for measuring international research collaboration. Quantitative Science Studies, 3(3), 529–559. https://doi.org/10.1162/qss_a_00211
Noori, M. T., Rahman, M. A., & Purnomo, A. (2025). Sentiment Analysis of the Israel-Palestine Conflict on X : Insights from the Indonesian Perspective using a Long Short-Term Memory Algorithm. Journal of Informatics and Web Engineering, 4(2), 417–429. https://doi.org/10.33093/jiwe.2025.4.2.27
Pardede, A. M., Mustafid, M., & Sugito, S. (2025). Implementasi Metode Convolutional Neural Network Untuk Klasifikasi Sentimen Ulasan Pengguna Aplikasi Mypertamina. Jurnal Gaussian, 14(2), 345–355. https://doi.org/10.14710/j.gauss.14.2.345-355
Pavlick, E. (2022). Semantic structure in deep learning. Annual Review of Linguistics, 8, 447–471. https://doi.org/10.1146/annurev-linguistics-031120-122924
Peng, J., & Li, Y. (2025). Frontiers of Artificial Intelligence for Personalized Learning in Higher Education: A Systematic Review of Leading Articles. In Applied Sciences (Vol. 15, Issue 18, p. 10096). https://doi.org/10.3390/app151810096
Prastyo, P. H., Ardiyanto, I., & Hidayat, R. (2020). Indonesian Sentiment Analysis: An Experimental Study of Four Kernel Functions on SVM Algorithm with TF-IDF. 2020 International Conference on Data Analytics for Business and Industry: Way Towards a Sustainable Economy (ICDABI), 1–6. https://doi.org/10.1109/ICDABI51230.2020.9325685
Quddus, Z. A., & Sabarina, G. (2022). Analisis Biblometrik Terhadap Jurnal Bidang Perpustakaan dan Informasi di Indonesia Terindeks SCOPUS Tahun 2015-2019. Global Komunika: Jurnal Ilmu Sosial Dan Ilmu Politik, 5(2), 74–85. https://doi.org/10.33822/gk.v5i2.5543
Radyuli, P., Sefriani, R., & Fitria, L. (2023). Edukasi Menulis Artikel dan Updating Data Sinta Kemendikbud dalam Meningkatkan Kemampuan Menulis dan Publikasi pada Jurnal Terakreditasi. Jurnal Pustaka Mitra (Pusat Akses Kajian Mengabdi Terhadap Masyarakat), 3(2 SE-Artikel), 75–78. https://doi.org/10.55382/jurnalpustakamitra.v3i2.333
Rehman, S., Irtaza, A., Nawaz, M., & Kibriya, H. (2022). Text document classification using deep learning techniques. 2022 International Conference on Emerging Trends in Electrical, Control, and Telecommunication Engineering (ETECTE), 1–6. https://doi.org/10.1109/ETECTE55893.2022.10007316
Rifky, M., & Veri, J. (2024). Analisa Implementasi Teknologi Informasi Dalam Pengelolaan Ekonomi Digital: Tinjauan Systematic Literature Review. Journal of Economics and Business, 4(6), 2982–2991. https://doi.org/10.54373/ifijeb.v4i6.2309
Ryan, A. A., Arpita, H. D., Tabassum, A., Ahammad, M. S., & Akram, M. A. (2024). A Comparative Analysis Between Deep Learning and Machine Learning Algorithms Based on User Review Sentiment Analysis from Various OTT Applications. 2024 International Conference on Computer, Electrical & Communication Engineering (ICCECE), 1–7. https://doi.org/10.1109/ICCECE58645.2024.10497229
Sandhi, M. I. I., Begum, M. A., Jadhav, R. J., Maroor, J. P., MD, A., & S, V. B. (2024). DeepSentiment: Unlocking Insights from Twitter Data with Advanced Deep Learning Analytics. 2024 4th International Conference on Ubiquitous Computing and Intelligent Information Systems (ICUIS), 966–969. https://doi.org/10.1109/ICUIS64676.2024.10867110
Sari, W. K., Rini, D. P., & Malik, R. F. (2019). Text Classification Using Long Short-Term Memory. 2019 International Conference on Electrical Engineering and Computer Science (ICECOS), 150–155. https://doi.org/10.1109/ICECOS47637.2019.8984558
Seo, S., Kim, C., Kim, H., Mo, K., & Kang, P. (2020). Comparative study of deep learning-based sentiment classification. IEEE Access, 8, 6861–6875. https://doi.org/10.1109/ACCESS.2019.2963426
Siregar, B. N., Sulistyanto, A., Harahap, H. S., Yasya, W., & Dwinarko, D. (2024). Research Trend of User-Generated Content in Tourism. Dinasti International Journal of Education Management And Social Science, 5(5 SE-Articles), 1362–1373. https://doi.org/10.38035/dijemss.v5i5.2797
Siroot, H. A., Purbolaksono, M. D., & Dewi, U. K. (2024). Sentiment Analysis of Raya Digital Bank Application Reviews Using the TF-IDF Method and Support Vector Machine. 2024 International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA), 308–313. https://doi.org/10.1109/ICICYTA64807.2024.10913051
Stephen, G. (2021). Chat Metric For Li(fe)brary at Home WhatsApp Forum with User Satisfaction of NIELIT – Itanagar Library, Arunachal Pradesh. Library Philosophy and Practice (e-Journal), January, 1–12. https://scholarworks.sjsu.edu/libphilprac/4818/
Sujana, Y. (2023). A Comparative Study of Machine Learning Models for Sentiment Analysis of Dana App Reviews. Indonesian Journal of Informatics Education, 7(2), 160–166. https://doi.org/10.20961/ijie.v7i2.93132
Taherdoost, H., & Madanchian, M. (2023). Artificial intelligence and sentiment analysis: A review in competitive research. Computers, 12 (2), 37. Publisher Full Text. https://doi.org/10.3390/computers12020037
Tanwar, N. (2026). Sentiment Analysis for Product Review using Hybrid CNN-LSTM Model. International Scientific Journal of Engineering and Management, 04(10), 1–34. https://doi.org/10.55041/ISJEM05062
Tao, D. (2020). How deep learning works for information retrieval. Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 5. https://doi.org/10.1145/3397271.3402429
Wąsowicz-Zaborek, E. (2023). Mapping Research on User-Generated Content in the Service Sector — A Bibliometric Analysis. Marketing of Scientific and Research Organizations, 49(3), 65–100. https://doi.org/10.2478/minib-2023-0016
Yaman, A., Yoganingrum, A., & Riyanto, S. (2019). Tinjauan Pustaka Sistematis Pada Basis Data Pustaka Digital: Tren Riset, Metodologi, Dan Coverage Fields. Baca: Jurnal Dokumentasi Dan Informasi, 9008(21), 1–20. https://doi.org/10.14203/j.baca.v40i1.481
Yuliska, Y., Qudsi, D. hidayatul, Lubis, J. H., Syaliman, K. U., & Najwa, N. fadilah. (2021). Analisis Sentimen pada Data Saran Mahasiswa Terhadap Kinerja Departemen di Perguruan Tinggi Menggunakan Convolutional Neural Network. Jurnal Teknologi Informasi dan Ilmu Komputer, 8(5 SE-Ilmu Komputer), 1067–1076. https://doi.org/https://doi.org/10.25126/jtiik.2021854842