Sentiment Analysis of WhatsApp User Reviews as Information Evaluation for Digital Services

Main Article Content

Nur Aminudin
Agus Wantoro
Dita Septasari

Abstract

This study examines user reviews of the WhatsApp application as digital information objects that reflect user perceptions of digital information service quality. The rapid growth of communication platforms has generated large volumes of user-generated content, which requires systematic analysis and functions as a form of digital documentation. This research aims to evaluate how machine learning and deep learning approaches can support information evaluation through sentiment analysis of user reviews. A publicly available dataset of WhatsApp user reviews obtained from Kaggle was used as the data source. The research methodology consisted of text preprocessing, feature representation, sentiment classification, and performance evaluation. Support Vector Machine (SVM) was employed as a baseline machine learning method, while Long Short-Term Memory (LSTM) and Convolutional Neural Network (CNN) models represented deep learning approaches. The experimental results show that deep learning models outperform the traditional approach, with CNN achieving the best performance across accuracy, precision, recall, and F1-score metrics. These findings indicate that deep learning-based sentiment analysis is effective in transforming large-scale user reviews into actionable information for evaluating digital information services. This study contributes to documentation and information science by demonstrating the role of artificial intelligence in analyzing user-generated digital documentation to support evidence-based decision-making in digital service development.

Downloads

Download data is not yet available.

Article Details

How to Cite
Aminudin, N., Wantoro, A., & Septasari, D. (2026). Sentiment Analysis of WhatsApp User Reviews as Information Evaluation for Digital Services. BACA: Jurnal Dokumentasi Dan Informasi, 47(1), 53–71. Retrieved from https://ejournal.brin.go.id/baca/article/view/14917
Section
Articles

References

Achmad Saefuloh. (2025). Transformasi Media Komunikasi Dalam Menyebarkan Informasi Secara Efektif Di Era Digitalisasi Global. Journal Central Publisher, 1(12 SE-Artikel), 1404–1408. https://doi.org/10.60145/jcp.v1i12.317

Adawiyyah, V. R., Reffiansyah, N. A., & Anbiya, B. F. (2024). Teknologi Pembelajaran: Peran WhatsApp dalam Interaksi Pendidik dan Peserta Didik. Jurnal Edukasi, 2(2), 84–98. https://doi.org/10.60132/edu.v2i2.271

Agustin Fitriana, Lady, Sugiyarto, I., & Faddillah, U. (2026). Penerapan Model LSTM dan CNN Untuk Klasifikasi Sentimen Pada Ulasan Aplikasi Roblox. Infotek: Jurnal Informatika Dan Teknologi, 9(1 SE-Articles), 71–82. https://doi.org/10.29408/jit.v9i1.32848

Ahmad, S., Ridwan, A. M., & Setiawan, G. D. (2023). Analisis Sentimen Product Tools & Home Menggunakan Metode CNN Dan LSTM. Jurnal Teknologi Dan Rekayasa Sistem Komputer, 6(2), 133–140. https://doi.org/10.31943/teknokom.v6i2.154

Ahmar, A. S., Kurniasih, N., Irawan, D. E., Sutiksno, D. U., Napitupulu, D., Setiawan, M. I., Simarmata, J., Hidayat, R., Busro, Abdullah, D., Rahim, R., & Abraham, J. (2018). Lecturers’ Understanding on Indexing Databases of SINTA, DOAJ, Google Scholar, SCOPUS, and Web of Science: A Study of Indonesians. Journal of Physics: Conference Series, 954(1), 12026. https://doi.org/10.1088/1742-6596/954/1/012026

Ahmed, Z. H., Hameed, A. S., Mutar, M. L., Alrifaie, M. F., & Taresh, M. M. (2021). Experimental Study of Hybrid Genetic Algorithms for the Maximum Scatter Travelling Salesman Problem. International Journal of Advanced Computer Science and Applications(IJACSA), 12(8), 471–482. https://doi.org/10.14569/IJACSA.2021.0120855

Alaei, A. R., Becken, S., & Stantic, B. (2019). Sentiment analysis in tourism: capitalizing on big data. Journal of Travel Research, 58(2), 175–191. https://doi.org/10.1177/0047287517747753

Alam, M. S., Mrida, M. S. H., & Rahman, M. A. (2025). Sentiment Analysis In Social Media: How Data Science Impacts Public Opinion Knowledge Integrates Natural Language Processing (Nlp) With Artificial Intelligence (AI). American Journal of Scholarly Research and Innovation, 4(1), 63–100. https://doi.org/10.63125/r3sq6p80

Ali, N. M., Mostafa, M., El, A., & Youssif, A. (2019). Sentiment Analysis For Movies Reviews Dataset Using Deep Learning Models. International Journal of Data Mining & Knowledge Management Process (IJDKP), 9(2), 19–27. https://doi.org/10.5121/ijdkp.2019.9302

Amaliadanti, A. (2024). Mobile Apps WhatsApp Sebagai Media Komunikasi dan Informasi: Studi Literatur Sistematik. CoverAge: Journal of Strategic Communication, 15(1 SE-Articles), 35–57. https://doi.org/10.35814/coverage.v15i1.6238

Aminudin, N., Wantoro, A., & Saptasari, D. (2026). Sentiment Analysis of WhatsApp User Reviews as Information Evaluation for Digital Services. Zenodo. https://doi.org/10.5281/zenodo.19396605

Amiraslani, F., & Dragovich, D. (2022). A Review of Documentation: A Cross-Disciplinary Perspective. In World (Vol. 3, Issue 1, pp. 126–145). https://doi.org/10.3390/world3010007

Ariono, G. P. R., & Alrasyid, W. (2025). Ai-based sentiment analysis of social media to detect public opinion on government policies. Journal Basic Science and Technology, 14(2), 61–68.

Asri, Y., Kuswardani, D., Suliyanti, W. N., & Manullang, Y. O. (2025). Sentiment analysis based on Indonesian language lexicon and IndoBERT on user reviews PLN mobile application. Indonesian Journal of Electrical Engineering and Computer Science (IJEECS), 38(1), 677–688. https://doi.org/10.11591/ijeecs.v38.i1.pp677-688

Baj-rogowska, A. (2019). Do online reviews reveal mobile application usability and user experience? The case of WhatsApp. Federated Conference on Computer Science and Information Systems, 18, 747–754. https://doi.org/10.15439/2019F289

Bajaj, A., Sharma, T., & Sangwan, O. P. (2020). Information retrieval in conjunction with deep learning. In Handbook of research on emerging trends and applications of machine learning (pp. 300–311). IGI Global Scientific Publishing. https://doi.org/10.4018/978-1-5225-9643-1.ch014

Bezirci, P., & Biçen Aras, B. (2022). COVID-19 ve Üniversite Kütüphanelerinin Twitter Kullanımı TT - COVID-19 and University Libraries' Use of Twitter. Kütüphane Arşiv ve Müze Araştırmaları Dergisi, 3(1), 1–26. https://doi.org/10.29228/lamre.55065

Burzykowski, T., Geubbelmans, M., Rousseau, A.-J., & Valkenborg, D. (2023). Validation of machine learning algorithms. American Journal of Orthodontics and Dentofacial Orthopedics, 164(2), 295–297. https://doi.org/10.1016/j.ajodo.2023.05.007

Byun, H., Chiu, W., & Won, D. (2023). The Voice from Users of Running Applications: An Analysis of Online Reviews Using Leximancer. In Journal of Theoretical and Applied Electronic Commerce Research (Vol. 18, Issue 1, pp. 173–186). https://doi.org/10.3390/jtaer18010010

Cahyani, R. D., & Prasetyaningrum, P. T. (2026). Sentiment Analysis of User Reviews for AI Applications: Evaluating SVM, Logistic Regression, and Random Forest. Journal of Information Systems and Informatics, 8(1), 1–27. https://doi.org/10.63158/journalisi.v8i1.1366

Chai, C. P. (2023). Comparison of text preprocessing methods. Natural Language Engineering, 29(3), 509–553. https://doi.org/10.1017/S1351324922000213

Chaputula, A. H., Abdullah, H., & Mwale, B. (2020). Proliferation of social media in academic libraries: use of WhatsApp as a platform for providing library services. Library Management, 41(8–9), 717–729. https://doi.org/10.1108/LM-04-2020-0075

Chen, B. (2021). Sentiment Analysis From Machine Learning to Deep Learning. 2021 International Conference on Electronic Information Engineering and Computer Science (EIECS), 724–728. https://doi.org/10.1109/EIECS53707.2021.9587971

Dankolo, N., Ahmad Aliero, A., Sulaimon Adebayo, B., Olanrewaju Aliyu, H., Gogo Tafida, A., & Umar Kangiwa, B. (2023). Systematic Review on Text Normalization Techniques and its Approach to Non-Standard Words [Internet]. Vol. 185. International Journal of Computer Applications. https://doi.org/10.5120/ijca2023923106

Didi, Y., Walha, A., & Wali, A. (2022). COVID-19 Tweets Classification Based on a Hybrid Word Embedding Method. In Big Data and Cognitive Computing (Vol. 6, Issue 2, p. 58). https://doi.org/10.3390/bdcc6020058

Dwijaya, A., & Laksito, A. (2023). Sentiment Analysis of Pedulilindungi Application Reviews Using Machine Learning and Deep Learning. Jurnal Riset Informatika, 5, 187–194. https://doi.org/10.34288/jri.v5i2.505

Fanani, M. I. (2023). Tren Publikasi Jurnal Bidang Ilmu Perpustakaan dan Informasi Terindeks Sinta. Jurnal Perpustakaan Dan Informasi, 17(1), 108–129. https://doi.org/10.30829/iqra.v17i1.14540

Faridan, R., & Lawanda, I. I. (2024). Tren Penelitian Layanan Perpustakaan Melalui Pemanfaatan Repositori Institusi dengan Analisis Bibliometrik Berbasis Data Scopus. Media Informasi, 33(1 SE-Articles). https://doi.org/10.22146/mi.v33i1.13195

Fitroh, F., & Hudaya, F. (2023). Systematic Literature Review: Analisis Sentimen Berbasis Deep Learning. Jurnal Nasional Teknologi Dan Sistem Informasi, 9(2 SE-), 132–140. https://doi.org/10.25077/TEKNOSI.v9i2.2023.132-140

Handoko, H., Asrofiq, A., Junadhi, J., & Negara, A. S. (2024). Sentiment Analysis of Sirekap Tweets Using CNN Algorithm. INTENSIF: Jurnal Ilmiah Penelitian Dan Penerapan Teknologi Sistem Informasi, 8(2 SE-Article), 312–329. https://doi.org/10.29407/intensif.v8i2.23046

Harahap, N. H., Azzura, P. R., Yasmin, R., Ikram, R., Alfarisi, R., Maghfira, W. A., & Hsb, Z. L. S. (2025). Analisis Isi Pesan Komunikasi Interpersonal dalam Percakapan Digital Melalui Aplikasi WhatsApp Sebagai Bentuk Interaksi Sosial Modern. Fatih: Journal of Contemporary Research, 2(1), 433–444. https://doi.org/10.61253/dkjptn18

Hasanah, N., & Rachman, M. A. (2021). Trend of Library and Information Science Research on Library and Information Science Journals in Indonesia ( 2013-2019 ). Webology, 18(1), 233–246. https://doi.org/10.14704/WEB/V18I1/WEB18086

He, G., Xue, Z., Jiang, Z., Kang, Y., Zhao, S., & Lu, W. (2023). H2CGL: Modeling dynamics of citation network for impact prediction. Information Processing & Management, 60(6), 103512. https://doi.org/10.1016/j.ipm.2023.103512

Ilfa Minatika, R. A. (2025). Implementation of the Term Frequency-Inverse Document Frequency Method for Mental Health Classification Using Algorithm Support Vector Machine. Recursive Journal of Informatics, 3(2 SE-Articles), 93–98. https://doi.org/10.15294/rji.v3i2.1921

Irfan, L., Hussain, S., Ayoub, M., Yu, Y., & Khan, A. (2022). A Comparative Analysis of Social Communication Applications using Aspect Based Sentiment Analysis. Pakistan Journal of Engineering and Technology, 5(3 SE-Research Articles), 44–50. https://doi.org/10.51846/vol5iss3pp44-50

Juliana, S. A., Liza, T., Fatimahtuzzahra, F., & Hilmi Imel, M. A. (2023). Tantangan Sosial Di Era Digital Pada Interaksi Manusia. SIGNIFICANT : Journal Of Research And Multidisciplinary, 2(02 SE-), 245–261. https://doi.org/10.62668/significant.v2i02.912

Kamkarhaghighi, M., Gultepe, E., & Makrehchi, M. (2019). Deep learning for document representation. Handbook of Deep Learning Applications, 101–110. https://doi.org/10.1007/978-3-030-11479-4_5

Khader, M., & Zarzour, H. (2025). Enhancing Sentiment Analysis via Advanced Deep Learning Techniques. 2025 7th International Conference on Pattern Analysis and Intelligent Systems (PAIS), 1–6. https://doi.org/10.1109/PAIS66004.2025.11126468

Kharisudin, I., & Masri, H. (2022). Topic Modeling on WhatsApp User Reviews Using Latent Dirichlet Allocation. Scientific Journal of Informatics, 9(1), 51–62. https://doi.org/10.15294/sji.v9i1.34941

Kozlowski, D., Dusdal, J., Pang, J., & Zilian, A. (2021). Semantic and relational spaces in science of science: Deep learning models for article vectorisation. Scientometrics, 126(7), 5881–5910. https://doi.org/10.1007/s11192-021-03984-1

Kumar, A., & Garg, G. (2020). The multifaceted concept of context in sentiment analysis. In Cognitive Informatics and Soft Computing: Proceeding of CISC 2019 (pp. 413–421). Springer. https://doi.org/10.1007/978-981-15-1451-7_44

Kumar, A., Supra, G. S., Thakur, S., & Kaur, N. (2025). Navigating the Pitfalls of Current Methods and Challenges in Sentiment Analysis: Progress and Open Directions. Journal of Interdisciplinary Knowledge, 8, e01636–e01636. https://doi.org/10.37497/jik.v8iknowledge.1636

Ligthart, A., Catal, C., & Tekinerdogan, B. (2021). Systematic reviews in sentiment analysis: a tertiary study. Artificial Intelligence Review, 54(7), 4997–5053. https://doi.org/10.1007/s10462-021-09973-3

Malavade, V., & Sureshkumar, B. (2023). Comparative Analysis of Artificial Intelligence Techniques for Sentiment Analysis and its Challenges. 2023 7th International Conference on Intelligent Computing and Control Systems (ICICCS), 670–675. https://doi.org/10.1109/ICICCS56967.2023.10142264

Mauritsius, T., Saputra, A. R., Kafiar, A. L., Monica, G. G., Retnowardhani, A., & Miranda, E. (2026). Improving Sentiment Classification of Product Reviews in Bahasa Indonesia Using Kernel-Based SVM. 2026 International Seminar on Intelligent Business and Edge-Computing Research (ISIBER), 728–733. https://doi.org/10.1109/ISIBER68248.2026.11470559

More, K., Sapkal, S., Selote, A., Sarda, V., Sawant, A., & Shadab, H. (2025). SVM–Powered Sentiment Analysis for E-Commerce Reviews. 2025 IEEE 17th International Conference on Computational Intelligence and Communication Networks (CICN), 2106–2111. https://doi.org/10.1109/CICN67655.2025.11368294

Nafis, N. S. M., & Awang, S. (2021). An Enhanced Hybrid Feature Selection Technique Using Term Frequency-Inverse Document Frequency and Support Vector Machine-Recursive Feature Elimination for Sentiment Classification. IEEE Access, 9, 52177–52192. https://doi.org/10.1109/ACCESS.2021.3069001

Nayoan, R. A. N., Hidayatullah, A. F., & Fudholi, D. H. (2021). Convolutional Neural Networks for Indonesian Aspect-Based Sentiment Analysis Tourism Review. 2021 9th International Conference on Information and Communication Technology (ICoICT), 60–65. https://doi.org/10.1109/ICoICT52021.2021.9527518

Nguyen, B. X., Luczak-Roesch, M., Dinneen, J. D., & Larivière, V. (2022). Assessing the quality of bibliographic data sources for measuring international research collaboration. Quantitative Science Studies, 3(3), 529–559. https://doi.org/10.1162/qss_a_00211

Noori, M. T., Rahman, M. A., & Purnomo, A. (2025). Sentiment Analysis of the Israel-Palestine Conflict on X : Insights from the Indonesian Perspective using a Long Short-Term Memory Algorithm. Journal of Informatics and Web Engineering, 4(2), 417–429. https://doi.org/10.33093/jiwe.2025.4.2.27

Pardede, A. M., Mustafid, M., & Sugito, S. (2025). Implementasi Metode Convolutional Neural Network Untuk Klasifikasi Sentimen Ulasan Pengguna Aplikasi Mypertamina. Jurnal Gaussian, 14(2), 345–355. https://doi.org/10.14710/j.gauss.14.2.345-355

Pavlick, E. (2022). Semantic structure in deep learning. Annual Review of Linguistics, 8, 447–471. https://doi.org/10.1146/annurev-linguistics-031120-122924

Peng, J., & Li, Y. (2025). Frontiers of Artificial Intelligence for Personalized Learning in Higher Education: A Systematic Review of Leading Articles. In Applied Sciences (Vol. 15, Issue 18, p. 10096). https://doi.org/10.3390/app151810096

Prastyo, P. H., Ardiyanto, I., & Hidayat, R. (2020). Indonesian Sentiment Analysis: An Experimental Study of Four Kernel Functions on SVM Algorithm with TF-IDF. 2020 International Conference on Data Analytics for Business and Industry: Way Towards a Sustainable Economy (ICDABI), 1–6. https://doi.org/10.1109/ICDABI51230.2020.9325685

Quddus, Z. A., & Sabarina, G. (2022). Analisis Biblometrik Terhadap Jurnal Bidang Perpustakaan dan Informasi di Indonesia Terindeks SCOPUS Tahun 2015-2019. Global Komunika: Jurnal Ilmu Sosial Dan Ilmu Politik, 5(2), 74–85. https://doi.org/10.33822/gk.v5i2.5543

Radyuli, P., Sefriani, R., & Fitria, L. (2023). Edukasi Menulis Artikel dan Updating Data Sinta Kemendikbud dalam Meningkatkan Kemampuan Menulis dan Publikasi pada Jurnal Terakreditasi. Jurnal Pustaka Mitra (Pusat Akses Kajian Mengabdi Terhadap Masyarakat), 3(2 SE-Artikel), 75–78. https://doi.org/10.55382/jurnalpustakamitra.v3i2.333

Rehman, S., Irtaza, A., Nawaz, M., & Kibriya, H. (2022). Text document classification using deep learning techniques. 2022 International Conference on Emerging Trends in Electrical, Control, and Telecommunication Engineering (ETECTE), 1–6. https://doi.org/10.1109/ETECTE55893.2022.10007316

Rifky, M., & Veri, J. (2024). Analisa Implementasi Teknologi Informasi Dalam Pengelolaan Ekonomi Digital: Tinjauan Systematic Literature Review. Journal of Economics and Business, 4(6), 2982–2991. https://doi.org/10.54373/ifijeb.v4i6.2309

Ryan, A. A., Arpita, H. D., Tabassum, A., Ahammad, M. S., & Akram, M. A. (2024). A Comparative Analysis Between Deep Learning and Machine Learning Algorithms Based on User Review Sentiment Analysis from Various OTT Applications. 2024 International Conference on Computer, Electrical & Communication Engineering (ICCECE), 1–7. https://doi.org/10.1109/ICCECE58645.2024.10497229

Sandhi, M. I. I., Begum, M. A., Jadhav, R. J., Maroor, J. P., MD, A., & S, V. B. (2024). DeepSentiment: Unlocking Insights from Twitter Data with Advanced Deep Learning Analytics. 2024 4th International Conference on Ubiquitous Computing and Intelligent Information Systems (ICUIS), 966–969. https://doi.org/10.1109/ICUIS64676.2024.10867110

Sari, W. K., Rini, D. P., & Malik, R. F. (2019). Text Classification Using Long Short-Term Memory. 2019 International Conference on Electrical Engineering and Computer Science (ICECOS), 150–155. https://doi.org/10.1109/ICECOS47637.2019.8984558

Seo, S., Kim, C., Kim, H., Mo, K., & Kang, P. (2020). Comparative study of deep learning-based sentiment classification. IEEE Access, 8, 6861–6875. https://doi.org/10.1109/ACCESS.2019.2963426

Siregar, B. N., Sulistyanto, A., Harahap, H. S., Yasya, W., & Dwinarko, D. (2024). Research Trend of User-Generated Content in Tourism. Dinasti International Journal of Education Management And Social Science, 5(5 SE-Articles), 1362–1373. https://doi.org/10.38035/dijemss.v5i5.2797

Siroot, H. A., Purbolaksono, M. D., & Dewi, U. K. (2024). Sentiment Analysis of Raya Digital Bank Application Reviews Using the TF-IDF Method and Support Vector Machine. 2024 International Conference on Intelligent Cybernetics Technology & Applications (ICICyTA), 308–313. https://doi.org/10.1109/ICICYTA64807.2024.10913051

Stephen, G. (2021). Chat Metric For Li(fe)brary at Home WhatsApp Forum with User Satisfaction of NIELIT – Itanagar Library, Arunachal Pradesh. Library Philosophy and Practice (e-Journal), January, 1–12. https://scholarworks.sjsu.edu/libphilprac/4818/

Sujana, Y. (2023). A Comparative Study of Machine Learning Models for Sentiment Analysis of Dana App Reviews. Indonesian Journal of Informatics Education, 7(2), 160–166. https://doi.org/10.20961/ijie.v7i2.93132

Taherdoost, H., & Madanchian, M. (2023). Artificial intelligence and sentiment analysis: A review in competitive research. Computers, 12 (2), 37. Publisher Full Text. https://doi.org/10.3390/computers12020037

Tanwar, N. (2026). Sentiment Analysis for Product Review using Hybrid CNN-LSTM Model. International Scientific Journal of Engineering and Management, 04(10), 1–34. https://doi.org/10.55041/ISJEM05062

Tao, D. (2020). How deep learning works for information retrieval. Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, 5. https://doi.org/10.1145/3397271.3402429

Wąsowicz-Zaborek, E. (2023). Mapping Research on User-Generated Content in the Service Sector — A Bibliometric Analysis. Marketing of Scientific and Research Organizations, 49(3), 65–100. https://doi.org/10.2478/minib-2023-0016

Yaman, A., Yoganingrum, A., & Riyanto, S. (2019). Tinjauan Pustaka Sistematis Pada Basis Data Pustaka Digital: Tren Riset, Metodologi, Dan Coverage Fields. Baca: Jurnal Dokumentasi Dan Informasi, 9008(21), 1–20. https://doi.org/10.14203/j.baca.v40i1.481

Yuliska, Y., Qudsi, D. hidayatul, Lubis, J. H., Syaliman, K. U., & Najwa, N. fadilah. (2021). Analisis Sentimen pada Data Saran Mahasiswa Terhadap Kinerja Departemen di Perguruan Tinggi Menggunakan Convolutional Neural Network. Jurnal Teknologi Informasi dan Ilmu Komputer, 8(5 SE-Ilmu Komputer), 1067–1076. https://doi.org/https://doi.org/10.25126/jtiik.2021854842