Usability Sentiment Analysis Menggunakan Metode SUMI, NLP Scikit-Learn pada Aplikasi New Sakpole

Agus Aminudin; Kristophorus Hadiono; Kristiawan Nugroho

doi:10.30591/jpit.v9i2.5451

Usability Sentiment Analysis Menggunakan Metode SUMI, NLP Scikit-Learn pada Aplikasi New Sakpole

Agus Aminudin, Kristophorus Hadiono, Kristiawan Nugroho

Abstract

This research will discuss issues related to how to evaluate the usability and Sentiment Analysis aspects of the New Sakpole application system, how to determine the level of user satisfaction in using the New Sakpole mobile application and to determine sentiment analysis based on the results of analysis using the SUMI and NLP tools. The research objective is based on the formulation of existing problems to provide usability aspect values for the development of the New Sakpole mobile application and generate recommendations for improvement and determine the level of positive and negative sentiment analysis by using the New Sakpole Application as a medium for paying Motor Vehicle Tax. The test uses the Software Usability Measurement Inventory (SUMI) tool, the New Sakpole mobile application system, which is very helpful and can provide value to the community in the online vehicle tax payment process. This can be seen and obtained from a scale of helpfulness and efficiency resulting from a maximum score of 100 with an average score of 101 and 86.2. The results of the test using the SUMI tool, all average aspects get above average results, so the level of usability that occurs is that the use of New Sakpole has worked and is running well. The test uses Scikit-Learn Natural Language Processing (NLP) that the results of processing the review dataset on the New Sakpole Application from the Google Play Store with a total of 4704 reviews and a sampling of 500 reviews, that the response or reviews of the community using the New Sakpole application are negative even though for Acuracy word (words) that conveyed a review of 80.90%. From the results of the sample data test that index 0 is negative so that the words "good, very enlightening" can be concluded with Sentiment is 1 (POSITIVE)".

Keywords

Mobile, New Sakpole, Motor Vehicle Tax, SUMI, Usability, NLP

Full Text:

References

I. Aprilia et al., “Pengujian Usability Website Menggunakan System Usability Scale Website Usability Testing using System Usability Scale,” 2015. [Online]. Available: http://www.tegal

P. Hanifah and M. Wahyuni Siregar, “Penerapan Metode SUMI Pada Pengujian Usability Aplikasi E-Learning Berbasis Website,” 2021. [Online]. Available: http://jurnal.polibatam.ac.id/index.php/JAIC

A. Pratomo and R. Mantala, “PENGEMBANGAN APLIKASI UJIAN BERBASIS KOMPUTER BESERTA ANALISIS UJI GUNA SISTEM PERANGKAT LUNAKNYA MENGGUNAKAN METODE SUMI (SOFTWARE USABILITY MEASUREMENT INVENTORY),” 2016.

A. Aulia and S. Khairani, “ANALISIS E-SAMSAT UNTUK PENDATAAN KENDERAAN MENUNGGAK PAJAK DENGAN METODE IMPORTANCE PERFORMANCE ANALYSIS,” Jurnal Teknologi Informasi), vol. 6, no. 2, 2022.

A. Fahmi and I. Ramadhan, “ANALISIS SENTIMENT MASYARAKAT SELAMA BULAN RAMADHAN DALAM MENGHADAPI PANDEMI COVID-19,” 2020.

A. F. Sabily, P. P. Adikara, and M. A. Fauzi, “Analisis Sentimen Pemilihan Presiden 2019 pada Twitter menggunakan Metode Maximum Entropy,” 2019. [Online]. Available: http://j-ptiik.ub.ac.id

E. H. Muktafin, K. Kusrini, and E. T. Luthfi, “Analisis Sentimen pada Ulasan Pembelian Produk di Marketplace Shopee Menggunakan Pendekatan Natural Language Processing,” Jurnal Eksplora Informatika, vol. 10, no. 1, pp. 32–42, Sep. 2020, doi: 10.30864/eksplora.v10i1.390.

N. Munasatya and S. Novianto, “Natural Language Processing untuk Analisis Sentimen Presiden Jokowi Menggunakan Multi Layer Perceptron Natural Language Processing for President Jokowi Sentiment Analysis using Multi Layer Perceptron,” 2020. [Online]. Available: https://t.co/dV56DeVJSA

P. Arsi, R. Wahyudi, and R. Waluyo, “Optimasi SVM Berbasis PSO pada Analisis Sentimen Wacana Pindah Ibu Kota Indonesia,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 5, no. 2, pp. 231–237, Apr. 2021, doi: 10.29207/resti.v5i2.2698.

K. Hamid et al., “Usability Evaluation of Mobile Banking Applications in Digital Business as Emerging Economy,” IJCSNS International Journal of Computer Science and Network Security, vol. 22, no. 2, p. 250, 2022, doi: 10.22937/IJCSNS.2022.22.2.32.

M. Amien, “Sejarah dan Perkembangan Teknik Natural Language Processing (NLP) Bahasa Indonesia: Tinjauan tentang sejarah, perkembangan teknologi, dan aplikasi NLP dalam bahasa Indonesia,” Mar. 2023, [Online]. Available: http://arxiv.org/abs/2304.02746

Z. Kastrati, F. Dalipi, A. S. Imran, K. P. Nuci, and M. A. Wani, “Sentiment analysis of students’ feedback with nlp and deep learning: A systematic mapping study,” Applied Sciences (Switzerland), vol. 11, no. 9. MDPI AG, 2021. doi: 10.3390/app11093986.

P. J Kirakowski, “The Use of Questionnaire methods for Usability Assessment Background notes on the SUMI questionnaire,” 2018.

P. Hanifah and M. Wahyuni Siregar, “Penerapan Metode SUMI Pada Pengujian Usability Aplikasi E-Learning Berbasis Website,” 2021. [Online]. Available: http://jurnal.polibatam.ac.id/index.php/JAIC

DOI: https://doi.org/10.30591/jpit.v9i2.5451