Klasifikasi Pengucapan Huruf Hijaiyah Berbasis Android Menggunakan CNN dengan Fitur Mel-Spectrogram

Fawwaz Ijlal Muqsith; Endang Supriyati; Tri Listyorini

doi:10.30591/jpit.v10i1.8145

Klasifikasi Pengucapan Huruf Hijaiyah Berbasis Android Menggunakan CNN dengan Fitur Mel-Spectrogram

Fawwaz Ijlal Muqsith, Endang Supriyati, Tri Listyorini

Abstract

Mastery of Hijaiyah letters is a fundamental basis in learning the Qur'an, but data from the IIQ Community Service Institute 2021/2022 shows that 72.25% of the 3,111 Muslims tested have not been able to read the Qur'an properly. This research aims to develop an Android-based Hijaiyah letter pronunciation classification system using Convolutional Neural Network (CNN) with mel-spectrogram features. The research methodology includes collecting 8,904 voice samples from 53 participants at Pondok Tahfidz Yanbu'ul Qur'an Menawan, preprocessing data using MFCC techniques, developing CNN models, and implementing the system in the form of mobile applications with MVVM architecture. The test results showed promising performance with some classes achieving 100% accuracy and an average overall accuracy of 83.80%, although there were challenges in some classes such as “alif_dommah” and “ghaiin_dommah” which had an accuracy below 40%. The developed system successfully provides an interactive learning platform through the integration of mobile applications with the Flask API, but still requires further development, especially in expanding the dataset to overcome overfitting problems and improve the generalization ability of the model.

Full Text:

References

DAFTAR PUSTAKA

R. Helmalia, L. Suzanti, and Rr. D. Widjayatri, “Pengenalan Huruf Hijaiyah Melalui Metode Tilawati bagi Anak Usia 5-6 Tahun,” Aulad: Journal on Early Childhood, vol. 7, no. 1, pp. 199–209, Apr. 2024, doi: 10.31004/aulad.v7i1.634.

F. G. Safinatunnajah, A. Prasetiadi, and M. Wibowo, “CLASSIFICATION OF CAT SOUNDS USING CONVOLUTIONAL NEURAL NETWORK (CNN) AND LONG SHORT-TERM MEMORY (LSTM) METHODS,” Jurnal Teknik Informatika (Jutif), vol. 3, no. 5, pp. 1349–1353, Oct. 2022, doi: 10.20884/1.jutif.2022.3.5.373.

V. Karenina, M. F. Erinsyah, and D. S. Wibowo, “Klasifikasi Rentang Usia Dan Gender Dengan Deteksi Suara Menggunakan Metode Deep Learning Algoritma Cnn (Convolutional Neural Network),” Komputika : Jurnal Sistem Komputer, vol. 12, no. 2, pp. 75–82, Sep. 2023, doi: 10.34010/komputika.v12i2.10516.

A. Maccagno, A. Mastropietro, U. Mazziotta, M. Scarpiniti, Y.-C. Lee, and A. Uncini, “A CNN Approach for Audio Classification in Construction Sites.”

K. M. Rezaul et al., “Enhancing Audio Classification Through MFCC Feature Extraction and Data Augmentation with CNN and RNN Models,” International Journal of Advanced Computer Science and Applications, vol. 15, no. 7, pp. 37–53, 2024, doi: 10.14569/IJACSA.2024.0150704.

J. Lee, J. Nam, T. Kim, and J. Park, “Raw Waveform-based Audio Classification Using Sample-level CNN Architectures,” 2017, doi: 10.48550/arXiv.1712.00866.

H. Mahmud Nawawi, A. Baitul Hikmah, A. Mustopa, and G. Wijaya, “Model Klasifikasi Machine Learning untuk Prediksi Ketepatan Penempatan Karir,” Jurnal SAINTEKOM, vol. 14, no. 1, pp. 13–25, Mar. 2024, doi: 10.33020/saintekom.v14i1.512.

M. Aminuddin, “English Spoken Digit Recognition using Convolutional Neural Network (CNN),” Jurnal EEICT (Electric Electronic Instrumentation Control Telecommunication), vol. 6, no. 2, Oct. 2023, doi: 10.31602/eeict.v6i2.11877.

G. Ajinurseto, L. O. Bakrim, and N. Islamuddin, “Penerapan Metode Mel Frequency Cepstral Coefficients pada Sistem Pengenalan Suara Berbasis Desktop,” Infomatek, vol. 25, no. 1, pp. 11–20, Jun. 2023, doi: 10.23969/infomatek.v25i1.6109.

Ulfah Nur Oktaviana, Ricky Hendrawan, Alfian Dwi Khoirul Annas, and Galih Wasis Wicaksono, “Klasifikasi Penyakit Padi berdasarkan Citra Daun Menggunakan Model Terlatih Resnet101,” Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi), vol. 5, no. 6, pp. 1216–1222, Dec. 2021, doi: 10.29207/resti.v5i6.3607.

M. Agil Izzulhaq, “Indonesian Journal of Mathematics and Natural Sciences Penerapan Algoritma Convolutional Neural Network Arsitektur ResNet50V2 Untuk Mengidentifikasi Penyakit Pneumonia.” [Online]. Available: https://journal.unnes.ac.id/journals/JM/index

N. Fadlia and R. Kosasih, “KLASIFIKASI JENIS KENDARAAN MENGGUNAKAN METODE CONVOLUTIONAL NEURAL NETWORK (CNN),” Jurnal Ilmiah Teknologi dan Rekayasa, vol. 24, no. 3, pp. 207–215, 2019, doi: 10.35760/tr.2019.v24i3.2397.

H. W. Sulistyo, H. Oktavianto, Z. Arifin, A. E. Wardoyo, and Q. Fitriyah, “PEMANFAATAN API PADA APLIKASI PORTAL BERITA SEDERHANA,” JUTIKOMP, 2024.

R. Nandang Pratama and Y. A. Susetyo, “Implementasi Python API dengan Framework Flask sebagai Cloud Run Service Untuk Proses Update di PT. XYZ,” 2024.

N. Puspitasari, E. Budiman, Y. N. Sulaiman, and M. B. Firdaus, “Microservice API Implementation for E-Government Service Interoperability,” in Journal of Physics: Conference Series, IOP Publishing Ltd, Apr. 2021. doi: 10.1088/1742-6596/1807/1/012005.

F. Dzulqarnain, “Computer Based Information System Journal RANCANG BANGUN APLIKASI BELAJAR ARAB UNTUK ANDROID MENGGUNAKAN JETPACK COMPOSE DAN KOTLIN,” CBIS JOURNAL, vol. 11, no. 01, 2023, [Online]. Available: http://ejournal.upbatam.ac.id/index.php/cbishttp://ejournal.upbatam.ac.id/index.php/cbis

B. Rizki, P. Surya, A. Putra Kharisma, and N. Yudistira, “Perbandingan Kinerja Pola Perancangan MVC, MVP, dan MVVM Pada Aplikasi Berbasis Android (Studi kasus : Aplikasi Laporan Hasil Belajar Siswa SMA BSS),” 2020. [Online]. Available: http://j-ptiik.ub.ac.id

Mahardika Yoshi Putra, “Rancang Bangun Deteksi Bentuk Wajah Untuk Menentukan Gaya Rambut Menggunakan Algoritma CNN,” Repeater : Publikasi Teknik Informatika dan Jaringan, vol. 2, no. 3, pp. 206–212, Jul. 2024, doi: 10.62951/repeater.v2i3.139.

Q. Nada, C. Ridhuandi, P. Santoso, and D. Apriyanto, “Speech Recognition dengan Hidden Markov Model untuk Pengenalan dan Pelafalan Huruf Hijaiyah,” 2019.

R. Punggawa Arcapada, W. Setiawan, I. Made Arsa Suyadnya, J. Raya Kampus Unud Jimbaran, and K. Badung, “Desember 2021 Robbani Punggawa Arcapada, Widyadi Setiawan, I Made Arsa Suyadnya 1.”

DOI: https://doi.org/10.30591/jpit.v10i1.8145