Penerapan Linear Discriminant Analysis Untuk Meningkatkan Kinerja Algoritma Support Vector Machine

Gusrianty Gusrianty; Fenly Fenly; Deny Jollyta; Erlin Erlin; Ramalia Noratama Putri; Dwi Oktariana

doi:10.30591/jpit.v10i4.8772

Penerapan Linear Discriminant Analysis Untuk Meningkatkan Kinerja Algoritma Support Vector Machine

Gusrianty Gusrianty, Fenly Fenly, Deny Jollyta, Erlin Erlin, Ramalia Noratama Putri, Dwi Oktariana

Abstract

Obesity is a complex chronic disease influenced by various factors, such as genetic, environmental, and lifestyle, which is characterized by excess body weight due to the excessive accumulation of body fat. With the rapid advancement of technology and digitalization across all sectors, data has become increasingly vital, as large datasets generate valuable information. However, a key challenge in data analysis is addressing redundancy, noise, and high dimensionality, which can affect the performance of machine learning algorithms. This study aims to investigate the effectiveness of combining Linear Discriminant Analysis (LDA) and Support Vector Machine (SVM) in enhancing the accuracy and efficiency of high-dimensional data classification, particularly in predicting obesity levels. LDA is employed to reduce data dimensionality while retaining the most relevant features, whereas SVM is utilized as the classification algorithm to predict obesity levels based on patterns identified within the dataset. The research was conducted using a dataset consisting of 779 training samples and 195 testing samples. The results reveal that the combination of LDA and SVM achieved a classification accuracy of up to 99%, with a 50% reduction in data dimensionality and a computation speed of 0,0696 second. Moreover, computation time was significantly reduced, indicating that LDA not only facilitates data simplification but also improves the overall efficiency of the classification process.

Keywords

Classification, Dimensionality Reduction, Linear Discriminant Analysis, Obesity, Support Vector Machine

Full Text:

References

R. Dianah, E. A. Andari, Elvira Anjani Putri, Cahya Chita Dwinanti, and D. N. Nafisah, “Penyuluhan Cara Mencegah Obesitas Pada Remaja dengan Pola Makan Yang Sehat,” J. Abdimas ADPI Sains dan Teknol., vol. 3, no. 3, pp. 41–50, 2022, doi: 10.47841/saintek.v3i3.220.

O. Dammann, “Data, Information, Evidence, and Knowledge: A Proposal for Health Informatics and Data Science,” Online J. Public Health Inform., vol. 10, no. 3, Mar. 2019, doi: 10.5210/ojphi.v10i3.9631.

Willy Fernando, D. Jollyta, Dadang Priyanto, and Dwi Oktarina, “The Influence Of Data Categorization And Attribute Instances Reduction Using The Gini Index On The Accuracy Of The Classification Algorithm ModeL,” J. Ilm. Kursor, vol. 12, no. 3, pp. 111–122, May 2024, doi: 10.21107/kursor.v12i3.372.

A. Setiawan and Sumijan, “Penerapan Metode Linear Discriminant Analysis Dalam Mendeteksi Kematangan Buah Tomat,” KESATRIA J. Penerapan Sist. Inf. (Komputer Manajemen), vol. 6, no. 1, pp. 1–11, Jan. 2025, doi: https://doi.org/10.30645/kesatria.v6i1.539.g534.

S. Nur Rismanah, R. Astuti, and F. M. Basysyar, “Penerapan Algoritma Support Vector Machine Dalam Menganalisis Sentimen Ulasan Pelanggan Shopeefood Berdasarkan Twitter,” JATI (Jurnal Mhs. Tek. Inform., vol. 8, no. 1, pp. 406–412, Feb. 2024, doi: 10.36040/jati.v8i1.8401.

V. Berisha et al., “Digital medicine and the curse of dimensionality,” npj Digit. Med., vol. 4, no. 1, p. 153, Oct. 2021, doi: 10.1038/s41746-021-00521-5.

S. Abimanyu, N. Bahtiar, and E. Adi Sarwoko, “Implementasi Metode Support Vector Machine (SVM) dan t-Distributed Stochastic Neighbor Embedding (t-SNE) untuk Klasifikasi Depresi,” J. Masy. Inform., vol. 14, no. 2, pp. 146–158, 2023, doi: 10.14710/jmasif.14.2.59513.

D. Jollyta, Prihandoko, A. Hajjah, E. Haerani, and M. Siddik, Algoritma Klasifikasi untuk Pemula Solusi Python dan RapidMiner. Deepublish, 2023.

M. H. Ramdani, I. G. P. S. Wijaya, and R. Dwiyansaputra, “Optimalisasi Pengenalan Wajah Berbasis Lineardiscriminant Analysis Dan K-Nearest Neighbormenggunakan Particle Swarm Optimization,” J. Teknol. Informasi, Komput. dan Apl., vol. 4, Mar. 2022, [Online]. Available: http://jtika.if.unram.ac.id/index.php/JTIKA/

R. Wang, “Comparison of Decision Tree, Random Forest and Linear Discriminant Analysis Models in Breast Cancer Prediction,” J. Phys. Conf. Ser., vol. 2386, no. 1, p. 012043, Dec. 2022, doi: 10.1088/1742-6596/2386/1/012043.

D. Jollyta, G. Gusrianty, P. Prihandoko, and D. Sukrianto, “N-gram and Kernel Performance Using Support Vector Machine Algorithm for Fake News Detection System,” Ilk. J. Ilm., vol. 15, no. 3, pp. 398–404, Dec. 2023, doi: 10.33096/ilkom.v15i3.1770.398-404.

J. H. Shah, M. Sharif, M. Yasmin, and S. L. Fernandes, “Facial expressions classification and false label reduction using LDA and threefold SVM,” Pattern Recognit. Lett., vol. 139, pp. 166–173, Nov. 2020, doi: 10.1016/J.PATREC.2017.06.021.

MrSimple, “Obesity prediction,” Kaggle, 2024. https://www.kaggle.com/datasets/mrsimple07/obesity-prediction (accessed Jan. 09, 2025).

Y. R. Wulan, N. Susanto, A. Larasati, and V. E. Darmawan, “The Sentiment Analysis of User Perception on The Peduli Lindungi Application Using Support Vector Machine Algorithm,” in Proceedings of the International Conference on Industrial Engineering and Operations Management, Michigan, USA: IEOM Society International, Sep. 2022, pp. 832–842. doi: 10.46254/AP03.20220165.

A. Dewan, D. Wibiyanto, and A. Wibowo, “Penerapan Algoritma Multiclass Support Vector Machine dan TF-IDF Untuk Klasifikasi Topik Tugas Akhir,” SKANIKA Sist. Komput. dan Tek. Inform., vol. 6, no. 1, pp. 42–51, 2023.

D. Jollyta, A. Hajjah, E. Haerani, and M. Siddik, Algoritma Klasifikasi untuk Pemula Solusi Python dan RapidMiner. Deepublish, 2023. [Online]. Available: https://books.google.co.id/books?id=y84TEQAAQBAJ

R. Destriana, D. Nurnaningsih, D. Alamsyah, and A. A. J. Sinlae, “Implementasi Metode Linear Discriminant Analysis (LDA) Pada Klasifikasi Tingkat Kematangan Buah Nanas,” Build. Informatics, Technol. Sci., vol. 3, no. 1, pp. 56–63, 2021, doi: 10.47065/bits.v3i1.1007.

DOI: https://doi.org/10.30591/jpit.v10i4.8772