Verifikasi Wajah untuk Menghitung Jumlah Transaksi Pengunjung Menggunakan Metode Deep Metric Learning

Rifqi Affan Maulana; Riyanto Sigit; setiawardhana setiawardhana

doi:10.30591/jpit.v10i3.8922

Verifikasi Wajah untuk Menghitung Jumlah Transaksi Pengunjung Menggunakan Metode Deep Metric Learning

Rifqi Affan Maulana, Riyanto Sigit, setiawardhana setiawardhana

Abstract

This research carries the theme of facial recognition to detect visitors' faces by counting the number of times visitors make transactions. The objective of this research is to develop and implement a face verification system for public purposes, such as commercial purposes. One potential application of this system is in the realm of promotions, where it could be utilized to track the number of transactions conducted by visitors. The method employed utilizes deep metric learning (DML) to generate a model capable of verifying various facial images through the Convolutional Neural Network (CNN) architecture, which is designed to train human face image data. The triplet loss method is employed in training data due to its recognition as a more flexible approach in utilizing labels (in the form of face images) to facilitate comparison with the detected face images. The model employed for face recognition applications is facenet, a system that has been demonstrated to achieve a high degree of accuracy. The research's output is an application capable of swiftly and precisely verifying facial images of visitors and calculating the number of visitor transactions. The number of visitor transactions can subsequently be utilized as a promotional or discount strategy in commercial services.

Keywords

Deep Metric Learning, Face Verification, CNN , Facenet

Full Text:

References

Mu, Xiaohui & Li, Siying & Haipeng, Peng. (2020). A Review of Face Recognition Technology. IEEE Access. PP. 1-1. 10.1109/ACCESS.2020.3011028.

Wu, Zehao. (2024). Overview of Mainstream Face Recognition Methods. Transactions on Computer Science and Intelligent Systems Research. 7. 390-397. 10.62051/e37s5n84.

M. Arsal, B. Agus Wardijono, dan D. Anggraini, “Face Recognition Untuk Akses Pegawai Bank Menggunakan Deep Learning Dengan Metode CNN”, TEKNOSI, vol. 6, no. 1, hlm. 55–63, Jun 2020.

C. G. Da Rato dan A. R. Adriyanto, "Efektivitasan Sistem Face Recognition pada Boarding Gate Stasiun Kota Bandung," Action Research Literate, vol. 8, no. 6, pp. 1–7, Jun. 2024, doi: 10.46799/arl.v8i6.392.

W. -J. Chang et al., "A Deep Learning Facial Expression Recognition based Scoring System for Restaurants," 2019 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Okinawa, Japan, 2019, pp. 251-254, doi: 10.1109/ICAIIC.2019.8668998.

J. Lu, J. Hu and J. Zhou, "Deep Metric Learning for Visual Understanding: An Overview of Recent Advances," in IEEE Signal Processing Magazine, vol. 34, no. 6, pp. 76-84, Nov. 2017, doi: 10.1109/MSP.2017.2732900.

D. D. Mohan, B. Jawade, S. Setlur, and V. Govindaraj, Deep Metric Learning for Computer Vision: A Brief Overview. 2023. [Online]. Available: https://arxiv.org/abs/2312.10046

Florian Schroff, Dmitry Kalenichenko, James Philbin: “FaceNet: A Unified Embedding for Face Recognition and Clustering”, 2015; arXiv:1503.03832. DOI: 10.1109/CVPR.2015.7298682.

Golwalkar, Rucha & Mehendale, Ninad. (2022). Masked-face recognition using deep metric learning and FaceMaskNet-21. Applied Intelligence. 52. 13268-13279. 10.1007/s10489-021-03150-3.

Bankar, Rutuja & Bargat, Nikita & Hanmante, Isha & Dakore, Prof. (2022). Face Recognition Using Facenet Deep Learning Network for Attendance System. International Journal of Scientific Research in Computer Science, Engineering and Information Technology. 458-463. 10.32628/CSEIT228630.

Azmi, Khairul & Defit, Sarjon & Sumijan, Sumijan. (2023). Implementasi Convolutional Neural Network (CNN) Untuk Klasifikasi Batik Tanah Liat Sumatera Barat. JURNAL UNITEK. 16. 28-40. 10.52072/unitek.v16i1.504.

F. Zhuang et al., A Comprehensive Survey on Transfer Learning. 2020. [Online]. Available: https://arxiv.org/abs/1911.02685

Oztel, Ismail & Yolcu, Gözde & Oz, Cemil. (2019). Performance Comparison of Transfer Learning and Training from Scratch Approaches for Deep Facial Expression Recognition. 1-6. 10.1109/UBMK.2019.8907203.

Learned-Miller, Erik & Huang, Gary & RoyChowdhury, Aruni & Li, Haoxiang & Hua, Gang. (2016). Labeled Faces in the Wild: A Survey. 10.1007/978-3-319-25958-1_8.

Sinha, Ekta & Kumar, Ashwani & Tyagi, Abhinav. (2025). OpenCV for Computer Vision Applications. International Journal For Multidisciplinary Research. 7. 10.36948/ijfmr.2025.v07i03.44280.

Anggara, K. D., Kartikasari, D. P., & Bakhtiar, F. A. (2023). Implementasi Algoritma MTCNN dalam Mekanisme Autentikasi berbasis Pengenalan Wajah. Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer, 7(8), 3613–3621. Diambil dari https://j-ptiik.ub.ac.id/index.php/j-ptiik/article/view/13044

Ryando, Catoer & Sigit, Riyanto & Setiawardhana, Setiawardhana & Dewantara, Bima. (2025). Face Recognition for Logging in Using Deep Learning for Liveness Detection on Healthcare Kiosks. JOIV : International Journal on Informatics Visualization. 9. 295. 10.62527/joiv.9.1.2759.

D. Tribuana, Hazriani, and A. L. Arda, “Image Preprocessing Approaches Toward Better Learning Performance with CNN”, J. RESTI (Rekayasa Sist. Teknol. Inf.) , vol. 8, no. 1, pp. 1 - 9, Jan. 2024.

DOI: https://doi.org/10.30591/jpit.v10i3.8922