DS Journal of Digital Science and Technology (DS-DST)

Research Article | Open Access | Download Full Text

Volume 4 | Issue 1 | Year 2025 | Article Id: DST-V4I1P104 DOI: https://doi.org/10.59232/DST-V4I1P104

Comparative Study of Machine Learning Algorithms for Facial Recognition Systems

Arun Kumar Singh

ReceivedRevisedAcceptedPublished
11 Jan 202512 Feb 202516 Mar 202531 Mar 2025

Citation

Arun Kumar Singh. “Comparative Study of Machine Learning Algorithms for Facial Recognition Systems.” DS Journal of Digital Science and Technology, vol. 4, no. 1, pp. 50-62, 2025.

Abstract

Robust facial recognition systems are frequently adopted in security, healthcare and entertainment fields and improve substantial growth through ML algorithms. This paper compares different machine learning approaches: CNN, SVM, k-NN, Decision Trees and others with a focus on the facial recognition task. The algorithm is evaluated based on accuracy, speed, efficiency, and insensitivity to changes in lighting and pose of the subject. In order to avoid bias when evaluating the performance of the developed algorithms, the study is performed on recognized datasets like Labeled Faces in the Wild (LFW) and Yale Face Database B. Outcome shows that DL architecture based on CNN yields superior performance than other traditional ML but at a higher computational load. The paper’s conclusion is presented through recommendations on how best to select an algorithm given an application and outlined future studies. Biometrics and facial recognition have been receiving considerable attention worldwide in recent years due to improvements in ML that improve their accuracy, performance, and flexibility of use. In this context, this work aims to compare well-known techniques of facial recognition based on ML algorithms using methods like CNN, SVM, PCA, and DBN. The performance of each algorithm is compared based on accuracy, time of execution, consistency under varying illumination and computational complexity. This analysis shows that although deploying CNN-based architectures always provides high accuracy and flexibility, it requires significant computational power that cannot practically be used for low-power devices. On the other hand, algorithms such as PCA have lower computational time in recognizing, but they are not efficient when dealing with high dimensional data, which also affects the recognition rate under complex circumstances. In this paper, various approaches that balance the accuracy and computational efficiency of the algorithm are presented as conclusions for choosing the best algorithm depending on the application. The insights from the work will benefit the exploration of future directions and the practical applicability of facial recognition algorithms by focusing on context-specific algorithm choices.

Keywords

Facial Recognition, Machine Learning, Convolutional Neural Networks (CNN), Support Vector Machines (SVM), Principal Component Analysis (PCA), Deep Belief Networks (DBN), Algorithm comparison, Biometric authentication.

References

[1] Vanlalhruaia, Yumnam Kirani Singh, and N. Debachandra Singh, “Binary Face Image Recognition using Logistic Regression and Neural Network,” International Conference on Energy, Communication, Data Analytics and Soft Computing, Chennai, India, pp. 3883-3888, 2017.

[CrossRef] [Google Scholar] [Publisher Link]

[2] Chris Albon, Machine Learning with Python Cookbook, O’Reilly Media Inc., USA, 2018.

[Google Scholar] [Publisher Link]

[3] Chloe-Agathe Azencott, Introduction au Machine Learning, Dunod, 2019.

[4] Zied Bannour Lahaw, Dhekra Essaidani, and Hassene Seddik, “Robust Face Recognition Approaches Using PCA, ICA, LDA Based on DWT, and SVM Algorithms,” 41st International Conference on Telecommunications and Signal Processing, Athens, Greece, pp. 1-5, 2018.

[CrossRef] [Google Scholar] [Publisher Link]

[5] Huda Mady, and Shadi M. S. Hilles, “Face Recognition and Detection Using Random Forest and Combination of LBP and HOG Features,” International Conference on Smart Computing and Electronic Enterprise, Shah Alam, Malaysia, pp. 1-7, 2018.

[CrossRef] [Google Scholar] [Publisher Link]

[6] Shakir Fattah Kak, Firas Mahmood Mustafa, and Pedro R. Valente, “Discrete Wavelet Transform with Eigenface to Enhance Face Recognition Rate,” Academic Journal of Nawroz University, vol. 7, no. 4, pp. 9-17, 2018.

[Google Scholar]

[7] Laith R. Fleah, and Shaimaa A. Al-Aubi, “A Face Recognition System Based on Principal Component Analysis-Wavelet and Support Vector Machines,” Cihan University-Erbil Scientific Journal, vol. 3, no. 2, pp. 14-20.

[Google Scholar] [Publisher Link]

[8] S. Meenakshi, M. Siva Jothi, and D. Murugan, “Face Recognition Using Deep Neural Network Across Variationsin Pose and Illumination,” International Journal of Recent Technology and Engineering, vol. 8, no. 1S4, pp. 289-292, 2019.

[Google Scholar] [Publisher Link]

[9] Putta Sujitha, Venkatramaphanikumar S., and Krishna Kishore K.V., “Scale Invariant Face Recognition with Gabor Wavelets and SVM,” International Journal of Recent Technology and Engineering, vol. 7, no. 5S4, pp. 100-104, 2019.

[Google Scholar] [Publisher Link]

[10] Sri Sutarti, Anggyi Trisnawan Putra, and Endang Sugiharti, “Comparison of PCA and 2DPCA Accuracy with K-Nearest Neighbor Classification in Face Image Recognition,” Scientific Journal of Informatics, vol. 6, no. 1, pp. 64-72, 2019.

[CrossRef] [Google Scholar] [Publisher Link]

[11] Ni Kadek Ayu Wirdiani et al., “Face Identification Based on K-Nearest Neighbor,” Scientific Journal of Informatics, vol. 6, no. 2, 2019.

[CrossRef] [Google Scholar] [Publisher Link]

[12] Zhiming Xie, Junjie Li, and Hui Shi, “A Face Recognition Method Based on CNN,” Journal of Physics: Conference Series, vol. 1395, no. 1, 2019.

[Google Scholar] [Publisher Link]

[13] Pranati Rakshit et al., “Face Detection Using Support Vector Mechine with PCA,” 2nd International Conference on Non-Conventional Energy: Nanotechnology & Nanomaterials for Energy & Environment, 2019.

[CrossRef] [Google Scholar] [Publisher Link]

[14] Muhammad Shakeel Faridi et al., “A Comparative Analysis Using Different Machine Learning: An Efficient Approach for Measuring Accuracy of Face Recognition,” International Journal of Machine Learning and Computing, vol. 11, no. 2, pp. 115-120, 2021.

[CrossRef] [Google Scholar] [Publisher Link]

[15] Yohanssen Pratama et al., “Face Recognition for Presence System by Using Residual Networks-50 Architecture,” International Journal of Electrical and Computer Engineering, vol. 11, no. 6, pp. 5488-5496, 2021.

[CrossRef] [Google Scholar] [Publisher Link]

[16] Benradi Hicham, Chater Ahmed, and Lasfar Abdelali, “Face Recognition Method Combining SVM Machine Learning and Scale Invariant Feature Transform,” 10th International Conference on Innovation, Modern Applied Science and Environmental Studies, vol. 351, pp. 1-5, 2022.

[CrossRef] [Google Scholar] [Publisher Link]

[17] S.S.H. Ab Waheed Lone, and M.A. Ahad, “Face Recognition by SVM Using Local Binary Patterns,” International Journal on Computer Science and Engineering, vol. 9, no. 5, pp. 222-226, 2017.

[Google Scholar] [Publisher Link]

[18] Zahraa Modher Nabat, Mushtaq Talib Mahdi, and Shaymaa Abdul Hussein Shnain, “Face Recognition Method Based on Support Vector Machine and Rain Optimization Algorithm (ROA),” Webology, vol. 19, no. 1, pp. 2170-2181, 2022.

[CrossRef] [Google Scholar] [Publisher Link]


Comparative Study of Machine Learning Algorithms for Facial Recognition Systems