Robust Single Sample Per Person Face Recognition with Probabilistic Illumination Enhancement

Authors

  • Muhammad Tariq Siddique School of Computing and Informatics, Universiti Teknologi Brunei, Brunei Darussalam
  • Ibrahim Venkat School of Computing and Informatics, Universiti Teknologi Brunei, Brunei Darussalam
  • Shah Hasan Shah Newaz School of Computing and Informatics, Universiti Teknologi Brunei, Brunei Darussalam
  • Sharul Tajuddin School of Computing and Informatics, Universiti Teknologi Brunei, Brunei Darussalam

DOI:

https://doi.org/10.32890/jict2025.24.3.5

Keywords:

Illumination, probabilistic image enhancement, Retinex theory, SSPP face recognition, FaceNet, SVM

Abstract

The challenges imposed by the Single Sample Per Person face recognition problem become especially critical when face images are captured in uncontrolled environments, which typically involve variations in illumination, facial expression, pose, occlusion, and more. In particular, illumination changes caused by poor lighting conditions can significantly degrade the performance of face recognition systems. In this paper, we investigate the SSPP face recognition problem in the presence of potential illumination variation and propose a two-fold approach. Firstly, we analyse and quantify the illumination variations in face images and then normalise these variations based on a probabilistic image enhancement approach. Subsequently, the feature embedding process was performed using the deep learning-based FaceNet system, and finally, faces were classified using the classical Support Vector Machine. The performance of the proposed approach is demonstrated through comprehensive experiments compared to state-of-the-art techniques. The proposed method achieved significant accuracy improvements, attaining 96.17% and 95.68% for 20 and 30 subjects, respectively, on the Extended Yale-B dataset. The performance of the proposed method is evaluated and exhibits superiority in handling illumination compared to state-of-the-art counterparts.

References

Abdelmaksoud, M., Nabil, E., Farag, I., & Hameed, H. A. (2020). A novel neural network method for face recognition with a single sample per person. IEEE Access, 8, 102212-102221. https://doi.org/10.1109/ACCESS.2020.2999030

Adjabi, I., Ouahabi, A., Benzaoui, A., & Jacques, S. (2021). Multi-block color-binarized statistical images for single-sample face recognition. Sensors, 21(3), 728. https://doi.org/10.3390/ s21030728

Anbarjafari, G., Jafari, A., Jahromi, M. N. S., Ozcinar, C., & Demirel, H. (2015). Image illumination enhancement with an objective no-reference measure of illumination assessment based on Gaussian distribution mapping. Engineering Science and Technology, An International Journal, 18(4), 696-703. https://doi.org/10.1016/j.jestch.2015.04.011

Arigbabu, O. A., Syed Ahmad, S. M., Wan Adnan, W. A., Yussof, S., & Mahmood, S. (2015). Soft biometrics: Gender recognition from unconstrained face images using local feature descriptor. Journal of Information and Communication Technology (JICT), 14, 111-122. https://e-journal.uum.edu.my/index.php/jict/article/view/8159

Azmeen, J., & Borah, D. J. (2021). Face recognition techniques, challenges: A review. Soft Computing for Intelligent Systems, 369-374. https://doi.org/10.1007/978-981-16-1048-6_27

Bouchene, M. M. (2024). Bayesian optimization of histogram of oriented gradients (HOG) parameters for facial recognition. The Journal of Supercomputing, 80(14), 20118-20149. https://doi.org/10.1007/s11227-024-06259-7

Cuculo, V., D'Amelio, A., Grossi, G., Lanzarotti, R., & Lin, J. (2019). Robust single-sample face recognition by sparsity-driven sub-dictionary learning using deep features. Sensors, 19(1), 146. https://doi.org/10.3390/s19010146

CVS. (2007). Yale Face Database. http://cvc.cs.yale.edu/cvc/projects/yalefacesB/corrupt.html

Deng, W., Hu, J., & Guo, J. (2012). Extended SRC: Undersampled face recognition via intraclass variant dictionary. IEEE Transactions on Pattern Analysis and Machine Intelligence, 34(9), 1864-1870. https://doi.org/10.1109/TPAMI.2012.30

Deng, W., Hu, J., & Guo, J. (2013). In defense of sparsity based face recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 399-406). https://doi.org/10.1109/CVPR.2013.58

Dey, N. (2019). Uneven illumination correction of digital images: A survey of the state-of-the-art. Optik, 183, 483-495. https://doi.org/10.1016/j.ijleo.2019.02.118

Dougherty, G. (2012). Pattern recognition and classification: An introduction. Springer Science & Business Media. https://doi.org/10.1007/978-1-4614-5323-9

Fei, R., Zhang, J., Bo, L., Zhang, H., Li, H., & Li, M. (2024). Joint multi-subspace feature learning with singular value decomposition for robust single-sample face recognition. Computers and Electrical Engineering, 114, 109085. https://doi.org/10.1016/j.compeleceng.2024.109085

Filippidou, F. P., & Papakostas, G. A. (2020). Single sample face recognition using convolutional neural networks for automated attendance systems. In 2020 Fourth International Conference on Intelligent Computing in Data Sciences (ICDS) (pp. 1-6). IEEE. https://doi.org/10.1109/ ICDS50568.2020.9268759

Fu, X., Liao, Y., Zeng, D., Huang, Y., Zhang, X.-P., & Ding, X. (2015). A probabilistic method for image enhancement with simultaneous illumination and reflectance estimation. IEEE Transactions on Image Processing, 24(12), 4965-4977. https://doi.org/10.1109/TIP.2015. 2474701

Fu, X., Zhuang, P., Huang, Y., Liao, Y., Zhang, X. P., & Ding, X. (2014, October). A retinex-based enhancing approach for single underwater image. In 2014 IEEE International Conference on Image Processing (ICIP) (pp. 4572-4576). IEEE. https://doi.org/10.1109/ICIP.2014.7025927

Gan, W., Yang, H., Zeng, J., & Chen, F. (2020). Auxiliary dictionary of diversity learning for face recognition with a single sample per person. International Journal on Artificial Intelligence Tools, 29(05), 2050015. https://doi.org/10.1142/S0218213020500153

Georghiades, A. S., Belhumeur, P. N., & Kriegman, D. J. (2001). From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Transactions on Pattern Analysis and Machine Intelligence, 23(6), 643-660. https://doi.org/10.1109/34.927464

Goldstein, T., & Osher, S. (2009). The split Bregman method for L1-regularized problems. SIAM Journal on Imaging Sciences, 2(2), 323-343. https://doi.org/10.1137/080725891

Huang, Y.-S., & Alhlffee, M. H. B. (2023). Improving face recognition by integrating decision forest into GAN. Applied Artificial Intelligence, 37(1), 2175108. https://doi.org/10.1080/08839514. 2023.2175108

Huang, Z., Huang, L., Li, Q., Zhang, T., & Sang, N. (2018). Framelet regularization for uneven intensity correction of color images with illumination and reflectance estimation. Neurocomputing, 314, 154-168. https://doi.org/10.1016/j.neucom.2018.06.063

Ji, H.-K., Sun, Q.-S., Ji, Z.-X., Yuan, Y.-H., & Zhang, G.-Q. (2017). Collaborative probabilistic labels for face recognition from single sample per person. Pattern Recognition, 62, 125-134. https://doi.org/10.1016/j.patcog.2016.08.007

Jobson, D. J., Rahman, Z.-U., & Woodell, G. A. (1997a). A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Transactions on Image Processing, 6(7), 965-976. https://doi.org/10.1109/83.597272

Jobson, D. J., Rahman, Z.-U., & Woodell, G. A. (1997b). Properties and performance of a center/surround retinex. IEEE Transactions on Image Processing, 6(3), 451-462.

Kimmel, R., Elad, M., Shaked, D., Keshet, R., & Sobel, I. (2003). A variational framework for retinex. International Journal of Computer Vision, 52(1), 7-23. https://doi.org/10.1109/83.557356

Land, E. H. (1983). Recent advances in retinex theory and some implications for cortical computations: color vision and the natural image. Proceedings of the National Academy of Sciences of the United States of America, 80(16), 5163. https://doi.org/10.1073/pnas.80.16.5163

Land, E. H., & McCann, J. J. (1971). Lightness and retinex theory. Journal of the Optical Society of America, 61(1), 1-11. https://doi.org/10.1364/JOSA.61.000001

Lee, P.-H., Wu, S.-W., & Hung, Y.-P. (2012). Illumination compensation using oriented local histogram equalization and its application to face recognition. IEEE Transactions on Image Processing, 21(9), 4280-4289. https://doi.org/10.1109/TIP.2012.2202670

Li, M., Liu, J., Yang, W., Sun, X., & Guo, Z. (2018). Structure-revealing low-light image enhancement via robust retinex model. IEEE Transactions on Image Processing, 27(6), 2828-2841. https://doi.org/10.1109/TIP.2018.2810539

Liu, F., Ding, Y., Xu, F., & Ye, Q. (2019). Learning low-rank regularized generic representation with block-sparse structure for single sample face recognition. IEEE Access, 7, 30573-30587. https://doi.org/10.1109/ACCESS.2019.2903333

Liu, F., Tang, J., Song, Y., Zhang, L., & Tang, Z. (2015). Local structure-based sparse representation for face recognition. ACM Transactions on Intelligent Systems and Technology (TIST), 7(1), 1-20. https://doi.org/10.1145/2733383

Liu, F., Wang, F., Ding, Y., & Yang, S. (2021). SOM-based binary coding for single sample face recognition. Journal of Ambient Intelligence and Humanized Computing, 1-11. https://doi.org/10.1007/s12652-021-03255-0

Liu, F., Wang, F., Wang, Y., Zhou, J., & Xu, F. (2022). Cycle-autoencoder based block-sparse joint representation for single sample face recognition. Computers and Electrical Engineering, 101, 108003. https://doi.org/10.1016/j.compeleceng.2022.108003

Liu, F., Yang, S., Ding, Y., & Xu, F. (2019). Single sample face recognition via BoF using multistage KNN collaborative coding. Multimedia Tools and Applications, 78(10), 13297-13311. https://doi.org/10.1007/s11042-018-7002-5

Mehdipour Ghazi, M., & Kemal Ekenel, H. (2016). A comprehensive analysis of deep learning based representation for face recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops (pp. 34-41). https://doi.org/10.1109/CVPRW. 2016.20

Ming, Z., Chazalon, J., Luqman, M. M., Visani, M., & Burie, J. C. (2017, October). Simple triplet loss based on intra/inter-class metric learning for face verification. In 2017 IEEE International Conference on Computer Vision Workshops (ICCVW) (pp. 1656-1664). IEEE. https://doi.org/10.1109/ICCVW.2017.194

Mohd Sharif, N. A., Harun, N. H., & Yusof, Y. (2024). Colour image enhancement model of retinal fundus image for diabetic retinopathy recognition. Journal of Information and Communication Technology (JICT), 23(2), 293-334. https://doi.org/10.32890/jict2024.23.2.5

Mokhayeri, F., & Granger, E. (2020). A paired sparse representation model for robust face recognition from a single sample. Pattern Recognition, 100, 107129. https://doi.org/10.1016/j.patcog. 2019.107129

Mokhayeri, F., Granger, E., & Bilodeau, G.-A. (2018). Domain-specific face synthesis for video face recognition from a single sample per person. IEEE Transactions on Information Forensics and Security, 14(3), 757-772. https://doi.org/10.1109/TIFS.2018.2866295

Ng, M. K., & Wang, W. (2011). A total variation model for Retinex. SIAM Journal on Imaging Sciences, 4(1), 345-365. https://doi.org/10.1137/100806588

Nikan, F., & Hassanpour, H. (2020). Face recognition using non-negative matrix factorization with a single sample per person in a large database. Multimedia Tools and Applications, 79(37), 28265-28276. https://doi.org/10.1007/s11042-020-09394-4

Oloyede, M. O., Hancke, G. P., & Myburgh, H. C. (2020). A review on face recognition systems: Recent approaches and challenges. Multimedia Tools and Applications, 79(37), 27891-27922. https://doi.org/10.1007/s11042-020-09261-2

Osher, S., Burger, M., Goldfarb, D., Xu, J., & Yin, W. (2005). An iterative regularization method for total variation-based image restoration. Multiscale Modeling & Simulation, 4(2), 460-489. https://doi.org/10.1137/040605412

Pang, M., Cheung, Y.-M., Shi, Q., & Li, M. (2020). Iterative dynamic generic learning for face recognition from a contaminated single-sample per person. IEEE Transactions on Neural Networks and Learning Systems, 32(4), 1560-1574. https://doi.org/10.1109/TNNLS.2020. 2985099

Pang, M., Cheung, Y.-M., Wang, B., & Lou, J. (2019). Synergistic generic learning for face recognition from a contaminated single sample per person. IEEE Transactions on Information Forensics and Security, 15, 195-209. https://doi.org/10.1109/TIFS.2019.2919950

Peng, Y., Shi, H., Wu, H., Li, R., Kwok, N., Liu, S. C., Liu, S., & Rahnam, M. A. (2019). An optimum shift-and-weighted brightness mapping for low-illumination image restoration. The Imaging Science Journal, 67(4), 187-201. https://doi.org/10.1080/13682199.2019.1592891

Rahman, Z.-U., Jobson, D. J., & Woodell, G. A. (2004). Retinex processing for automatic image enhancement. Journal of Electronic Imaging, 13(1), 100-110. https://doi.org/10.1117/1. 1636183

Ríos-Sánchez, B., Costa-da-Silva, D., Martín-Yuste, N., & Sánchez-Ávila, C. (2019). Deep learning for facial recognition on single sample per person scenarios with varied capturing Conditions. Applied Sciences, 9(24), 5474. https://doi.org/10.3390/app9245474

Schroff, F., Kalenichenko, D., & Philbin, J. (2015). Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 815-823). https://doi.org/10.1109/CVPR.2015.7298682

Silva, A., & Farias, R. (2025). AD-VAE: Adversarial disentangling variational autoencoder. Sensors, 25(5), 1574. https://doi.org/10.3390/s25051574

Taigman, Y., Yang, M., Ranzato, M. A., & Wolf, L. (2014). Deepface: Closing the gap to human-level performance in face verification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 1701-1708). https://doi.org/10.1109/CVPR.2014.220

Tran, Q. M., Pham, V. T., Nga, D. T. T., & The Bao, P. (2022). Evaluating the efficacy of small face recognition by convolutional neural networks with interpolation based on auto-adjusted parameters and transfer learning. Applied Artificial Intelligence, 36(1), 2012982. https://doi.org/10.1080/08839514.2021.2012982

UCSD. (2005). http://cvc.cs.yale.edu/cvc/projects/yalefacesB/yalefacesB.html

Wang, H., Zhang, D., & Miao, Z. (2019). Face recognition with single sample per person using HOG– LDB and SVDL. Signal, Image and Video Processing, 13(5), 985-992. https://doi.org/10.1007/ s11760-019-01436-1

Wang, L., Xiao, L., Liu, H., & Wei, Z. (2014). Variational Bayesian method for retinex. IEEE Transactions on Image Processing, 23(8), 3381-3396. https://doi.org/10.1109/TIP.2014. 2324813

Wang, M., & Deng, W. (2021). Deep face recognition: A survey. Neurocomputing, 429, 215-244. https://doi.org/10.1016/j.neucom.2020.10.08

Xue, S., & Ren, H. P. (2021). Single sample per person face recognition algorithm based on the robust prototype dictionary and robust variation dictionary construction. IET Image Processing, 16(3), 742-754. https://doi.org/10.1049/ipr2.12381

Yang, M., Van Gool, L., & Zhang, L. (2013). Sparse variation dictionary learning for face recognition with a single training sample per person. In Proceedings of the IEEE International Conference on Computer Vision (pp. 689-696). https://doi.org/10.1109/ICCV.2013.

Yang, M., Wen, W., Wang, X., Shen, L., & Gao, G. (2020). Adaptive convolution local and global learning for class-level joint representation of facial recognition with a single sample per data subject. IEEE Transactions on Information Forensics and Security, 15, 2469-2484. https://doi.org/10.1109/TIFS.2020.2965301

Ye, M., Cheng, Y., Lan, X., & Zhu, H. (2019). Improving night-time pedestrian retrieval with distribution alignment and contextual distance. IEEE Transactions on Industrial Informatics, 16(1), 615-624. https://doi.org/10.1109/TII.2019.2946030

Ye, M.-J., Hu, C.-H., Wan, L.-G., & Lei, G.-H. (2021). Fast single sample face recognition based on sparse representation classification. Multimedia Tools and Applications, 80(3), 3251-3273. https://doi.org/10.1007/s11042-020-09855-w

Yi, J., Mao, X., Chen, L., Xue, Y., Rovetta, A., & Caleanu, C.-D. (2015). Illumination normalization of face image based on illuminant direction estimation and improved retinex. PloS One, 10(4), e0122200. https://doi.org/10.1371/journal.pone.0122200

Yue, H., Yang, J., Sun, X., Wu, F., & Hou, C. (2017). Contrast enhancement based on intrinsic image decomposition. IEEE Transactions on Image Processing, 26(8), 3981-3994. https://doi.org/10.1109/TIP.2017.2703078

Zeng, J., Zhao, X., Gan, J., Mai, C., Zhai, Y., & Wang, F. (2018). Deep convolutional neural network used in single sample per person face recognition. Computational Intelligence and Neuroscience, 2018(1), 3803627. https://doi.org/10.1155/2018/3803627

Zeng, J., Zhao, X., Qin, C., & Lin, Z. (2017, December). Single sample per person face recognition based on deep convolutional neural network. In 2017 3rd IEEE International Conference on Computer and Communications (ICCC) (pp. 1647-1651). IEEE. https://doi.org/10.1109/ CompComm.2017.8322819

Zhang, Q., Yuan, G., Xiao, C., Zhu, L., & Zheng, W. S. (2018, October). High-quality exposure correction of underexposed photos. In Proceedings of the 26th ACM International Conference on Multimedia (pp. 582-590). https://doi.org/10.1145/3240508.3240595

Zhang, Y., Hu, C., & Lu, X. (2019). IL-GAN: Illumination-invariant representation learning for single sample face recognition. Journal of Visual Communication and Image Representation, 59, 501-513. https://doi.org/10.1016/j.jvcir.2019.02.007

Zhang, Z., Zhang, L., & Zhang, M. (2021). Dissimilarity-based nearest neighbor classifier for single-sample face recognition. The Visual Computer, 37(4), 673-684. https://doi.org/10.1007/ s00371-020-01827-3

Zhuang, P., Li, C., & Wu, J. (2021). Bayesian retinex underwater image enhancement. Engineering Applications of Artificial Intelligence, 101, 104171. https://doi.org/10.1016/j.engappai.2021. 104171

Downloads

Published

31-07-2025

How to Cite

Siddique, M. T., Venkat, I., Newaz, S. H. S., & Tajuddin, S. (2025). Robust Single Sample Per Person Face Recognition with Probabilistic Illumination Enhancement. Journal of Information and Communication Technology, 24(3), 90-112. https://doi.org/10.32890/jict2025.24.3.5

Research impact

Harvested 2026-09-05
0 citations recorded so far

Counts differ between services because each indexes a different body of literature. None of them is the whole picture.

Identifiers DOI 10.32890/jict2025.24.3.5 OpenAlex W4412815008 Scopus 105017654299