Back close

A vision system to assist visually challenged people for face recognition using multi-task cascaded convolutional neural network (MTCNN) and local binary pattern (LBP)

Publication Type : Journal Article

Publisher : Journal of Ambient Intelligence and Humanized Computing,

Source : Journal of Ambient Intelligence and Humanized Computing, 14(4), 4329-4341

Url : https://link.springer.com/article/10.1007/s12652-023-04542-8

Campus : Coimbatore

School : School of Computing

Year : 2023

Abstract : Visually impaired people are socially disconnected in situations like face-to-face communication and recognize known individuals. Engaging freely with their sighted counterparts is still challenging and adequate attention is not given to non-verbal communication. This work proposed a compact wearable solution to recognize faces to aid the visually impaired in better social interaction. To address this, we develop a portable embedded device with face recognition capabilities, which facilitates a visually impaired person to recognize faces through the audio feedback system. In preprocessing a hybrid method is proposed for enhancing the visual quality of the face. This is based on LAB color space and Contrast Limited Adaptive Histogram Equalization (CLAHE) with gamma enhancement, accurately recognizing the faces irrespective of various illumination conditions. The efficiency of the proposed methodology is evaluated in a real-time scenario with the following parameters: Process CPU usage, process memory usage, Frame per Second (FPS), Model load analysis, and average CPU load analysis. Experimental results show The MTCNN based LPB uses optimal CPU utilization and improve the accuracy of real-time face recognition.

Cite this Research Publication : Baskar, A., Kumar, T. G., &Samiappan, S. (2023).
. Journal of Ambient Intelligence and Humanized Computing, 14(4), 4329-4341

Admissions Apply Now