Article : Real-Time Implementation of Face Recognition and Emotion Recognition in a Humanoid Robot Using a Convolutional Neural Network

Dwijayanti, Suci and Suprapto, Bhakti Yudho (2022) Article : Real-Time Implementation of Face Recognition and Emotion Recognition in a Humanoid Robot Using a Convolutional Neural Network. IEEE Access, 10. pp. 89876-89886. ISSN 2169-3536

Text (Article IEEE Access Real time) Real-Time_Implementation_of_Face_Recognition_and_E_230501_155126.pdf - Published Version Download (2MB)

Abstract

Robots can mimic humans, including recognizing faces and emotions. However, relevant studies have not been implemented in real-time humanoid robot systems. In addition, face and emotion recognition have been considered separate problems. This study proposes a combination of face and emotion recognition for real-time application in a humanoid robot. Specifically, face and emotion recognition systems are developed simultaneously using convolutional neural network architectures. The model is compared to well-known architectures, such as AlexNet and VGG16, to determine which is better for implementation in humanoid robots. Data used for face recognition are primary data taken from 30 electrical engineering students after preprocessing, resulting in 18,900 data points. Emotion data of surprise, anger, neutral, smile, and sad are taken from the same respondents and combined with secondary data for a total of 5,000 data points for training and testing. The test is carried out in real time on a humanoid robot using the two architectures. The face and emotion recognition accuracy is 85% and 64%, respectively, using the AlexNet model. VGG16 yields recognition accuracies of 100% and 73%, respectively. The proposed model architecture shows 87% and 67% accuracies for face recognition and emotion recognition, respectively. Thus, VGG16 performs better in recognizing faces as well as emotions, and it can be implemented in humanoid robots. This study also provides a method for measuring the distance between the recognized object and robot with an average error rate of 2.52%.

Item Type:	Article
Subjects:	T Technology > TK Electrical engineering. Electronics Nuclear engineering > TK7800-8360 Electronics > TK7816.P39 Electronics
Divisions:	03-Faculty of Engineering > 20201-Electrical Engineering (S1)
Depositing User:	Mr. Bhakti Suprapto
Date Deposited:	01 May 2023 13:55
Last Modified:	01 May 2023 13:55
URI:	http://repository.unsri.ac.id/id/eprint/98709

Actions (login required)

View Item