Face Detection and Recognition of the Seven Emotions via Facial Expression: Integration of Machine Learning Algorithm into the NAO Robot

Document Type

Conference Proceeding

Publication Date



This study revolves around NAO, a programmable and interactive robot, to do Emotion Recognition via Facial Expression, and to give an appropriate response for the identified emotion whilst accumulating images to further enhance the accuracy. To develop this cohesive system, the authors utilized Computer Vision and Haar-Cascade Classifier along with the feature descriptors, Histogram of Oriented Gradient and Local Binary Pattern to train the Support Vector Machine Learning Algorithm. Gathering and increasing data with Asian/Filipino participants whilst being added to the CK+ database in different stages of retraining, optimization, and undertaking cross-fold validation yielded improved results with the highest average accuracy across the seven emotions of 87.14%. Suggesting that adding images with a specific ethnicity yields a higher accuracy model for a more diverse testing dataset and in the wild image classifications. With the machine learning model capable of accurately recognizing the emotion and reinforcing it with the accumulated local images, NAO equipped with emotion recognition capabilities can better aid and support the individuals in need.