Improvement of emotion recognition from facial images using deep learning and early stopping cross validation

Archive ouverte : Article de revue

Bentoumi, Mohamed | Daoud, Mohamed | Benaouali, Mohamed | Taleb-Ahmed, Abdelmalik

Edité par HAL CCSD ; Springer Verlag

International audience. Inthis paper, we present a new approach for emotion recognition from facial images. The proposed method is based on the association of a pretrained convolutional neural network (CNN) model (VGG16, ResNet50) with a multilayer perceptron (MLP) classifier. The pretrained CNN model is used as a feature extractor. For this purpose, we adapt the original architecture by adding a global average pooling layer (GAP) without any fine tuning of the network parameters. In order to avoid overfitting for the MLP classifier, we introduce the early stopping criterion. It is proved that the aforementioned elements contribute in improving the performance of our approach in terms of generalization ability. The procedure for emotion recognition from facial images is applied on the CK+ (extended Cohen-Kanad), JAFFE (Japanese Female Facial Expression) and KDEF (Karolinska Directed Emotional Faces) databases. The k-fold cross validation procedure is used for accuracy estimation. The experimental results show the effectiveness of our facial emotion recognition (FER) approach compared to the existing methods yielding to recognition rates of 100%, 96.40% and 98.78% for the CK+, JAFFE and KDEF databases, respectively. On the other hand, further improvement of our recognition performance is obtained for images from the JAFFE database by performing a data augmentation during the training phase. This allows to achieve an accuracy of 100% for this database. Four other metrics, namely the F1-score, positive and negative likelihood ratios and Mathews correlation coefficient, confirm as well the classification results obtained from accuracy.

Consulter en ligne

Suggestions

Du même auteur

Segmentation and classification of benign and malignant breast tumors via texture characterization from ultrasound images | Benaouali, Mohamed

Segmentation and classification of benign and malignant breast tumors via t...

Archive ouverte: Communication dans un congrès

Benaouali, Mohamed | 2022-05-08

International audience. The present paper deals with breast tumors classification from ultrasound images. The proposed procedure consists of four steps, namely preprocessing, segmentation, feature extraction and cla...

Contribution of interferometry to Vickers indentation toughness determination of glass and ceramic glass | Bentoumi, Mohamed

Contribution of interferometry to Vickers indentation toughness determinati...

Archive ouverte: Article de revue

Bentoumi, Mohamed | 2019

International audience. Cracking resistance or fracture toughness of brittle materials, such as optical glasses, can be determined by Vickers indentation, which allows generating cracks along the diagonals of the in...

Automatic pain estimation from facial expressions: a comparative analysis using off-the-shelf CNN architectures | El Morabit, Safaa

Automatic pain estimation from facial expressions: a comparative analysis u...

Archive ouverte: Article de revue

El Morabit, Safaa | 2021-08-11

International audience. Automatic pain recognition from facial expressions is a challenging problem that has attracted a significant attention from the research community. This article provides a comprehensive analy...

Du même sujet

Pain Detection From Facial Expressions Based on Transformers and Distillation | El Morabit, Safaa

Pain Detection From Facial Expressions Based on Transformers and Distillati...

Archive ouverte: Communication dans un congrès

El Morabit, Safaa | 2022-05-18

International audience. Pain assessment is a challenging problem in the field of emotion recognition. Pain represents a complex emotion difficult to detect or to estimate its intensity. This is what makes automatic ...

Knowledge-based tensor subspace analysis system for kinship verification | Serraoui, I.

Knowledge-based tensor subspace analysis system for kinship verification

Archive ouverte: Article de revue

Serraoui, I. | 2022-07

International audience. Most existing automatic kinship verification methods focus on learning the optimal distance metrics between family members. However, learning facial features and kinship features simultaneous...

A CMOS Compatible Thermoelectric Device made of Crystalline Silicon Membranes with Nanopores | Bah, Thierno-Moussa

A CMOS Compatible Thermoelectric Device made of Crystalline Silicon Membran...

Archive ouverte: Article de revue

Bah, Thierno-Moussa | 2022-12-10

International audience. Herein, we report the use of nanostructured crystalline silicon as a thermoelectric material and its integration into thermoelectric devices. The proof-of-concept relies on the partial suppre...

Effet de l'angle de charge sur les harmoniques d'efforts magnétiques dans les machines synchrones à aimants permanents surfaciques | Le Besnerais, Jean

Effet de l'angle de charge sur les harmoniques d'efforts magnétiques dans l...

Archive ouverte: Communication dans un congrès

Le Besnerais, Jean | 2016-06-07

International audience. Cet article étudie l'effet de l'angle de charge sur les efforts harmoniques de Maxwell (tangentiels et radiaux) et les bruits et vibrations d'origine magnétique dans deux machines synchrones ...

Further investigation of convolutional neural networks applied in computational electromagnetism under physics‐informed consideration | Gong, Ruohan

Further investigation of convolutional neural networks applied in computati...

Archive ouverte: Article de revue

Gong, Ruohan | 2022-04-07

International audience. Convolutional neural networks (CNN) have shown great potentials and have been proven to be an effective tool for some image-based deep learning tasks in the field of computational electromagn...

Thermal and hygroscopic study of hemp concrete in real ambient conditions | Asli, M.

Thermal and hygroscopic study of hemp concrete in real ambient conditions

Archive ouverte: Article de revue

Asli, M. | 2021-04

International audience

Chargement des enrichissements...