Abstract
Automatically recognizing facial expression is an important part for human-machine interaction. In this paper, we first review the previous studies on both 2D and 3D facial expression recognition, and then summarize the key research questions to solve in the future. Finally, we propose a 3D facial expression recognition (FER) algorithm using convolutional neural networks (CNNs) and landmark features/masks, which is invariant to pose and illumination variations due to the solely use of 3D geometric facial models without any texture information. The proposed method has been tested on two public 3D facial expression databases: BU-4DFE and BU-3DFE. The results show that the CNN model benefits from the masking, and the combination of landmark and CNN features can further improve the 3D FER accuracy.
Recommended Citation
H. Yang and L. Yin, "CNN Based 3D Facial Expression Recognition Using Masking And Landmark Features," 2017 7th International Conference on Affective Computing and Intelligent Interaction, ACII 2017, pp. 556 - 560, Institute of Electrical and Electronics Engineers, Jul 2017.
The definitive version is available at https://doi.org/10.1109/ACII.2017.8273654
Department(s)
Computer Science
International Standard Book Number (ISBN)
978-153860563-9
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2023 Institute of Electrical and Electronics Engineers, All rights reserved.
Publication Date
02 Jul 2017
Comments
National Science Foundation, Grant CNS-1205664