Abstract
Emotion is expressed in multiple modalities, yet most research has considered at most one or two. This stems in part from the lack of large, diverse, well-annotated, multimodal databases with which to develop and test algorithms. We present a well-annotated, multimodal, multidimensional spontaneous emotion corpus of 140 participants. Emotion inductions were highly varied. Data were acquired from a variety of sensors of the face that included high-resolution 3D dynamic imaging, high-resolution 2D video, and thermal (infrared) sensing, and contact physiological sensors that included electrical conductivity of the skin, respiration, blood pressure, and heart rate. Facial expression was annotated for both the occurrence and intensity of facial action units from 2D video by experts in the Facial Action Coding System (FACS). The corpus further includes derived features from 3D, 2D, and IR (infrared) sensors and baseline results for facial expression and action unit detection. The entire corpus will be made available to the research community.
Recommended Citation
Z. Zhang and J. M. Girard and Y. Wu and X. Zhang and P. Liu and U. Ciftci and S. Canavan and M. Reale and A. Horowitz and H. Yang and J. F. Cohn and Q. Ji and L. Yin, "Multimodal Spontaneous Emotion Corpus for Human Behavior Analysis," Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2016-December, pp. 3438 - 3446, article no. 7780743, Institute of Electrical and Electronics Engineers, Dec 2016.
The definitive version is available at https://doi.org/10.1109/CVPR.2016.374
Department(s)
Computer Science
International Standard Book Number (ISBN)
978-146738850-4
International Standard Serial Number (ISSN)
1063-6919
Document Type
Article - Conference proceedings
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2023 Institute of Electrical and Electronics Engineers, All rights reserved.
Publication Date
09 Dec 2016
