Method of Facial Expression Analysis Using Video Phone and Thermal Image

DOI

10.2991/jrnal.2014.1.1.2How to use a DOI?

Keywords

Facial expression analysis, Video phone, Area of mouth and jaw, Thermal image, and Skype

Abstract

To improve the quality of life of elderly people living in a home or healthcare facility, especially in a rural area, we have been developing a method for analyzing the facial expressions of a person using a video phone system (Skype) to speak with another person. In the present study, we proposed a method for analyzing facial expressions of a person using the video phone system to talk to another person. The recorded video is analyzed by thermal image processing and the newly proposed feature vector of facial expression, which is extracted in the mouth area by applying 2D-DCT. The facial expression intensity, defined as the norm of the difference vector between the feature vector of the neutral facial expression and that of the observed expression, can be used to analyze a change of facial expression. The judgment of utterance is performed by using the intensity of the sound wave. The experimental results show the usefulness of the proposed method. We intend to use the proposed method of facial expression analysis to develop a method for estimating the emotions or mental state of people, especially elderly patients.

Copyright

© 2013, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - JOUR
AU  - Yasunari Yoshitomi
AU  - Taro Asada
AU  - Ryota Kato
AU  - Masayoshi Tabuse
PY  - 2014
DA  - 2014/06/30
TI  - Method of Facial Expression Analysis Using Video Phone and Thermal Image
JO  - Journal of Robotics, Networking and Artificial Life
SP  - 7
EP  - 11
VL  - 1
IS  - 1
SN  - 2352-6386
UR  - https://doi.org/10.2991/jrnal.2014.1.1.2
DO  - 10.2991/jrnal.2014.1.1.2
ID  - Yoshitomi2014
ER  -