Capacitive facial activity measurement

Ville Rantanen, Pekka Kumpulainen, Hanna Venesvirta, Jarmo Verho, Oleg Spakov, Jani Lylykangas, Akos Vetek, Veikko Surakka, Jukka Lekkala


A wide range of applications can benefit from the measurement of facial activity. The current study presents a method that can be used to detect and classify the movements of different parts of the face and the expressions the movements form. The method is based on capacitive measurement of facial movements. It uses principal component analysis on the measured data to identify active areas of the face in offline analysis, and hierarchical clustering as a basis for classifying the movements offline and in real-time. Experiments involving a set of voluntary facial movements were carried out with 10 participants. The results show that the principal component analysis of the measured data could be applied with almost perfect performance to offline mapping of the vertical location of the facial activity of movements such as raising and lowering eyebrows, opening mouth, raising mouth corners, and lowering mouth corners. The presented classification method also performed very well in classifying the same movements both with the offline and the real-time implementations.

Full Text: