Capacitive facial activity measurement

Authors

  • Ville Rantanen Tampere University of Technology
  • Pekka Kumpulainen Tampere University of Technology
  • Hanna Venesvirta University of Tampere
  • Jarmo Verho Tampere University of Technology
  • Oleg Spakov University of Tampere
  • Jani Lylykangas University of Tampere
  • Akos Vetek Nokia Research Center
  • Veikko Surakka University of Tampere
  • Jukka Lekkala Tampere University of Technology

DOI:

https://doi.org/10.21014/acta_imeko.v2i2.121

Abstract

A wide range of applications can benefit from the measurement of facial activity. The current study presents a method that can be used to detect and classify the movements of different parts of the face and the expressions the movements form. The method is based on capacitive measurement of facial movements. It uses principal component analysis on the measured data to identify active areas of the face in offline analysis, and hierarchical clustering as a basis for classifying the movements offline and in real-time. Experiments involving a set of voluntary facial movements were carried out with 10 participants. The results show that the principal component analysis of the measured data could be applied with almost perfect performance to offline mapping of the vertical location of the facial activity of movements such as raising and lowering eyebrows, opening mouth, raising mouth corners, and lowering mouth corners. The presented classification method also performed very well in classifying the same movements both with the offline and the real-time implementations.

Author Biographies

Ville Rantanen, Tampere University of Technology

Sensor Technology and Biomeasurements, Department of Automation Science and Engineering

Pekka Kumpulainen, Tampere University of Technology

Department of Automation Science and Engineering

Hanna Venesvirta, University of Tampere

Research Group for Emotions, Sociality, and Computing, Tampere Unit for Computer-Human Interaction, School of Information Sciences

Jarmo Verho, Tampere University of Technology

Sensor Technology and Biomeasurements, Department of Automation Science and Engineering

Oleg Spakov, University of Tampere

Research Group for Emotions, Sociality, and Computing, Tampere Unit for Computer-Human Interaction, School of Information Sciences

Jani Lylykangas, University of Tampere

Research Group for Emotions, Sociality, and Computing, Tampere Unit for Computer-Human Interaction, School of Information Sciences

Akos Vetek, Nokia Research Center

Media Technologies Laboratory

Veikko Surakka, University of Tampere

Research Group for Emotions, Sociality, and Computing, Tampere Unit for Computer-Human Interaction, School of Information Sciences

Jukka Lekkala, Tampere University of Technology

Sensor Technology and Biomeasurements, Department of Automation Science and Engineering

Downloads

Published

2014-01-15

Issue

Section

Research Papers