Decoding of emotional responses to user-unfriendly computer interfaces via electroencephalography signals

Authors

  • Natsue Yoshimura Tokyo Institute of Technology
  • Osamu Koga Tokyo Institute of Technology
  • Yu Katsui Tokyo Institute of Technology
  • Yousuke Ogata Tokyo Institute of Technology
  • Hiroyuki Kambara Tokyo Institute of Technology
  • Yasuharu Koike Tokyo Institute of Technology

DOI:

https://doi.org/10.21014/acta_imeko.v6i2.383

Abstract

When a user interacts with an interface such as a computer, its effects on specific biosignals may reflect emotional responses to the interface, providing a means to evaluate usability. Towards the development of an interface that can adapt its usability based on the user’s emotions, here we decoded electroencephalography (EEG) activity occurring during interaction with a user-unfriendly interface. Participants performed target-reaching tasks while irregular transformations were applied to cursor motion to induce frustration. Our results showed that differential signals from the frontal electrodes (AF3-AF4) were sufficient to classify between brain activities during transformed (frustrated) and normal cursor motion (non-frustrated). Functional magnetic resonance imaging during the same tasks showed significant activations in the middle frontal gyrus, orbitofrontal gyrus, and inferior parietal cortex, areas found to be related to negative emotions. Altogether, these results suggest that the usability of an interface can be measured from EEG signals, which could aid in the development of adaptive interfaces that increase its intuitiveness. 

Author Biographies

Natsue Yoshimura, Tokyo Institute of Technology

Laboratory for Future Interdisciplinary Research of Science and Technology

Osamu Koga, Tokyo Institute of Technology

Laboratory for Future Interdisciplinary Research of Science and Technology

Yu Katsui, Tokyo Institute of Technology

Laboratory for Future Interdisciplinary Research of Science and Technology

Yousuke Ogata, Tokyo Institute of Technology

Laboratory for Future Interdisciplinary Research of Science and Technology

Hiroyuki Kambara, Tokyo Institute of Technology

Laboratory for Future Interdisciplinary Research of Science and Technology

Yasuharu Koike, Tokyo Institute of Technology

Laboratory for Future Interdisciplinary Research of Science and Technology

Downloads

Published

2017-07-21

Issue

Vol. 6 No. 2 (2017)

Section

Research Papers

License

Authors who publish with this journal agree to the following terms:

  • Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
  • Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
  • Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).