|
Facial Expressions of Comprehension| old_uid | 14659 |
|---|
| title | Facial Expressions of Comprehension |
|---|
| start_date | 2017/11/06 |
|---|
| schedule | 14h30-15h30 |
|---|
| online | no |
|---|
| summary | In the past years, automatic recognition of facial expressions has been a popular research topic in the field of computer vision. Recent innovations in the field of affective computing include the investigation of facial expressions in teaching environments, yet to date, none have investigated the multidimensionality of comprehension. Expanding the search to related fields bring us to research in psychology where neuroscience tools matched with computational modeling and experimentation have laid a groundwork for the study of memory and learning specifically about language processing. The automatic recognition of facial expressions has much to offer this interdisciplinary focus since facial expressions play an important role in communicating emotions, allowing access to intentional and affective mental states.
In this presentation, I will discuss work from my dissertation that investigates facial expressions during language comprehension. Subjects were shown general knowledge true/false statements which varied in topic and difficulty while their upper bodies were recorded with the Kinect v2. A principal contribution of my doctoral work is the identification of facial patterns not only during successful recall of target information but unsuccessful recall and expressions used during guessing. In addition to these online measures during the reading of true and false sentences, facial expressions are also analyzed during a feedback stage. This allows for expressions of surprise, acceptance, negation, etc., to improve prediction of when comprehension does or doesn't occur. |
|---|
| responsibles | Contact |
|---|
| |
|