|
From head nods to gesture units - exploring temporal domains of co-speech gestures and prosody| old_uid | 12369 |
|---|
| title | From head nods to gesture units - exploring temporal domains of co-speech gestures and prosody |
|---|
| start_date | 2016/10/26 |
|---|
| schedule | 10h |
|---|
| online | no |
|---|
| summary | The interaction between prosody and gesture has been receiving growing interest in both the gesture and speech communities. One interesting topic concerns the question of timing of speech and gesture and how to define temporal domains of synchronization. An example of such a domain is the stressed syllable synchronized with a beat gesture involving a hand movement or a head nod. Longer domains can comprise a prosodic phrase coupled to a gesture phrase or a talk spurt accompanied by a gesture unit.
I will present some studies where we have investigated head nods produced by Swedish newsreaders and head nods from spontaneous dialogues recorded with video and motion capture. In both newsreading and spontaneous dialogue, head nods co-occur to a large extent with focal accent. In the spontaneous dialogues, head nods having a beat function and signaling prominence were generally synchronized with the stressed or accented syllable but began on average slightly before the accented syllable.
We have also turned our attention to the longer domain of the gesture unit and looked at coordination between the beginning and end of gesture units and talk spurts. At the beginning of the gesture units, we found considerable individual variation, but there was a general tendency for the talk spurts to slightly precede the gesture unit. This shows a timing trend contrary to that appearing between head motion and the syllable. At the ends of the gesture units, we found that gesture activity ending prior to the end of the talk spurt correlated with turn yielding while gesture continuation after the talk spurt was indicative of turn holding. |
|---|
| responsibles | Contact |
|---|
| |
|