Is Reverse-Correlation Appropriate for Uncovering (Para)linguistic Inferences from Speech Prosody?

titleIs Reverse-Correlation Appropriate for Uncovering (Para)linguistic Inferences from Speech Prosody?
start_date2025/07/09
schedule11h
onlineno
location_infoamphi Jean-Jacques Gagnepain
summaryReverse-correlation applied to prosody provides a principled method for uncovering the prototypical representations underlying high-level inferences from speech signals. This approach holds promise for studying cross-cultural differences in emotional and social judgments, as well as impairments in individuals with specific pathologies or neurological disorders. However, a critical assumption of this method is that the brain’s inference algorithm can be approximated by linear template-matching—where prosodic judgments arise from comparing speech signals to a single internal prototype via a dot product. This assumption, though foundational, has never been empirically tested. In this talk, I will present two novel approaches to evaluate whether (para)linguistic inferences from prosody are well captured by linear template-matching, using existing published datasets. First, we explore alternative visualization techniques for reverse-correlation data to better discriminate between competing computational models. Second, we categorize trials based on linguistic-theoretical criteria and assess how effectively template-matching explains trial-by-trial responses across different categories. These directions aim to refine our understanding of the computational mechanisms behind prosodic inference and assess the validity of reverse-correlation in this domain.
responsiblesAucouturier, Villain