I don’t Believe they Reason about Beliefs. Propositional Attitudes in Large Language Models

titleI don’t Believe they Reason about Beliefs. Propositional Attitudes in Large Language Models
start_date2024/12/11
schedule16h30-17h30
onlineyes
location_infosur Zoom
summaryLarge Language Models (LLMs) reveal outstanding linguistic abilities acquired through a simple, general-purpose word-prediction learning objective that allows them to extract huge amounts of knowledge encoded in distributional statistics. These so-called “emerging abilities” apparently include important aspects of pragmatic competence as well, such as for instance mastering indirect speech acts or interpreting figurative expressions. These phenomena are particularly important because they are usually considered to be the hallmark of human language understanding and creativity, and to presuppose sophisticated abilities to represent and reason about belief states. In this talk, I will present evidence from recent research investigating the performance of LLMs in pragmatic tasks. Results will be discussed within the general question of the scope and nature of language understanding in Generative AI.
responsiblesBernard