|
Breaking Down Language Models| title | Breaking Down Language Models |
|---|
| start_date | 2024/02/29 |
|---|
| schedule | 12h-13h |
|---|
| online | no |
|---|
| location_info | Amphithéâtre Jaurès |
|---|
| summary | Language models are the only thing we have in natural language processing that could be considered scientific.” A collaborator of mine said this more than a decade ago, long before LMs emerged as the single most important technology to come out of our field. In these exciting times, I seek both to make the study of LMs more scientific, and to make LMs more practically beneficial. In this talk, I’ll first draw from recent work from my UW group that starts to tackle questions about LMs that could help “break them down” for a deeper scientific understanding. Then I’ll turn to some developments that try to broaden the usefulness of language models by literally “breaking them down” into more modular components. Finally, I’ll shamelessly advertise some newly delivered artifacts that I believe will help the research community make progress on both of these directions and more. |
|---|
| responsibles | Loureiro, Lorenzi, Peyré, Biroli, Mallat |
|---|
Workflow history| from state (1) | to state | comment | date |
|---|
| submitted | published | | 2024/02/15 13:01 UTC |
| |
|