|
Rapture of the deep: highs and lows of sparsity in a world of depths| title | Rapture of the deep: highs and lows of sparsity in a world of depths |
|---|
| start_date | 2023/02/02 |
|---|
| schedule | 12h-13h |
|---|
| online | no |
|---|
| location_info | Amphithéâtre Jaurès |
|---|
| summary | Promoting sparse connections in neural networks is natural to control their complexity. Besides, given its thoroughly documented role in inverse problems and variable selection, sparsity also has the potential to give rise to learning mechanisms endowed with certain interpretability guarantees. Through an overview of recent explorations around this theme, I will compare and contrast classical sparse regularization for inverse problems with multilayer sparse regularization. During our journey, I will notably highlight the role of rescaling-invariances in deep parameterizations. In the process we will also be remembered that there is life beyond gradient descent, as illustrated by an algorithm that brings speedups of up to two orders of magnitude when learning certain fast transforms via multilayer sparse factorization. |
|---|
| responsibles | Lorenzi, Peyré, Mallat |
|---|
Workflow history| from state (1) | to state | comment | date |
|---|
| submitted | published | | 2023/02/02 09:10 UTC |
| |
|