Dec 19, 2024
On a geometric problem of machine learning
Algebraic Geometry and Number Theory Seminar
Date: December 19, 2024 |
1:00 pm –
3:00 pm
Speaker:
Richard Rimanyi, University of North Carolina at Chapel Hill
Location: Office Bldg West / Ground floor / Heinzel Seminar Room (I21.EG.101)
Language:
English
In this talk we will enumerate the main reasons for a collection of matrices multiplying to 0. Our motivation is Bayesian Learning Theory, where one of the goals is to progressively approximate an unknown distribution using data generated from that distribution. A key component in this framework is a function K (relative entropy), which is often highly singular. The invariants of the singularities of K (in the style of log canonical threshold') are related to how well the Singular Learning Theory "generalizes"—or, in Machine Learning terms, how efficiently the model can be trained. Computing the singularity invariants in real-life scenarios of Machine Learning is notoriously difficult. In this talk, we focus on an elementary example and compute the learning coefficients of Linear Neural Networks. Joint work with S. P. Lehalleur.
