The Bayesian Online Natural Gradient (BONG) is a principled approach to online learning of overparametrized models, combining Bayesian inference with natural gradient descent. It aims to address the ...