Random Memories

Label noise in SGD

SGD Medium

Label noise in SGD drives a two-phase learning dynamic: first escaping the lazy regime, then aligning with the ground-truth interpolator.