Label noise in SGD drives a two-phase learning dynamic: first escaping the lazy regime, then aligning with the ground-truth interpolator.
Random Memories
Label noise in SGD
Random Memories
Label noise in SGD drives a two-phase learning dynamic: first escaping the lazy regime, then aligning with the ground-truth interpolator.