Degeneracies are sticky for SGD

Published in AI alignment forum, 2024