Messy Transitions can lead to Messy Training