That's essentially the same explanation Data gives in "First Contact" for why they remained unchanged when the Borg sphere went back in time and they saw the Earth change.