I went from a 4mm blade to another 4mm blade so it was fine, although the new blade was a StepSteel, which had the added height to get used to which wasn't an issue for me.
They say when you switch from a 4mm to 3mm, usually you'll need to get a new skate cut hollow too in order to adjust with your new blades/skates.