I've seen deer directly downwind of my car where I park to hunt. The car smell doesn't bother them, but when I walk to the car after hunting they get spooked, even after dark. I shower on a regular basis, so it can't be that.
I think deer that are around people or people activity get to know what's a harmful scent and what's not.