In my experience deer could navigate ladders to eat your most treasured plants on the roof. They put in extra effort when they see something in a pot put out just for them. The lengths they have gone through to get at my planted trees blows my mind where there is so much other forage for them to work with.
I saw one paw fencing away from a sapling that I had staked in firmly so it could eat it. Luckily I saw it happen or else there would be nothing of it left. It really wanted the white pine contained within.