Tim.
I think If you allowed me to come hunt once a week I could scare him off

How many acres you got fenced, how big you grow 'em, 160"? If it makes you feel any better I have two clients with high fence and they too worry about neighbors shooting the deer. One guy stuck up a trail camera pointed towards the neighbors stand across the fence.