I agree that you shouldn't piss off locals near your property, especially if you're an absentee land owner.
There does come a time though, when you need to make an example out of a scumbag.
I also find these types of things to be cyclical. You run off some scumbags and have a peace for a while, maybe even a year or two. Then a new crop of scumbags pop up, and you have to repeat the cycle.
kenc, why can't you go and find out who this guy is, and tell him to keep out?