Drue, being an absentee landowner can be tough for the very reasons that you have listed. You have choices to make. Either sell the place which isn't a bad option or try to control access. Controlling access can be a never ending battle. My problems were like yours with the same predator/prey relationship but mostly ended when a lot of people agreed that I was a complete azzhole. I know that it shouldn't be that way but it is and, in some cases, what we consider civilization can have a thin veneer. I've outlasted and/or outlived some of them. Some have changed their opinion of me and others haven't.
If you decide to keep it:
I would PERSONALLY install the game cams that send a pic to your PC. I would have several of them strategically placed and move them frequently. Talk to both the GW and the Sheriff and forward the pics to him/her. Stay in touch and don't forget that the sheriff always needs financial help at election time. Some of the cams will be stolen and/or damaged. That's part of the price. If the Law seems or is reluctant, sell it and move on.
It's not about the fish. It's about the pond. Take care of the pond and the fish will be fine. PB subscriber since before it was in color.
Without a sense of urgency, Nothing ever gets done.
Boy, if I say "sic em", you'd better look for something to bite. Sam Shelley Rancher and Farmer Muleshoe Texas 1892-1985 RIP Grandpa