Lot's of good advice, and food for thought. It's too bad you can't choose your neighbors and unfortunately it seems you are saddled with a moron. I would ignore him completely and pretend he does not exist. Enjoy your land and the lake. Take your family fishing whenever you want, you have the right.
He is probably mostly a blowhard and won't follow through with his threats. Ignore him, he will soon grow tired if he doesn't get a rise out of you and will go back to his petty little existence and his obsessive compulsive need to inventory the gravel on his driveway.
Deep down I like DD's thinking and I can tell you that in my part of the country even a lawyer would have already layed a beatin on him. Still a lot of homestead mentality up here, wild west with a northern twist.
