Keep a written record of any statements, threats or otherwise made by your neighbor & your replies to him.
Written journals are admitable evidence in court & weigh heavily in your favor balanced against his verbal acounts of whatever occured.
I don't think there is very much can be done by any official until a law is broken.
