Brash people may only understand brash language.. I would walk across and ask exactly what his intentions are and why he felt the need to tell you that/how he told you that. It's possible the neighbors have no bad intentions, just lack normal interpersonal communication skills. Never know what previous neighbor conflicts were or who was right/wrong. I think it's best to know so you can limit your conjecture to reality. Just my $0.02.
