At minimum your pond should be designed with a regular drain and an emergency spillway. Both can be directed to a ditch to run in specific areas to avoid being a problem to the neighbors. If I were them, I would be more than happy to have a drainage area built to direct water flow away from the house in the process.