I follow your thought process of common sense culling...as long as the neighbor has that same sense. That's part of the fun of having a pond and being the decision maker.

Teach a man to grow fish...
He can teach to catch fish...