Well think about this. Im trying to build the forage base back up in my pond so ive been adding as many bluregill as possible. If each one eats 5 3" bluegill a day then thats 1800 3 inch bluegill per year for each one. Thats means that those 2 birds are taking out 3600 3" bluegill a year. So you may think they aren't bothering much but that adds up to alot of money when you buying bluegill to add to the pond.
What you say makes sense but here are two points:
1.) Although it happens (as mentioned above) you will very rarely see two birds feeding at one pond, even larger ones.
2.) They don't just eat fish. They have a varied diet of fish, mice, moles, frogs, and crayfish.