IMHO, your big sunfish are factories for free forage. I'd definitely leave them alone. Did you read Dave Willis' pond quiz a couple of issues back? It's very interesting and relevant to your situation. Bass are notorious for their ability to overpopulate, and you as an angler can have a significant impact on bass size structure in a pond this size, especially if you've got boys helping you.
