I would consider at least 2 ponds, if not 3 ponds.

The kids could target one pond - they could swim in it, play in it, and fish in it.

Adults (and children at times) could target a second pond for say largemouth bass.

Alternatively, you could have 2 adult ponds, and alternate fishing between them, or fish one and manage the other for 2-3 years before wetting a line in it.