I think some of those fish are HBG. Possibly contaminated stocking BG and HBG. The HBG would grow faster initially.

Seine and remove most putting back only select quality BG male and female. Start transferring them as soon as weather allows. 5 inches is big enough to move. If you move some now at your location you may get a early fall spawn if moved into a pond not full of BG.