Point-blank, the bullhead are a problem just because of the numbers they can produce and how they disturb bottom sediments. The BG with no predation are going to do basically the same as far as numbers being uncontrolled.
I'm going to guess because of competition, the GSH are maxing out in the 3.5" range and then lifespan is up.
removing BH and BG are 2 of the tougher fish to eradicate.
My recommendation would be to tank as many GSH as you can and then nuke the pond and return your gsh stock. The offspring from your returned fish will be able to grow to larger sizes.