Personally, I'm one of those believers that say you can't have too many forage fish if predators are present. I would prefer for my top of the line fish to simply "yawn", and have something accidentally swim in there.

You do face an issue with 4"+ fish, you may need to target larger panfish & crappie down the line since a HSB has a smaller mouth size.