The better and more diverse the food chain you have before you add bigger fish, the better off you'll be. I doubt smallmouth would reproduce in the conditions you describe. Do you want reproduction of your top predator? Not having reproduction offers more control of what's going on in the long run... But you may have to add or remove until you find the balance you want and then periodically add as fish are lost. At least five pounds of FHM and plenty of spawning structure for them would be a good start... Are there other good forage minnows that do well in your area? The more fish you start out with, the more forage fish you'll need. Are you going to supplemental feed?
