I don't think so, and here's why.
You're actually just selecting for pure fitness. What's the worst that can happen? If your growth rates decrease, or if one particular species starts to get difficult to catch you can change your tack.
The way I see it, all you're doing is making the rich richer--and that's a good thing. Good genetics management, and good management for "matching" your particular fish to your particular environment.
