It would seem to me that a fish that is being caught on the same food it is expected to eat to grow is going to less aggressively feed on the food which will lead to it eating less of it and growing less rapidly...

I truly believe fish like humans, like dogs, like deer have different temperaments. Just like some dogs are more aggressive to bite, just like some bucks may be more apt to fight and come into a set of rattling antlers, some LMB, BG etc are more aggresive and will react differently to being caught multiple times.

The same as the buck who comes into rattling antlers or estrous doe bleat and the hunter just misses him or he spooks before the hunter gets a shot. He is going to be more wary next time he comes into the sounds of a fighting buck or estrous doe... This may mean he breeds less does in the long run. However, some bucks are just more aggressive, don't learn and get shot... So in the long run, that more timid buck may breed more does.

The question becomes how much to multiple bad experiences a fish experiences before it causes them to become so timid that it affects the amount of pellets it takes in.