Alot of people on this site eat fish. Just check out the post under Questions and Observations entitled "Let's Cook!" There is a bunch of recipes for fish there. Mule to answer your question I would agree and say that most store bought fish aren't the greatest. I highly prefer fresh taken from a lake or pond. So I think that maybe the culprit behind the bad-taste rather than that they were pellet fed.

Chris