I think Dave has it right. When feed is used supplementally, as in our ponds, I don't notice a difference in taste. A steady diet of feed only might be another story.
While we're on the subject, I'm going to throw this out there, keeping in mind that "taste" is objective, and opinions vary widely from one person to another....
There are three species of fish that I have eaten, and tend to lump together under the category of "fish for folks who don't like the taste of fish".... and those would be Crappie, Rainbow trout, and Tilapia. To me, these three taste like whatever you cooked them in....not like fish. To be fair, I have never eaten a wild Tilapia, so I admit that my analysis is incomplete there. When I eat fish, I like to know that I'm eating fish...not just breading, or butter, or seasonings....I think such things should enhance the flavor of the fish, not overpower it, and to do that there needs to be a "base" of fish flavor present.
Again, that's just my take on it. For me, Bluegill is the fish of choice...not overpowering, but still tastes like......... fish?