I would think that if fish that are fed exclusively a commercial diet taste bad, then there would not be much of an aquaculture market. Sounds like a subjective thing to me.
I do know off flavor can be an issue but it has to do with other things besides feed from what I understand. Purging in fresh water for a couple of days usually gets rid of the problem.
There's also an off flavor phenomenon sometimes in catfish production ponds due to a particular type of blue green algae I believe.
https://srac.tamu.edu/index.cfm/event/getFactSheet/whichfactsheet/33/