Yes, but catfish eat mussels, so they are really turning all that phytoplankton and zooplankton into what you really want.

Also, mussels are indicators of aquatic health. If they are present in your pond, it is a good bet that the water isn't too badly polluted.

Short answer is that I wouldn't worry about them being in my pond.