The pond doesn't have to get muddy. Any large rain related rise will put them off their feed for a day or two. It may be other food washing in, scattering the fish, or the changes in water chemistry caused by the addition of fresh rain water.