Not to worry! Catfish are far more shy than bass and bluegill. Unless you have been hand feeding them, they will head for the holes at the slightest disturbance.