It depends on the current status of your population (% of carrying capacity being used). It is a challenge anytime one has been using feeding or fertilization to increase pond productivity to stop unless you manage the downward shift in food supplies. Your case is a little different in that many of the big food eaters have been otter harvested. It may be that enough reduction has happened so that the pond at normal production (no fert or feeding) could carry the fish there.