I have not heard that clay when fresh will harm fish. Stocking into new clay ponds happens all the time without a problem. Trout may be an issue - did you stock them ?