I don't see many yellow perch feeding in hot weather either but they show up in the spring and fall. It seems to me there are some of all species that just will not hit pellets for some reason. I had LMB in my old pond but never did see one take pellets. I doubt it is poison related since you do still have some fish.