I am thinking the (unrealistic) fear with excessive amounts of concrete is Calcium Hydroxide (Hydrated Lime) leaching out. Hydrated Lime, on it's own will raise pH very quickly to lethal levels when spread in a pond....I do not see that likely happening, over years, from broken concrete, however.