It will only leach if your water is acidic enough. The threshold of PH where this begins is rather high, but after all it is how caves are made.
Personally the addition of Limestone to very acidic waters in acid-rain ponds in the mountains should tame them fairly well converting acid to alkalinity.
