Large chunks of limestone have very low solubility in fresh water.
However, rip rap that has been quarried, transported, sorted, transported again, and then dumped, is frequently coated with a lot of very fine limestone particles or "rock flour". That stuff is much more soluble due to its tiny particle size.
Like you said, the water level reaching the rip rap could have had a significant impact on the chemistry.