Limestone comes in all densities , some hard some soft. So how much it dissolves is dependent on its density and the acidity of the water it is eroded by. While it may not make a measurable difference in pond alkalinity (measuring ph is to variable) it will help the crustaceans (shrimp , craws and scuds ) who feed on or near it with shell strength and formation (especially in acidic water).