I think hay bails and silt fencing would certainly reduce the risk. Lightly tilling the lime and fertilizer into the soil may also help with run off.

What species of grass are you planting?