Jimmy,
The rye grass will help, won't hurt anything, but unless it is seeded very thickly, it won't help as much as you need. The rye grass stem is very thin and doesn't have much of root system. Native grasses like bermuda are much better. It would help to mix some clover (like crimson clover) and/or small grain such as oats in with it. A side benefit to small grains is that deer love them also. You could begin to plant it now, but without moisture it won't do much.
Better still, in my experience, is to spread old hay around the areas you want to protect. By next spring it will not only have provided protection, but also provide grass seeds and mulch to get things going quickly.