Jake,
Dig out the hole, backfill with good clay, packed solid with a tamp. Be sure to install an anti-seep collar around your pipe.
I wouldn't use rocks. They aren't as structurally sound as solid packed clay.

Teach a man to grow fish...
He can teach to catch fish...