I'm not sure what to tell you. First it was the crayfish for me and then it was the five star moles. I'm thinking the five star moles dig after the crayfish but that's just my theory. I do know I don't have as many crayfish holes as I used to have.
I was told by a pest control business operator taxidermy customer that the local Menards sold something that looked like a nitecrawler but it's toxic to five star moles. He told me to push a hole shut with my heal and if it opens back up it's an active hole. Then drop one of the toxic worms into the hole. I would think this would work for the crayfish too. Just don't let your dog dig one up.
If pigs could fly bacon would be harder to come by and there would be a lot of damaged trees.
If you can catch them, they make great snacks. Find some "crab boil" and drop them in the boiling water for a very short time -- maybe a minute. Just like shrimp -- don't overcook, or they'll get tasteless and tough. Break off the tails, pull out the meat, and dip it in some cocktail sauce made from catchup and horse radish. Yeesh, I just drooled on my shirt.
There are about 400 different kinds of crawfish/crawdads/crayfish in the US. Some are known as "burrowers." They dig down to the water table, and are nocturnal. Those are the kinds that dig the holes in dams and yards. They come out at night to feed.
And I've seen those holes in big open fields not near any water source other than being fairly wet for awhile after a big rain. I know what you mean, TJ. It shocked me when I first learned about that, too. Never imagined crayfish out of a creek, pond, or otherwise.
I have the same thing in my shoreline, creyfish for sure one foggy morning walking the edge I saw a big one excavating mud out of a 4 inch chimney! I had left over degraded limestone & pour it into the holes to the top then heal in the chimney, works good.