Zep - it seems to me the way to go is to use pea gravel first, then graduate to the smaller gravel sizes, but I'm certainly no expert.
Around here, pea gravel is the smallest.
I am not saying this as a recommendation(because every area probably does it different) We start with a 3" stone for the base, then a #307 on that(it is a mix of finer stones and dirt). then a #57 to top dress. then the pea gravel if you want that fine, but I don't really like it, good for some areas tho.
They also make a crushed #57 that is nice. Look into a crushed gravel if you go with gravel. Nice because it doesn't roll around. Similar to limestone.