You are correct. If you have the gun, the clothes and the required license (If it's required - there are exemptions for some landowners), and butcher the animal yourself, it is cheap meat. You'll get roughly 40% of deboned meat from a deer.
Out-of-state hunts is where the $$ start adding up fast.