Believe it or not, I find myself doing fine even in negative temps - it's the wind on exposed skin that can do some damage in a hurry and that I loathe.
Another bonus of temps 20 and below....most a-holes stay home/indoors - so one has a place on the planet largely to oneself. No loud motorcyles, no screaming kids in the neighborhood, no incessantly barking dogs, no subwoofers booming in a teenager car. It's an overlooked benefit in my book...the silence.
I fear the end is nigh, however - we have 50s scheduled all next week. Buh bye ice fishing and solace.