Damone,
I am ex-active Coast Guard and now a Coast Guard Auxilirist, I have more hours on the water and in the water than I care to think about. That being said, I always wear a PFD (Personal Floatation Device). Even today while installing an aeration system.
Its not if but when. Even if you know how to swim like myself being a resuce swimmer, you never know if you will hit your head or hurt your self in such a way that all you can do is float with your pfd.
Now with the invention of SOS-spenders, a pfd that looks like suspenders or a pouch type that you wear around your belt, there is no excuses like "they get in my way" or "they are uncomfortable" to not wear them.
Good luck and happy safe boating! Semper Peratus, (Always Ready)