At least with bluegill I get lots of practice finding out if I was right or wrong. The filet knife is a good verification device.
I would say that the fish in the photo is 99+% certain of being a male, but I wholeheartedly agree with you that you can never be absolutely sure!
