I feel you. It's frustrating not owning a huge tract of land where you can actually manage your own herd in a sense, so we make the best of it we can. I am truly a meat hunter and have shot one rack buck ever, that being my 8 point last year. He was a nice sized deer body-wise but his rack, while very nicely shaped and very symmetrical, could have stood another year or two and he'd have been a gorgeous mount with decent mass. As it was, though, I knew there was little chance of him surviving another season and figured I might as well be the guy to shoot him. We had him mounted and he now hangs in my son's room.
I do not like to hunt too hard and the high number of does makes it easy to know we're going to get at least a few deer in the freezer each season with just a bit of effort.