Wow I have a 1 acre pond and never would have thought I could have 6 pound bass in it? Sounds like you have a nice LMB pond. Lets do some math here.
Most 6 pound bass are real close to 22 inches long. So that means that bass would prefer a 6 to 7 inch fish to eat. The only reason a 7 inch BG won't get ate is because it may be to tall to fit in the LMB mouth but he will sure try if he has to.

And if you have a bunch from 2.5 lbs and one or two 6ers man you are going through BG like no ones buisness!!
A 3lbs bass is right around 17 to 18 inches one third of that is 5 to 6 inches so it's no wonder you don't have any BG left. It's time to start grilling some of those bass!!

Keeping a few won't hurt. If you want some bigger BG I would get rid of a few of the larger bass. If you leave all the 4, 5 and 6 pounders in there you may never get any bigger BG in there again! What a terrible thing to have a pond full of HUNGRY and BIG LMB!! Dang it!!