M2A2 - You are in a difficult situation, as you already know. Many fishers think that since they can catch fish they automatically know how to manage them. Not always true.
Several things should happen in your situation in addition to the good advise previously posted.
If the lake does not have a lake association (Lake Board) one should be started. Even if it only meets once or twice a year. Educational information about fish management can be made available at meetings. The association should come to some agreement as the goal or goals for the various fish species. An expert should attend one of the meetings or to help establish, guide, direct and lay out the methods to achieve the goals.
To defend your fishing harvest you need to become educated so you can defend your fish harvest with wisdom and literature. Your fish harvest may need to be refined and limited to better achieve fishery goals for the small lake. You as the main fisherman should keep good catch AND harvest records on every fishing trip. These records will help justify or defend your actions. Do some searching on this forum for 'relative weights' and or 'catch records'.
Be aware that your intensive fishing pressure on the lake may make the catching of some of the species a little more difficult not for you but for the more unskilled, casual anglers.
Be aware that new research of trophy class bluegill and redears indicates that they can be easily overfished by skilled anglers and thus overharvested. Proper harvest is very improtant to maintaing a trophy class bgill fishery.
I recommend that you subscribe to In-Fisherman magazine and make copies of the pertinent "harvest" articles as handouts to the "crying neighbors" and Lake Board menbers in efforts to better educate all involved about current philosophies of proper fish catch, release and harvest for the goals established by the local lake association. Since you are the primary fisherman on this lake you should not be the main JUDGE of what gets harvestred but you should be the main educator, manager and protector of the lake's fishery. Your knowledge, information, frequent sampling and familarity of the fishes in the lake will in the future provide the main indicators for the overall health and vitality of the lake's fishery.
Fish harvest is good, but wise fish harvest is better.
