i just worry that maybe its not too many bass at all and its just all not enough food. if i cull too many fish would it have an adverse affect down the roads like in a few years time.
"Too many bass" and "not enough food" are, in most ponds, different expressions of the same idea. Every pond is a little different, and no generalization applies universally, but most would agree that removing every skinny bass you catch, and probably all fish below a certain length, is probably not going to have any adverse effects--keep going until you see them fattening up.
I remove 150-250 annually from a 3 acre pond, and it's really just barely enough.