I agree with Mike. Some is good, having none is bad. Keep some native plants. If access is your main goal, open several areas around the pond for access.
If fishing is your main goal, open several areas, then enhance the pond with structure, to congregate fish near your cleared areas.
But, first, find out what types of plants you have and evaluate their role around your pond. You'll be surprised to find out some of your plants improve the pond, rather than detract.

Teach a man to grow fish...
He can teach to catch fish...