After giving this some thought since it doesn't make sense to put it back in the pond I think I might use a lot of the extra soil for some mounds along pond bank well away from the dam. The family is wanting some weeping willow and maybe cypress trees. Hopefully this is fairly safe -I'm sure the cypress will require some maintenance to keep it from spreading.
You'll find the Willow's can be a nightmare to control, both in and out of the water. Willow spreads by sucker roots, seeds, and, fragmentation! small limbs becoming only a half inch piece from getting chopped up by a lawn mower can grow roots and become dozens of sprouts in just a few days...
I like the looks of Bald Cypress. I also love a big willow. Just makes sure you KNOW you will devote time and resources that can maintain the look wanted.