To me it looks like you have a lot of predators that will eat the baby crappie.
I don't know about the fence idea. I think somebody else said that when bass fry get in there they will ruin it. I you can keep them out it should work.