A lot of times, if you're not hooking them, they aren't all that excited about your presentation or the color you're using. Chage it up and try that.
Also, sometimes they may not all be bass. I've caught catfish, carp, bluegills, bullheads, and crappies on rubber worms.
When I fish a worm or craw or creature, I set the hook immediately. They can spit a bait in a blink and if they don't like the taste, or feel you, they'll blow it and you'll swing and miss.
Hope a little of this helps. Nothing more fun than catching them on soft plastics. My suggestion though would be a 1/16th oz crappie jig with a black head and a four inch strait tailed worm. The little hook will hold well and they are surprisingly weedless. Drop down to spinning tackle and 6 or 8 lb. test and watch your line for signs of hits because you won't always feel them. Set on any mushy feel too. I think you'll be surprised.
Good luck and good fishing.
Dan
