Well, Wicked, you may just have to live with it. You are putting about max. 20 amp-hrs. back into the battery on a good bright day. It will get less as the season progresses. You should still get 2 or 3 hrs. out of it a night. That is a pretty good feeding time. Bugs get going good from about 9 til midnight. Re-charge it weekly and get one good all nighter out of it.
It looks to me like the angle is a little low on the panels. Point it at the 11AM sun(actually 10am sun time. You will get all of the morning sun and not directly facing the hot 4-6pm sun.
Afternoons are more often cloudy, also. Notice some roadside blinking signals or speed monitors panels.
I will edit this somewhat. Note the time it turns on. If it is before the bugs get flying good, you may have to point more toward the afternoon sun to maximize the late afternoon exposure, and cause it to kick on later.