get a new one in a smaller size
I had the same problem but on the advice of a colleague started to use the number below. Although a little tight at first, then reveals a better overall behavior.
I agree 100% with Tar Heel - done it the same way for years. I even built a velcro strip attached to a caribiner clip to let my gloves dry a bit between wearings during a round. Afterward, they are stored in a ziplock bag.
Hmm. What glove are you using? Maybe try a different style FJ glove, or even a Titleist glove.