I, personally wouldn't wear a sweater on the course but that's just me. I like where they are now, you think of FJ and you know what products they have and represent, might be difficult to jump into this category.
There are a lot of options for cashmere or wool sweaters outside FJ (large market). You have POLO Golf, Cremuix, Lacoste, Mizuno, Adidas, Nike, Burberry... etc, I don't know if FJ has a place for this type of product, doesn't really seem to blend with what they offer in general...
Would like to hear from Mike/Chris though, always an interesting topic when we want them to jump into a new category of products.