They look best with pants however white based would work with shorts as well. An all black also with shorts.
Either one is acceptable IMO. I like the look with either but if it's 100 degrees out, I'm wearing shorts!
i think it depends on the color. some colors wouldn't look right with shorts. but some colors would look just fine.