If anything, when it becomes a standard joke, that's when its most damaging. Look at Gerald Ford and the jokes about clumsiness when the man was actually very athletic.