Actually Pertwee was more of a Victorian dandy with his ruffles and bowties etc, I dont think that many people dressed like that in the 60s.

As for McGann, despite the fact he fitted into the wild west, he still would stand out like a sore thumb in any other era.

With the Tennant and Smith costumes, although they do represent an era of sorts, they are certainly not out of place in the modern era as many people dress like that (take Jarvis Cocker as a perfect example), and would not look so outlandish if they travelled to the past.