I think the reversion back to normal after taking off the Red Kryptonite right was a bit too fast. It was almost instant. I don't remember it being that fast.
After all, it takes him a bit longer to recover from the Green Kryptonite . . . why not the red too?