The problem, is that I used "Illegal Machine" (the name I want to be publicly displayed) as the login name, and "Dave" as the Publicly displayed name. So I was tried to start a new user with Illegal Machine as the publicly displayed name, but can't use it because it was already used as the login name on my other user.
Quite a pickle.