Handle the case where we have a user but no email.
This now seems to match properly for all the cases involved. A UserName but no email will match the same username, an email with no UserName will match the same email. But the empty entries never add a match to similar named entries.