If he has your password, he can change every aspect of your account, email, security question, with a couple clicks.