The term "maiden name" is only used to describe the name that a woman had before marriage, and as such, is not gender neutral. However, it occasionally occurs that a man will take his partner's last name, or they will choose a different last name altogether, so this doesn't work in all cases.
What is a gender-neutral way to refer to a last name that you had before you were married, in fewer words?