Like a term for someone you had a falling out with and no longer associate with? I'm looking for something that doesn't still have the term 'friend' in it.
I'd say that is a former friend. [edit, courtesy Papa Poule] or a former pal/chum/compadre
1 Having previously been a particular thing:
her former boyfriend
1.1 Of or occurring in the past:
the seafarers of former times
2 (the former) Denoting the first or first mentioned of two people or things:
I take the former view
You could say
He who shall remain nameless
Hugo the Treacherous (or whatever the person's name is)
This might make for a colorful recounting:
This picture here was taken by Hugo the Treacherous.
I had a housemate who referred to her ex as Shithead. She refused to refer to him by name.
I went there once with Shithead.