Do you use allophone in replacement of nonnative? And, do you have more expressions meaning nonnative?
Allophone is pretty much only used in that sense in Canada, particularly Quebec, where it means someone whose first language is neither English, French, nor one of the First Nations' languages. (So not including non-natives in Canada who do speak English or French).
It comes up because if you immigrate to Canada and don't speak either of those languages already, then whether you learn one, or the other, or both, will determine how you influence the demographics of a country which is mostly English-speaking, but with a sizeable French-speaking population, particularly in Quebec, making the numbers of such people of political interest.
Outside of Canada the word would only be understood in its more common sense, referring to the precise pronunciation of different phonemes (one of the things that makes foreigners sound foreign).
Even in Quebec, it would generally only be used in regard to those demographic issues, and their political implications.
According to Wiktionary, the word allophone is also used in Canada to refer to people whose native language is not one of the two major languages of Canada, French and English.
I'm not a Canadian, so that usage is not one that is familiar to me. I have been to Canada a few times and do not recall that term being used (and I am the kind of person who talks about language a lot), but perhaps it is just particular to certain parts of Canada where I haven't traveled—perhaps it is a common usage in language-conscious Quebec.