This can be called a pidgin, defined by Merriam-Webster as:.
a simplified speech used for communication between people with different languages
Individual loanwords from another language, used in a way most would not consider correct, are slang. If they’re deemed correct within a small community, they’re jargon. A polite term for less-than-fluent English is ESL (from “English as a second language”).
If the people’s children grow up speaking it, and it becomes a real language, linguists call it a creole or dialect instead. You might also hear, lingua franca, but this has multiple meanings.