As someone who has watched a lot of subtitled Japanese animation, it seems odd to hear a word such as ninja (used in the plural) in the dialogue and see it transliterated as ninjas.

It somehow seems better to me to treat ninja just like antelope, bison, buffalo, caribou, deer, elk, fish, grouse, quail, reindeer, sheep, swine, etc., which are both singular and plural.