Your teacher's view is simplistic.
"That tie is the wrong colour for your shirt." The subject is a tie not a person.
"That tie is the incorrect colour for your shirt." The English is OK but but the use of incorrect is strange.
and a bit further ...
"John has done it the wrong way." The subject is a person.
wrong as an adjective
"John has answered incorrectly." The subject is a person.
incorrectly as an adverb (adjectives for verbs)
Following the logic of your teacher's rule we should say "John has answered wrongly." which is incorrect (or wrong).
As with many rules that deal with a varying percentage of English constructions, your teacher's rule does not always apply.