The term is "magnetic materials."
The question is wrong. The term "a magnet" begs the question of their being magnets in the first place.
Materials that can create magnets are, themselves, to given degrees, "magnetic materials."
Thus we have the situation in which a magnetic material may display no obvious signs of magnetism, or be aan exceptionally powerful magnet. They are both the same "magnetic material."
The context given is very poor and not ambiguous at all: in the wall there is a magnetic material - it may be magnetised or not, i.e. a magnet or not.
With a known magnet, A, it is exceptionally difficult to say whether what is being attracted is another very weak magnet or simply an unmagnetised piece of magnetic material.
There is more on magnetic materials at https://www.first4magnets.com/magnetic-materials-i156