Tall is the word we use for measuring the vertical height of humans
- He's not tall enough for the part.
and also metaphorically the vertical height of long upright things (which resemble humans in being long and upright)
Sequoias are the tallest tree in North America.
The Empire State Building was once the tallest in Manhattan.
(Mountains are edge cases -- tall mountains seems less likely than high mountains,
though I haven't checked Google.)
High, on the other hand, is the general term, without any inference about the vertical-to-horizontal ratio of the thing described. It figures prominently in metaphors involving vertical scales, like high prices, high red count, high scores, high efficiency. These don't involve actual images of the scale, since a vertical list of numbers doesn't require much imaging.
But tall does require an image, and therefore it's only suitable for special metaphors,
like tall, dark, and handsome or tall tale.