Cambridge has
Cambridge spot:
a particular place
In the case where we say "let's go to that spot", we clearly have a choice, so would not choose an unpleasant place; this implies that in this usage the spot is at least acceptable, and probably pleasant.