What is the differentiator between these two phrases?
These are not two variants of the same phrase. "Of" is simply a preposition.
Similarly, you could encounter "that in which you", "that under which you", "that from which you", and theoretically even "that out from behind which you". The possibilities are (almost) endless!