"Many nouns have common prepositions..." dictionary.cambridge.org/grammar/british-grammar/about-nouns/…
"Of" usually follows an example or a cause or to define units of a whole.
There is no determined way to express a noun+preposition combination in a sentence unless there are qualifying modifiers like a possessive pronoun or a verb or a participle following a preposition so "regardless of the noun used" is simply not possible because prepositions are fixed with nouns to be used only in a certain way.
Some people tend to derive psychological aspects of a person from their usage of the language and one of the two forms - of - falls into that category.
For instance, the usage of -- of -- in conjunction with abstract nouns or entities might elicit or qualify for the psychological assessment, when the line "I had to reevaluate my expectations of college" because there is no pronoun to promote the abstract entity into a concrete form of life in which interactions could be judged or are possible is used, without a possessive pronoun for the noun.
Compare it with "I had expectations (or such high expectations) of my college..." which instantly highlights the stress on the word my to trigger a response and therefore, the sentence, because it communicates some intent and elicits a response, makes for a good form of communication.
Basically, your decision-making process must rely on the implicit messages - that crucial factor in effective communication - that your sentence carries.
So, "I had to reevaluate my expectations of college." sounds wrong English or a person suffering from literary malnutrition and may even communicate bad knowledge as the implicit message.
However, "I had to reevaluate my expectations of studying in a college." "I had to reevaluate my expectations of attending college." makes instant, communicative sense.
"I had to reevaluate my expectations of the future." would make sense if it is a reason given to some preceding act (with a because (nonfinite clause) preceding it) but independently used, as in this form, does not carry any value to what you want to communicate.