This question already has an answer here:
- Words that are pluralized in the middle? 5 answers
Why is it "runners-up", as opposed to the naïve "runner-ups"?
Is there a rule to remember for these situations?
The hyphenate runner-up contains a noun and an adverb/preposition. Only nouns can be pluralized. Since it is still hyphenated, the parts maintain their grammatical value.