You should almost never use an apostrophe to indicate a plural. Lowercase single letters used as nouns are a rareThe Chicago Manual of Style says:
Capital letters used as words, numerals used as nouns, and abbreviations usually form the plural by adding s. To aid comprehension, lowercase letters form the plural with an apostrophe and an s.
The lowercase letter exception, presumably exists because omitting the apostrophe can make the sentence much harder to understand (for example, "mind your p's and q's" is much clearer than "mind your ps and qs").
People often misremember this I don't know if the rule and use apostrophes to form plurals for things like single capital letters, abbreviations, numerals, and acronyms/initialismswas different in earlier editions of Chicago, but most style guides don't recommend this. So: "CDs", rather than "CD's"it's very much in keeping with the guide's philosophy of prioritizing clarity and simplicity over prescriptivist rules.