Is the former less common for native English speakers because it kinda sound like I done? I'm basing this assumption on Ngrams. But I may be wrong.
Example sentences:
Plus, I was ashamed to admit, I'd done nothing for the club so far.
Plus, I was ashamed to admit, I had done nothing for the club so far.