There are actually a lot of words that fit your explanation! Although the correct one or the one that you're looking for may depend on the context, and they're all various parts of speech.
The best one, I think, would be:
minutiae, noun: precise details; small or trifling matters (Dictionary.com)
"you've forgotten the big picture- you're just focusing on the minutiae"
Another possibility is:
trivial, adj.: of little worth or importance (Merriam Webster)
For your word, it would be the plural version, trivialities.
There are also some verbs you could use as well. One thing that my mother (all too much, in my opinion), used to accuse me of was nitpicking. It's rather informal, and not quite the perfect word for your situation, but:
nitpicking, verb: giving too much attention to details that are not important, especially as a way of criticizing (Cambridge)
Another verb, with a similar meaning, would be
pettifogging, verb: placing undue emphasis on petty details; petty or trivial (Oxford Languages)
Another way to put it is to tell your opponent that they are engaging in pedantry, or focusing on the pedantic details,
pedantry, noun: slavish attention to rules, details (Dictionary.com)
And finally, of details,
petty, adj.: having little or no importance or significance (Merriam Webster)
As I was writing this, other people answered, so there may be some that overlap.