Although both if and whether can elicit binary answers, if strongly references one option (the stated option) whereas whether references both.
The proposition "I sit next to you" has an implicit negation: "I don't sit next to you". The question "Do you mind?" with reference to this proposition could have 4 possibilities:
I mind that you sit next to me.