Is one of the following preferable to the other:
can't afford to (or don't want to)
can't afford (or don't want) to
As far as I know, it's mostly a matter of preference. Personally, I much prefer the former, since it flows better: can't afford to (or don't want to).