I would use "acting CEO", or in a very formal or serious situation (grave illness, maybe): "CEO pro tem" (short for pro tempore, i.e. for the time being).
If you're looking for a word which can describe the person's role (not title) as a backup to the boss, whether or not the boss is currently absent, then I suggestas @Jaydles suggested in the comments, you can say "he is on standby"; alternatively you could say exactly that: either backup or the more formal understudy (typically reserved for acting/theatre). As in
For example: "The boss' wife is going to give birth any day now, so he's got Sam on standby for him" (or just "Sam is on standby"), or the boss could say "Bob's my backup in case I have to leave early" or "Umberto is understudying me [or is my understudy]".