Many words started out as two separate words: maybe (may be), tomorrow, yesterday, otherwise, and hundreds more, but they are no longer considered compound words.
As JBJ points out, otherwise comes from Old English othre wisan: other manner. Some may seenseem mismatched if we don't know their Old or Middle English roots.