This question already has an answer here:
- What exactly is an “adverb”? 7 answers
What is the explanation for why we say "I'm going downtown" instead of "I'm going to downtown?"
This question has been asked before and already has an answer. If those answers do not fully address your question, please ask a new question.
"Go downtown" is similar to "go overseas", "go abroad", "go bankrupt", etc., in the sense that while it looks like a noun - and indeed it can act as one occasionally - it usually functions as an adverb.