This question already has an answer here:
- What exactly is an “adverb”? 7 answers
What is the explanation for why we say "I'm going downtown" instead of "I'm going to downtown?"
"Go downtown" is similar to "go overseas", "go abroad", "go bankrupt", etc., in the sense that while it looks like a noun - and indeed it can act as one occasionally - it usually functions as an adverb.