Yes, it's an old form of saying "going to" (also used where today we might just say "going").
Examples of usage:
"In my part of Brooklyn, we always said we were going "over New
York" (never, as people in Queens said, "to the City")" (Robert
Snyder, Transit Talk: New York's Bus and Subway Workers Tell Their
"i had to pay $17 to park for a hour inside the garage couldn't find
parking on street to much of a hassle to continue going over
Philadelphia" (RateMDs review, April 22, 2015)
"A man will be coming over town and he will say, 'You going over
town, Bob?' Whether I am going over town or not I always say
yes" (Northwestern Mutual Life Insurance Company Field Notes,
"'Where on earth are you going?' 'Over home,' said Eunice." (Lucy
Maude Montgomery, Avonlea Chronicles, 1912)
"I am going over home directly after breakfast to give out meal
and corn." (Send Me a Pair of Old Boots & Kiss My Little Girls: The
Civil War Letters of Richard and Mary Watkins, 1861-1865, Jeff
Note that the penultimate quote is by a Canadian, and the last was from a set of letters between a Virginia couple, so this usage apparently extended at least all up and down the eastern side of North America. Also, if that internet doctor review is not a typo of some sort, it may still be in current usage among some individuals/in some areas.
As for "going over home" in this particular sense, I believe it is the (not uncommon) practice of equating the afterlife and specifically "heaven" with "home". For comparison:
"In Remembrance of W.L. Clifton. . . . He prayed to see me, his only
sister, before he died. I arrived there on Wednesday before he passed
away Sunday. He said all was ready, he was only going over home."
(People and Things from the Walker County, Alabama Jasper Mountain
Eagle (1910 - 1913), Robin Sterling, ed.)