I can't understand what the sentence "You never came and you never went" is related to. Does it clarify the previous utterance or is it a new thought which says that the person has never been anywhere? The source is Eudora Welty's story called "A visit of charity".
Here is the context:
"Hush!” said the sick woman. “You never went to school. You never came and you never went. You never were anything—only here. You never were born! You don’t know anything. Your head is empty, your heart and hands and your old black purse are all empty—you showed it to me. And yet you talk, talk, talk, talk, talk all the time until I think I’m losing my mind! Who are you? You’re a stranger—a perfect stranger! Don’t you know you’re a stranger? Is it possible that they have actually done a thing like this to anyone—sent them in a stranger to talk, and rock, and tell away her whole long rigmarole? Do they seriously suppose that I’ll be able to keep it up, day in, day out, night in, night out, living in the same room with a terrible old woman forever?”