A friend of mine said "...I never saw you during school."
For some reason I wanted to respond "Neither I you." I am certain I have heard this reply before, but, looking at it now, it does not seem grammatically correct.
Is saying "Neither I you" correct? If not what would be the most concise to tell him that I had not seen him either ie Neither have I seen you?