Hey, I'm watching a TV show, and there's a sentence:
I knew giving you that book was gonna come back and bite me in the ass.
Can I change it to:
I know gave you that book was gonna come back and bite me in the ass.
No. The phrase "giving you that book" is the subject of the clause.
I guess you are thinking that "knew giving" is some funny sort of compound verb, and wanting to move the past tense within it; but that's not how the sentence is structured. There is an omitted "that" (which can often be done in colloquial English), so the structure is:
"I knew [that [giving you that book] was ... ]"
I think most of us are inclined to say that "gave" makes the sentence ungrammatical. However, from a linguistic standpoint, we probably all understood what was meant, so it doesn't really matter which is used.