I agree with the other answers that you really don’t need to (read: “shouldn’t) remind the person of his/her option/right to “believe [you] or not,” but if you really feel the need to include that notion, maybe the following version of it would come across as a bit less [yes, imo, rude and] “in-his/her-face,” (i.e., a bit less “take-it-or-leave-it”) (as for my other suggestions, you can, of course, “take them or leave them,” but they would provide a way for you to simultaneous say both of the things that you’ve apparently left unsaid for too long):
Although it's true that my apology is late, probably too late, as hard
as it might be to believe, please know that I've been struggling to
find a way to express my sincere regrets [for my behavior/words],
just as I’ve been struggling [since then] to find the courage to
simply tell you “Hello.”
I am now over these struggles:
Hello,
it’s me, it’s all me and I'm so terribly sorry.
(S/he might get [and, if so, perhaps even appreciate] the Todd Rundgren reference in the actual apology suggested in the last sentence. Regardless I think “it’s me, it’s all me,” although still perhaps too informal, is, in my opinion, a more suitable way to say “It’s [all] my fault” than “My bad” in whatever apology you end up using.)
(“Hello, It’s Me” lyrics from ‘MetroLyrics’ and example usage of “It’s me, it’s all me” from ‘The Social Work Psychoanalyst's Casebook: Clinical Voices in Honor of Jean Sanville’ edited by Joyce Edward, Elaine Rose, via Google Books)