I think a phrase like the flame of my love sounds not violent, but passionate (and probably a bit quaint in 2011).
The flame of a candle can have many connotations - warmth, steadiness, light - and I think the word you want will change according to which of a candle's meanings you have in mind. The warmth of my love sounds peaceful and comforting, the steadiness of my love sounds reliable (if not particularly romantic), the light of my love sounds a bit poetic, etc.
I think comparing love directly to a candle (the candlelight of my love, etc.) is a bit dangerous, as part of a candle's reputation is its tendency to be snuffed out.
I guess I'm also not sure what "polite and peaceful" love quite means - is this the love of old age rather than the passionate love of youth? Is it a love that's not so strong as to make the person fight for it?