I'll give an example:
I can't stand him anymore = There's a limit to my _____(noun)____
And if there is a verb which equal to "can't stand (sth) anymore", I'd also like to learn.
"There's a limit to my restraint"
"There's a limit to my patience"
Or, simply the noun "limit" can have this meaning in context, e.g.:
"I have my limits".
There are also variations of an idiomatic expression: "I'm at the end of my tether" meaning you are at the end of your patience with a situation or person.
There's a limit to my tolerance.
There is a limit to my forbearance.
Not especially idiomatic in the modern world, at least in my experience. This choice has a certain ... maybe "haughtiness" to it. Like if you were invoking the idea of someone in a position of power, this could help convey that sense.
A word that is both noun and verb that means "to hold yourself back is: "Retard." However, you should be very careful about how you are using this word as, "Retard" also is an insulting way of referring to someone of limited mental abilities. As in, "calling someone a retard." You can correctly refer to a brake "retarding" the motion of a wheel, but due to the problematic nature of this word, most people seek to use other related descriptive terms.