I'm trying to make a sentence about evaluating how interesting something is. I'm evaluating its ________?
The word interest itself can be used.
I'm evaluating its interest.
Allure and charm do have some appeal.
As @ermanen suggested, interestingness is a word; I then used it to find synonyms. I found "allure" and "charm" to be better fits!