For American pronunciation, both the Oxford dictionary's American pronunciation and the American Heritage dictionary's leave out the /ɘ/ in words like little, riddle, mantle, metal that I think of as ending /tɘl/ and /dɘl/, but not words ending in other consonants followed by /ɘl/, like /nɘl/, /bɘl/, /kɘl/. Merriam-Webster uses /təl/ and /dəl/, but /ɘl/ after other consonants; this symbolizes the same pronunciation: the /l/ is the nucleus of its own syllable, which contains no vowel.
For British pronunciation, the Cambridge Advanced Learner's Dictionary on-line uses either /l/ and /əl/ for all these words; I think it depends only on the spelling. I believe these are supposed to symbolize the same sound (no schwa). The online global Oxford dictionary seems to use /(ɘ)l/ for all of these words, meaning the schwa is optional. So presumably the schwa is supposedly left out in RP.
Going to forvo.com and listening to the pronunciation of words, it seems that Americans generally (not always) do put the schwa in after vowels other than /t/ and /d/, but many (not all) Americans leave the schwa out after /t/ and /d/. I'm not a linguist, so I can't say for sure, but I believe these variations are allophonic, meaning that English speakers will perceive them as having the same phoneme. If you leave out the schwa after /t/ or /d/, it is likely you are unaware you're doing so. Don't worry about pronouncing this "right"; you should be understood just as well either way. Even if you're trying to lose a foreign accent, judging from the pronunciations on Forvo, the variation in both native British and native American speakers is large enough that I don't think anybody will notice this.
In my comment above, I said there were no minimal pairs for /ɘl/ and syllabic /l/, because they are allophonic, but I think I was wrong. The way I speak, there are several multi-word minimal pairs; for example, metal ion versus met a lion, or mental aberration versus meant elaboration.