I haven't done this myself, but I think it should be possible: first convert from IPA to SAMPA using Phonverter - a converter between IPA and SAMPA transcriptions then use MBROLA to pronounce the SAMPA.
An alternative is to use lexconvert (mirrormirror) to do the conversion and feed the output to espeak.