Nothing about Vamp plugins themselves has any bearing on the file types your host can support -- you just have to be able to decode the audio file and pass the decoded data to the plugin. The plugin neither knows nor cares what file type the data came from, and it certainly cannot decode mp3 or any other compressed format itself.
So, I'm afraid, your question really comes down to "how do I read and decode an mp3 file in my program?"
I imagine your choice really is to use an mp3 decoder library such as madlib (if license and so on permit), or to run the plugin host in some sort of scripting environment in which the mp3 file is decoded by a separate decoder program run in a script or batch process (e.g. mpg321) and the resulting wav file is fed to the host.
If it's any help, Sonic Annotator (
http://omras2.org/SonicAnnotator) can run Vamp plugins on mp3 files, but it pulls in an awful lot of code to do so because it pulls in (GPL-licensed) libraries from Sonic Visualiser in order to save development time. I wouldn't necessarily advise that approach if all you want is to read an mp3, but it might be worth taking a look at it.
Chris