SV doesn't actually have any means of downsampling or decimating audio on request, I'm afraid -- it would be necessary to downsample the file outside of SV before loading it.
It would be possible for a Vamp plugin to offer this as an option, but I'm not sure whether any existing one does.
Chris