21 GPU's benchmarked running a small TTS model (vram peak: 5GB)

I rented different GPUs on vast.ai for a few minutes each to benchmark a small TTS model, OmniVoice, with a peak VRAM usage of about 5 GB. I wanted to see how various mostly consumer GPUs would stack up against my own RTX 3090.

This is by no means an extensive or scientific analysis, but I think it gives a rough estimate of how these GPUs perform relative to each other.

xRT means times real-time. It shows how much faster than real-time the GPU generates audio. Average of 3 runs of a small paragraph with reference audio provided (voice cloning).