Raw compute, memory and bandwidth side by side — then rent the one that fits your workload and budget.
FP16 Tensor figures are dense (without sparsity), from public specifications.
Large language models, foundation-model pre-training and heavy fine-tuning. H200 NVL adds 141 GB for long context and bigger batches.
Production inference, RAG and gen-AI APIs. L40S is excellent value for serving; H20 brings 96 GB of HBM3 for larger models.
Rendering, VFX, simulation and AI development on Blackwell. RTX A4500 is the most affordable way to start.