vLLM Multi-GPU Deployment — Tensor Parallelism and Pipeline Parallelism
Running large models across multiple GPUs requires choosing between tensor parallelism and pipeline parallelism — the configuration that maximizes throughput depends on model size, GPU interconnect, and request patterns.