Consumer GPUs (RTX series):
- Lower cost (-)
- -GB VRAM
- Single GPU setups
- Good for QLoRA on -B models
Data center GPUs (A100, H100):
- High cost (-)
- -GB VRAM
- Multi-GPU scaling
- Required for larger models or full fine-tuning
Cloud rentals make data center GPUs accessible at ~-/hour.