LoRA / QLoRA

What LoRA / QLoRA means in practice

Low-Rank Adaptation (LoRA) fine-tunes a model by injecting small trainable matrices into specific transformer layers rather than updating the full parameter set. QLoRA is the quantised variant — base weights frozen at 4-bit precision, adapters trained at 16-bit — which lets a 70B model fine-tune on a single A100. The architectural payoff for enterprise is that one base model can serve dozens of LoRA adapters at once (one per business unit, one per language, one per document type), swappable at inference time. This collapses the model-management problem from "thirty separate fine-tunes" to "one base model and thirty adapter files".