03 / 06 · Parameter-efficient fine-tuning

LoRA calculator

Pick a model and a rank and see how many parameters LoRA trains and how much GPU memory full fine-tuning, LoRA and QLoRA need.

low-rank adaptersQLoRAmemory accounting
Interactive demoruns locally