Humanity Unfolds

QLoRA lowers fine-tuning memory needs

May 23, 2023

Quantized low-rank adaptation combines frozen quantized weights with trainable adapters.

A major step toward fine-tuning large models with more accessible hardware.

Explore on Humanity Unfolds

Sources