Humanity Unfolds

LoRA: smaller model adaptations

Jun 17, 2021

Researchers introduce low-rank adaptation, reducing the trainable parameters needed to adapt a large language model.

An important foundation for community fine-tuning and sharing lightweight model adaptations.

Explore on Humanity Unfolds

Sources