LoRA or LoRA Base? #514

StripedPuppy · 2023-11-05T01:38:41Z

StripedPuppy
Nov 5, 2023

In the models tab, what is the difference between LoRA and LoRA Base for LoRA models?

I've noticed I can run 7b and 13b LoRA's under LoRA Base, but not LoRA due to insufficient extra RAM.

Answered by LostRuins

lora base is intended to select the original f16 model weights (a higher quality model to use as a base for the layers modified by the adapter.)

LostRuins · 2023-11-05T02:28:40Z

lora base is intended to select the original f16 model weights (a higher quality model to use as a base for the layers modified by the adapter.)

0 replies