Warn when LoRA skips the dense and shared expert layers of MoE models on transformers v5 with peft 0.19 to 0.21.2 - #7771

Warn when LoRA skips the dense and shared expert layers of MoE models on transformers v5 with peft 0.19 to 0.21.2#7771

albertvillanova merged 4 commits into

mainhuggingface/trl:mainfrom

warn-moe-lora-dense-shared-pefthuggingface/trl:warn-moe-lora-dense-shared-peftCopy head branch name to clipboard