Code
S'MoRE: Structural Mixture of Residual Experts for Parameter-Efficient LLM Fine-tuning
Why Lacuna links this resource
Linked from the paper
cal results demonstrate that S’MoRE achieves superior fine-tuning performance, offering a transformative approach for efficient LLM adaptation. Our implementation is available at: https://github.com/ZimpleX/SMoRE-LLM.