PortLLM: Personalizing Evolving Large Language Models with Training-Free and Portable Model Patches

Rana Muhammad Shahroz Khan, Pingzhi Li, Sukwon Yun, Zhenyu Wang, Shahriar Nirjon, Chau-Wai Wong, Tianlong Chen

Abstract

Large Language Models (LLMs) are frequently updated by providers, creating a "maintenance tax" for users who have fine-tuned specific versions for specialized domains. PortLLM is a training-free framework that allows users to "port" personalization patches (LoRA adapters) from an older LLM version to a newer, evolved version. By simply merging existing patches with updated base models, PortLLM maintains domain-specific performance without the massive computational cost or the need for original fine-tuning datasets. Our evaluation shows that PortLLM achieves performance parity with standard re-fine-tuning while offering a 4897× speedup.

Introduction: The Challenge of Model Evolution

LLMs are not static; they are constantly evolving through continued pretraining and weight updates (e.g., the transition from Llama 2 to Llama 3). For organizations that have invested heavily in fine-tuning these models for healthcare, legal, or proprietary coding tasks, this evolution presents a significant challenge.

Traditionally, every base model update requires a full re-fine-tuning cycle to ensure the specialized "knowledge" is compatible with the new weights. This process is often prohibitive due to high GPU costs, the potential unavailability of original training data (due to privacy or retention policies), and the rapid frequency of model releases. PortLLM addresses these issues by treating personalization as a portable patch that can be applied to new model versions without additional training.

Methodology: PortLLM and the Simple Merge Operation

The core technical insight of PortLLM relies on the mathematical properties of Low-Rank Adaptation (LoRA). During fine-tuning, LoRA adds a low-rank matrix ($\Delta \theta$) to the base weights rather than modifying the entire parameter space.

Figure 1: Overview of the PortLLM framework comparing traditional repeated fine-tuning with the proposed simple merge operation.

PortLLM proposes a "Simple Merge Operation": $$\theta'_i \approx \theta' + \Delta \theta_i$$ Where $\theta'$ represents the new, evolved base model and $\Delta \theta_i$ is the original LoRA patch created for the older model version. Theoretical analysis using Singular Value Decomposition (SVD) demonstrates that because these patches are extremely low-rank compared to the full-rank base model, the residual error of applying an old patch to a new model is negligible. Essentially, the specialized knowledge captured in the patch remains structurally compatible with evolved versions within the same model family.

Experimental Evaluation

The researchers validated PortLLM across several dimensions:

  • Benchmarks: Seven representative datasets including BoolQ (QA), MRPC (Similarity), RTE/WNLI (Inference), and WinoGrande/GSM8K (Reasoning).
  • Evolution Scenarios: Simulated model evolution using datasets like OpenOrca, SlimOrca, and AlpacaGPT4.
  • Model Architectures: Testing across Mistral-7B, Llama-2-7B, Llama-3.1-8B, and Gemma-2-9B to ensure cross-architecture validity within model families.

Key Results and Efficiency Gains

PortLLM demonstrates that specialized knowledge is remarkably portable. The framework achieved performance nearly identical to—and in some cases better than—full LoRA re-training across all tested benchmarks.

Figure 6: Performance comparison across different model families, showing that PortLLM (Ours) achieves results comparable to fresh fine-tuning.

Efficiency Breakthroughs:

  • Computational Speedup: The merge operation takes seconds (0.0083 GPU hours) compared to hours for fine-tuning (40.65 GPU hours), representing a 4897× speedup.
  • Memory Reduction: GPU memory usage was reduced by up to 12.2× (e.g., ~28GB for a merge vs. ~350GB for fine-tuning a 13B parameter model).
  • Zero Training: The method requires zero trainable parameters and zero access to the original fine-tuning data, making it ideal for privacy-sensitive applications.

Key Insights

  • Knowledge Synergy: PortLLM often outperforms the updated base model alone, successfully combining the improved general reasoning of the new version with the specialized expertise of the old patch.
  • Evolution Agnostic: The method works regardless of whether the base model was updated via LoRA or full-parameter fine-tuning, providing flexibility for users of proprietary models.

Limitations and Future Directions

While highly effective, PortLLM currently focuses on "intra-family" evolution (e.g., Llama 2 to Llama 3). It does not yet support "cross-architecture" patching, such as applying a Mistral patch to a Llama base model. Additionally, the portability of the patch depends on it remaining low-rank; extremely high-rank adaptations may see degraded performance. Future work will explore more sophisticated merging techniques, such as TIES-merging, to further refine the integration of legacy patches into next-generation architectures.

Summary updated

Abstract

As large language models (LLMs) increasingly shape the AI landscape, fine-tuning pretrained models has become more popular than in the pre-LLM era for achieving optimal performance in domain-specific tasks. However, pretrained LLMs such as ChatGPT are periodically evolved, i.e., model parameters are frequently updated), making it challenging for downstream users with limited resources to keep up with fine-tuning the newest LLMs for their domain application. Even though fine-tuning costs have nowadays been reduced thanks to the innovations of parameter-efficient fine-tuning such as LoRA, not all downstream users have adequate computing for frequent personalization. Moreover, access to fine-tuning datasets, particularly in sensitive domains such as healthcare, could be time-restrictive, making it crucial to retain the knowledge encoded in earlier fine-tuned rounds for future adaptation. In this paper, we present PortLLM, a training-free framework that (i) creates an initial lightweight model update patch to capture domain-specific knowledge, and (ii) allows a subsequent seamless plugging for the continual personalization of evolved LLM at minimal cost. Our extensive experiments cover seven representative datasets, from easier question-answering tasks {BoolQ, SST2} to harder reasoning tasks {WinoGrande, GSM8K}, and models including {Mistral-7B, Llama2, Llama3.1, and Gemma2}, validating the portability of our designed model patches and showcasing the effectiveness of our proposed framework. For instance, PortLLM achieves comparable performance to LoRA fine-tuning with reductions of up to 12.2x in GPU memory usage. Finally, we provide theoretical justifications to understand the portability of our model update patches, which offers new insights into the theoretical dimension of LLMs' personalization.
BibTeX
@inproceedings{khan2025portllm,
  author = {Rana Muhammad Shahroz Khan and Pingzhi Li and Sukwon Yun and Zhenyu Wang and Shahriar Nirjon and Chau-Wai Wong and Tianlong Chen},
  title = {{PortLLM: Personalizing Evolving Large Language Models with Training-Free and Portable Model Patches}},
  booktitle = {International Conference on Learning Representations},
  year = {2025},
  url = {https://openreview.net/forum?id=gyHoR6uFhU},
}
Figure