(Preprint) MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts

Jul 20, 2024·

Dengchun Li

,

Yingzi Ma

,

Naizheng Wang

,

Zhengmao Ye

,

Zhiyuan Cheng

唐英豪

,

Yan Zhang

,

Lei Duan

,

Jie Zuo

,

Cal Yang

,

Mingjie Tang

· 0 min read

Cite arXiv URL

Authors

唐英豪

Ph.D Student

---

(VLDB 2024) DLRover-RM: Resource Optimization for Deep Recommendation Models Training in the Cloud Jun 28, 2024 →