Leeroo-AI/mergoo

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

491 stars 34 forks 491 watchers Python GNU Lesser General Public License v3.0

artificial-intelligence fine-tuning generative-ai large-language-models llm lora merge mixture-of-adapters mixture-of-experts multi-model nlp open-source transformers

View on GitHub Website

1 Open Issue Need Help Last updated: Sep 5, 2025

Open Issues Need Help

View All on GitHub

Could model_type support QWEN models? about 2 months ago

help wanted

Leeroo-AI/mergoo

491

A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

Python

#artificial-intelligence#fine-tuning#generative-ai#large-language-models#llm#lora#merge#mixture-of-adapters#mixture-of-experts#multi-model#nlp#open-source#transformers