A modular, scalable, high-performance training framework for LLMs, VLMs, diffusion, and embodied models.

313 stars 32 forks 313 watchers Python Apache License 2.0
ai diffusion distributed dit infra llm lora megatron mid-training pretraining sft training vla vlm wan
3 Open Issues Need Help Last updated: Jul 10, 2026

Open Issues Need Help

View All on GitHub
enhancement good first issue model

A modular, scalable, high-performance training framework for LLMs, VLMs, diffusion, and embodied models.

Python
#ai#diffusion#distributed#dit#infra#llm#lora#megatron#mid-training#pretraining#sft#training#vla#vlm#wan

A modular, scalable, high-performance training framework for LLMs, VLMs, diffusion, and embodied models.

Python
#ai#diffusion#distributed#dit#infra#llm#lora#megatron#mid-training#pretraining#sft#training#vla#vlm#wan

A modular, scalable, high-performance training framework for LLMs, VLMs, diffusion, and embodied models.

Python
#ai#diffusion#distributed#dit#infra#llm#lora#megatron#mid-training#pretraining#sft#training#vla#vlm#wan