axolotl-ai-cloud

axolotl-ai-cloud/axolotl

Go ahead and axolotl questions

12.2K stars 1.4K forks 12.2K watchers Python Apache License 2.0
fine-tuning llm
View on GitHub Website
12 Open Issues Need Help Last updated: Jul 8, 2026

Open Issues Need Help

View All on GitHub
[ Discussion ] NVFP4 LoRA Merge 12 days ago
enhancement help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
[Feature] Automatic LoRA rank recommendation based on dataset size 13 days ago
good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
TPU/Trainium support 28 days ago
enhancement good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Causal LM Eval Failing with Qwen3 Base models + Zero3 Deepspeed about 1 month ago
bug help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Loading Large Long-Context SFT Dataset leads to RAM OOM about 2 months ago
bug help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Zero loss and nan grad_norm when Flash Attention is enabled about 2 months ago
bug help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Use flashoptim Optimizers 5 months ago
enhancement good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Packing Support for VLM Training 5 months ago
enhancement help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
deprecate dataset_processes in preference of dataset_num_proc 5 months ago
enhancement good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Save De-duplicated Set During Pre-processing 5 months ago
enhancement good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
CLI Args should also handle nested options 5 months ago
enhancement good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Wrong epoch when turning on `context_parallel_size ` 9 months ago
bug help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm