axolotl-ai-cloud

axolotl-ai-cloud/axolotl

Go ahead and axolotl questions

12.2K stars 1.4K forks 12.2K watchers Python Apache License 2.0
fine-tuning llm
View on GitHub Website
12 Open Issues Need Help Last updated: Jul 8, 2026

Open Issues Need Help

View All on GitHub
[Feature] Automatic LoRA rank recommendation based on dataset size 14 days ago
good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
[ Discussion ] NVFP4 LoRA Merge about 1 month ago
enhancement help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
TPU/Trainium support about 2 months ago
enhancement good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Causal LM Eval Failing with Qwen3 Base models + Zero3 Deepspeed 2 months ago
bug help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Loading Large Long-Context SFT Dataset leads to RAM OOM 3 months ago
bug help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Zero loss and nan grad_norm when Flash Attention is enabled 3 months ago
bug help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Use flashoptim Optimizers 6 months ago
enhancement good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Packing Support for VLM Training 6 months ago
enhancement help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
deprecate dataset_processes in preference of dataset_num_proc 6 months ago
enhancement good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Save De-duplicated Set During Pre-processing 6 months ago
enhancement good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
CLI Args should also handle nested options 6 months ago
enhancement good first issue
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm
Wrong epoch when turning on `context_parallel_size ` 10 months ago
bug help wanted
axolotl-ai-cloud/axolotl
12.2K

Go ahead and axolotl questions

Python
#fine-tuning#llm