Automodel good first issues (Python)

enhancement good first issue

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Profile and reduce Nemotron Nano single-GPU checkpoint load time 2 months ago

good first issue ckpt Performance ci automodel

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Support Windows RTX GPU for model finetuning 3 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Fix PEFT adapter outputs for v5 support 3 months ago

bug good first issue MoE qa_rcca_done

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Support Hy MT2 3 months ago

enhancement good first issue Feature

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

tools/merge_lora.py should save processor artifacts for VLMs 3 months ago

good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

VLM validation drops the batch dimension for tensor-valued hidden_states 3 months ago

good first issue community-request waiting-on-customer

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

fix(vlm): validation crashes with FusedLinearCrossEntropy — out.hidden_states[-1] indexes the batch dim when the model returns a single hidden-state tensor 3 months ago

bug good first issue community-request waiting-on-customer

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Gemma4 NaN with SDPA 3 months ago

good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Make StatefulDataloader be DP-aware 4 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

staging-free consolidation for databricks 4 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Support MiMo-V2.5-Pro 5 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Support MiniCPM5-1B 5 months ago

enhancement good first issue community-request

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Support Falcon H1 5 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Support inclusionAI/Ling-mini/flash/1T-2.0 5 months ago

enhancement good first issue community-request

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

YAML linter 6 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

bug: MoE expert LoRA checkpoints incompatible with HF PEFT and vLLM (Nemotron Super 120B) 6 months ago

good first issue community-request

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Support LLaVA-OneVision-1.5 Model Training 6 months ago

enhancement good first issue community-request waiting-on-maintainers

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

use lazy map for dataset preprocessing 6 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Optimize causal-conv1d/transformer engine installation in CI 7 months ago

enhancement good first issue Automation

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

(small) package deprecation 7 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Support Qwen-Image finetune (T2I) 7 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

S3 + DCP 7 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Skypilot + k8s tutorial 7 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

workaround required for padding_mask 7 months ago

bug good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Support Skypilot 7 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

MFU logging in train recipes 8 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Some configs missing dataset.vocab_size in MockIterableDataset 8 months ago

bug good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

[Bug] Model summary reports incorrect "Total parameters" for Quantized Models (Llama 3.1 8B QLoRA) 8 months ago

good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Add get_input_embeddings method to nemo_automodel.components.models.gpt_oss.model.GptOssForCausalLM 8 months ago

bug good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Can you support DoRA? 9 months ago

enhancement good first issue community-request external x-tencent t-algo

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Distributed signal handling 9 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

num_epochs should not default to 10 if max_steps is specified in step scheduler 9 months ago

bug good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

Add MoE load balancing metrics 10 months ago

enhancement good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

MCore Dataset needs to launch with uv instead of system python 11 months ago

good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

issue: missing FirstRankPerNode in recipes about 1 year ago

good first issue Stale

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

fix(checkpointing): Dataloader state about 1 year ago

good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

feat: deterministic job resume about 1 year ago

AI Summary: Implement deterministic job resume functionality for the NeMo AutoModel framework. This involves ensuring that resuming a training job from a saved state produces identical results to a continuous run, verifying the correct restoration of model, optimizer, dataloader, and data sampler states.

Complexity: 4/5

good first issue

NVIDIA-NeMo/Automodel

707

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

Python

#agent#deepseek-v3-2#deepseek-v4#finetuning#gemma3#gemma4#glm#gpt-oss#kimi-k2#llama#llama3#llm#minimax-m2#mistral#openai#qwen3#qwen3-6#qwen3-next#vlm

NVIDIA-NeMo/Automodel

Open Issues Need Help