NVIDIA

NVIDIA/Megatron-LM

Ongoing research training transformer models at scale

5 good first / help-wanted issues · Python · last activity Jul 12, 2026

large-language-models model-para transformers
5 Open Issues Need Help Last updated: Jul 12, 2026

Open Issues Need Help

View All on GitHub
good first issue documentation
NVIDIA/Megatron-LM
17.0K

Ongoing research training transformer models at scale

Python
#large-language-models#model-para#transformers
Add new install check about 1 month ago
enhancement good first issue module: inference setup-installation ci
NVIDIA/Megatron-LM
17.0K

Ongoing research training transformer models at scale

Python
#large-language-models#model-para#transformers
bug good first issue module: data pipeline community-request waiting-on-customer
NVIDIA/Megatron-LM
17.0K

Ongoing research training transformer models at scale

Python
#large-language-models#model-para#transformers
bug good first issue module: transformer engine community-request waiting-on-maintainers
NVIDIA/Megatron-LM
17.0K

Ongoing research training transformer models at scale

Python
#large-language-models#model-para#transformers
NVIDIA/Megatron-LM
17.0K

Ongoing research training transformer models at scale

Python
#large-language-models#model-para#transformers