huggingface

huggingface/nanotron

Minimalistic large language model 3D-parallelism training

4 good first / help-wanted issues · Python · last activity Jul 28, 2026

2.8K stars 325 forks 2.8K watchers Python Apache License 2.0

4 Open Issues Need Help Last updated: Jul 28, 2026

Open Issues Need Help

View All on GitHub

[Feature] Use CUDA event for measuring elasped time 21 days ago

enhancement good first issue help wanted

huggingface/nanotron

2.8K

Minimalistic large language model 3D-parallelism training

Python

[Feature] Refactor `ParallelContext.world_rank_matrix` 2 months ago

enhancement good first issue help wanted

huggingface/nanotron

2.8K

Minimalistic large language model 3D-parallelism training

Python

[Bug] Missing `_is_using_mup` when resume checkpoint 3 months ago

bug good first issue help wanted

huggingface/nanotron

2.8K

Minimalistic large language model 3D-parallelism training

Python

Avoid nested `InheritFromOtherOptimizer` about 1 year ago

good first issue help wanted Low Priority

huggingface/nanotron

2.8K

Minimalistic large language model 3D-parallelism training

Python