huggingface

huggingface/transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

42 good first / help-wanted issues · Python · last activity Jul 22, 2026

162.8K stars 34.0K forks 162.8K watchers Python Apache License 2.0
audio deep-learning deepseek gemma glm hacktoberfest llm machine-learning model-hub natural-language-processing nlp pretrained-models python pytorch pytorch-transformers qwen speech-recognition transformer vlm
View on GitHub Website
42 Open Issues Need Help Last updated: Jul 22, 2026

Open Issues Need Help

View All on GitHub
overflow_to_sample_mapping missing in in documentation 3 months ago
Good First Issue WIP
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Outdated examples about RAG 5 months ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Export LayoutLMv2 to onnx 7 months ago
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
GeneratorExp aren't supported by torch.jit.script when I try to export a previously trained model 'google/vit-base-patch16-224-in21k'. 7 months ago
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
oom when using adafactor optimizer in deepspeed 8 months ago
Usage Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Follow ups to DocumentQuestionAnswering Pipeline 8 months ago
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
[Performance] Tracking open Issues and PRs (pytorch transformers) 8 months ago
Good First Issue Performance Good Difficult Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Add support for BLIP and GIT in image-to-text and VQA pipelines 8 months ago
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Trying to add support for GPT2 as decoder in EncoderDecoder model 8 months ago
Core: Encoder-Decoder Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Getting time offsets of beginning and end of each word in Wav2Vec2 8 months ago
Good First Issue Good Second Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Syntax error in Transformer section 3 (Transformers, what can they do?) notebook 8 months ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Call to contributions: refactor output tracing in transformers 8 months ago
Help wanted Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Isolated reproduction of https://github.com/huggingface/transformers/issues/38071 8 months ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
examples/rag: test coverage, tiny model 8 months ago
Help wanted Tests rag Feature request
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Test BART's memory consumption 8 months ago
Help wanted Tests Benchmarks WIP
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
SwanLab integration uses outdated swanlab.init() signature 8 months ago
Good First Issue Feature request
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Please create a Huggingface Transformers SKILL for Claude 8 months ago
Good First Issue Feature request
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Tapas tokenization Different from Tensorflow Code 9 months ago
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Verify interpolation of image processors 9 months ago
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
[Community Event] Doc Tests Sprint 9 months ago
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Object Detection Pipeline only outputs first element when batching 10 months ago
Core: Pipeline Good First Issue Vision
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
FSDP Torch XLA vs. FSDPv2 (SMPD) Torch XLA checkpoint saving bug 10 months ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Add argument to set number of eval steps in Trainer 10 months ago
Good First Issue trainer Feature request
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
IsADirectoryError when training with tqdm enabled for trainer 10 months ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Please use the new API settings to control TF32 behavior, ... 11 months ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Bad error message for AutoTokenizer loading Voxtral 11 months ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
RuntimeError when loading llmcompressor W8A8 quantized model: int8 dtype in weight initialization 11 months ago
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Trainer.training_step incorrectly normalizes mean token loss when n_gpu > 1 11 months ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Improve EncoderDecoderModel docs 12 months ago

AI Summary: This GitHub issue proposes improving the documentation for the `EncoderDecoderModel` in Hugging Face Transformers, as the current docs are outdated and cause user confusion. The task involves updating the existing `encoder-decoder.mdx` file to include a "How-to-guide" on creating, saving, and fine-tuning the model, along with a warning about correctly setting configuration values.

Complexity: 2/5
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
[Contributions Welcome] Add Fast Image Processors 12 months ago
Good First Issue Good Second Issue Vision contributions-welcome Processing
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Accelerate x Trainer issue tracker: about 1 year ago
Good First Issue trainer Good Second Issue DeepSpeed Good Difficult Issue PyTorch FSDP HACKTOBERFEST-ACCEPTED Accelerate
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
`ConditionalDetrImageProcessor` still accepts the deprecated parameter `max_size` about 1 year ago
Good First Issue Vision
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Adding `logits_to_keep` to older models about 1 year ago
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Whisper Finetuning Issue about 1 year ago
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
[Community contributions] Model cards about 1 year ago
Good First Issue Good First Documentation Issue contributions-welcome
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
`train_tokens_per_second` is wrong after continuing from checkpoint about 1 year ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Safetensors files for long-t5-tglobal models fail to load correctly about 1 year ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Unknown Model (mobilenetv5_300m_enc) when loading Gemma 3n about 1 year ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Please remove the redundant dependency jieba: rjieba does the same and has better performance about 1 year ago
Good First Issue
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
Is there a plan to add DINOv3 into AutoBackbone? about 1 year ago

AI Summary: The user requests the addition of DINOv3 to AutoBackbone, noting that DINOv2 is already included. They suggest DINOv3 could directly inherit from DINOv2 for ease of implementation and user convenience.

Complexity: 2/5
Good First Issue Feature request
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
MultiTask Classification and label_names on Trainer about 1 year ago
Good First Issue bug
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm
text-generation extremely slow with large `bad_words_ids` list about 1 year ago

AI Summary: The task is to investigate and resolve a performance issue in the Hugging Face Transformers library. The text generation pipeline is significantly slower when a large list of `bad_words_ids` is used. The solution requires profiling the code to identify the bottleneck (inefficient looping, tensor access, or slow regex) and optimizing the relevant section to improve performance.

Complexity: 4/5
Good First Issue bug mps
huggingface/transformers
162.8K

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Python
#audio#deep-learning#deepseek#gemma#glm#hacktoberfest#llm#machine-learning#model-hub#natural-language-processing#nlp#pretrained-models#python#pytorch#pytorch-transformers#qwen#speech-recognition#transformer#vlm