compressed-tensors good first issues (Python)

Write a guide for quantizing models using frameworks outside of Compressed-Tensors quantization about 2 hours ago

documentation good first issue

vllm-project/compressed-tensors

294

A safetensors extension to efficiently store sparse quantized tensors on disk

Python

Skip Pinned Memory Staging Copy 3 days ago

good first issue

vllm-project/compressed-tensors

294

A safetensors extension to efficiently store sparse quantized tensors on disk

Python

[Bug] Disk Offloading and Deletion of Shared Tensors 24 days ago

bug good first issue stale

vllm-project/compressed-tensors

294

A safetensors extension to efficiently store sparse quantized tensors on disk

Python

[Bug] Unreachable GROUP+dynamic branch in QuantizationScheme.validate_model_after 3 months ago

bug good first issue question

vllm-project/compressed-tensors

294

A safetensors extension to efficiently store sparse quantized tensors on disk

Python

[Refactor] Remove `g_idx == -1` checks 4 months ago

good first issue

vllm-project/compressed-tensors

294

A safetensors extension to efficiently store sparse quantized tensors on disk

Python

[Performance] Speed up model loading by desynchronizing sync ops in `from_accelerate` 5 months ago

good first issue

vllm-project/compressed-tensors

294

A safetensors extension to efficiently store sparse quantized tensors on disk

Python

[convert] Add Converter for AutoAWQ format 5 months ago

good first issue

vllm-project/compressed-tensors

294

A safetensors extension to efficiently store sparse quantized tensors on disk

Python

[AssertionError] assert scale_dtype is torch.float32 in round_to_power_2 6 months ago

good first issue

vllm-project/compressed-tensors

294

A safetensors extension to efficiently store sparse quantized tensors on disk

Python

Catch cpu mmap issues and create warning 7 months ago

good first issue

vllm-project/compressed-tensors

294

A safetensors extension to efficiently store sparse quantized tensors on disk

Python

[Python 3.10+] Modernize codebase with Python 3.10+ idioms and features 8 months ago

enhancement good first issue keep-open

vllm-project/compressed-tensors

294

A safetensors extension to efficiently store sparse quantized tensors on disk

Python

[Compressed Linear] Remove CompressedLinear 9 months ago

enhancement good first issue help wanted keep-open

vllm-project/compressed-tensors

294

A safetensors extension to efficiently store sparse quantized tensors on disk

Python

vllm-project/compressed-tensors

Open Issues Need Help