cuLA good first issues (Python)

[Feature] Integrate Lightning SM90 Implementation via CuTe DSL 3 months ago

good first issue help wanted sm90

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

Small B/H/S optimizations 5 months ago

enhancement help wanted performance

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

[Feature] Add GVA support for Lightning 5 months ago

enhancement good first issue help wanted

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

[KDA] Grouped Value Attention (GVA) support 5 months ago

enhancement good first issue help wanted

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

WIP-RFC: Multi-GPU Unified Interface for cuLA 6 months ago

enhancement help wanted integration

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

Modular GDN forward / backward kernels (compatible with Kimi CP) 6 months ago

enhancement help wanted

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

More aggressive fusion of small neighboring kernels (cumsum etc.) for inference 6 months ago

enhancement help wanted inference

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

Identify and implement CUDA optimization opportunities for Intracard CP (single-card sequence splitting) 7 months ago

enhancement help wanted distributed

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

KDA Backward pass optimizations 7 months ago

enhancement help wanted sm10x sm90 train

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

Support for bf16 Beta 7 months ago

enhancement good first issue

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

We need a KDA decode kernel 7 months ago

enhancement help wanted inference

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

Lightning-attn supports pretransposed states 7 months ago

good first issue help wanted performance

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

Prefill Output Pretransposed States `[V, K]` for Decode 7 months ago

help wanted performance inference

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

Integrate cuLA into flash-linear-attention via FLA's kernel dispatch mechanism 7 months ago

enhancement good first issue integration

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

KDA MTP (Multi-Token Prediction) support 7 months ago

enhancement help wanted inference

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

Polynomial approximation to mitigate the exponential bottleneck (Flash-Attention-4) 7 months ago

help wanted research performance

inclusionAI/cuLA

534

CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.

Python

inclusionAI/cuLA

Open Issues Need Help