attention-warrior good first issues (Python)

good first issue: --attend CLI demo (readable Q/K/V weights table) about 2 months ago

good first issue

0

From-scratch Transformer attention — a tiny educational head you can run, break, and rebuild. Honest 2021-shaped archive chapter.

Python

#archive#attention#education#educational#from-scratch#machine-learning#neural-networks#python#teaching#transformers

good first issue: docs/softmax-stability.md (why subtract max before exp) about 2 months ago

good first issue

primeodin/attention-warrior

0

From-scratch Transformer attention — a tiny educational head you can run, break, and rebuild. Honest 2021-shaped archive chapter.

Python

#archive#attention#education#educational#from-scratch#machine-learning#neural-networks#python#teaching#transformers

good first issue: pytest fixture for AttentionHead.attend (weights sum ~1) about 2 months ago

good first issue

primeodin/attention-warrior

0

From-scratch Transformer attention — a tiny educational head you can run, break, and rebuild. Honest 2021-shaped archive chapter.

Python

#archive#attention#education#educational#from-scratch#machine-learning#neural-networks#python#teaching#transformers

good first issue: examples/scale-factor-walkthrough.md (why divide by sqrt(d)) about 2 months ago

good first issue

primeodin/attention-warrior

0

From-scratch Transformer attention — a tiny educational head you can run, break, and rebuild. Honest 2021-shaped archive chapter.

Python

#archive#attention#education#educational#from-scratch#machine-learning#neural-networks#python#teaching#transformers

Docs: ASCII Q/K/V attention diagram in docs/ about 2 months ago

documentation good first issue

primeodin/attention-warrior

0

From-scratch Transformer attention — a tiny educational head you can run, break, and rebuild. Honest 2021-shaped archive chapter.

Python

#archive#attention#education#educational#from-scratch#machine-learning#neural-networks#python#teaching#transformers

Examples: add a second worked attention walkthrough under examples/ about 2 months ago

documentation enhancement good first issue

primeodin/attention-warrior

0

From-scratch Transformer attention — a tiny educational head you can run, break, and rebuild. Honest 2021-shaped archive chapter.

Python

#archive#attention#education#educational#from-scratch#machine-learning#neural-networks#python#teaching#transformers

Docs: expand README Try it with exact commands + expected output about 2 months ago

documentation good first issue

primeodin/attention-warrior

0

From-scratch Transformer attention — a tiny educational head you can run, break, and rebuild. Honest 2021-shaped archive chapter.

Python

#archive#attention#education#educational#from-scratch#machine-learning#neural-networks#python#teaching#transformers

primeodin/attention-warrior

Open Issues Need Help