nooscraft

nooscraft/tokuin

CLI tool – estimates LLM tokens/costs and runs provider-aware load tests for OpenAI, Anthropic, OpenRouter, or custom endpoints.

1 good first / help-wanted issue · Rust · last activity Jul 17, 2026

143 stars 8 forks 143 watchers Rust Other
llms prompt-engineering rust tokenizer
View on GitHub Website
1 Open Issue Need Help Last updated: Jul 17, 2026

Open Issues Need Help

View All on GitHub
compress is tail-truncation, not semantic compression — corrupts trailing content at every level 3 months ago
bug documentation help wanted
nooscraft/tokuin
143

CLI tool – estimates LLM tokens/costs and runs provider-aware load tests for OpenAI, Anthropic, OpenRouter, or custom endpoints.

Rust
#llms#prompt-engineering#rust#tokenizer