Skip to content

feat: replace rough token estimation with accurate gpt-tokenizer - #135

Closed
AnthonyRonning wants to merge 6 commits into
masterfrom
feat/token-based-counting
Closed

feat: replace rough token estimation with accurate gpt-tokenizer#135
AnthonyRonning wants to merge 6 commits into
masterfrom
feat/token-based-counting

perf: eliminate duplicate token calculations

41afc64
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs