Skip to content
Source
Sign inSign up

pingdotgg

t3codePublic Synced with GitHub
Popular #1 Fork 0

effect__ai-openai__OpenAiTokenizer.yaml

6 lines521 Bytes

Raw
1"@effect/ai-openai/OpenAiTokenizer#layer":
2 replacement: "Tokenizer.make"
3 note: "The provider-specific tokenizer module was removed; build and provide an effect/ai/Tokenizer service explicitly, using gpt-tokenizer if equivalent OpenAI counting is required."
4"@effect/ai-openai/OpenAiTokenizer#make":
5 replacement: "Tokenizer.make"
6 note: "The provider-specific tokenizer module was removed; build and provide an effect/ai/Tokenizer service explicitly, using gpt-tokenizer if equivalent OpenAI counting is required."