Skip to main content
Back to catalog

␣EnumerableStream

A C# LINQ-flavored identifier (cl100k id 73016), adjacent to StreamLazy (73018).

Raw token

" EnumerableStream"

␣marks a real space; the symbol itself is not part of the token, and copying preserves it.

Observed behaviors

  • 01A “polysemantic” glitch token: perceived as a different word/spelling/meaning every time; nondeterministic at temperature 0 (bold-flagged in the source).LessWrong
Observed or documented on
GPT-3.5 / GPT-4
Behavior types
Polysemantic
Tokenizer
cl100k_base
Discovered by
Matthew Watkins

References