Skip to main content
Back to catalog

␣StreamLazy

A C# LINQ-flavored identifier (cl100k id 73018), adjacent to EnumerableStream (73016).

Raw token

" StreamLazy"

␣marks a real space; the symbol itself is not part of the token, and copying preserves it.

Observed behaviors

  • 01A “polysemantic” glitch token: perceived as a different word on every repeat attempt.LessWrong
  • 02Martin Fell's search ran on 2023-05-09 on the free ChatGPT (GPT-3.5 Default), with nondeterminism re-tested on Playground's gpt-3.5-turbo at temperature 0, and the anomaly confirmed on Bing AI as well.LessWrong
Observed or documented on
GPT-3.5 / GPT-4
Behavior types
Polysemantic
Tokenizer
cl100k_base
Discovered by
Matthew Watkins

References