Skip to main content
Back to catalog

\tRTHOOK

A likely code-identifier fragment beginning with a literal tab character, the #1 most under-trained token in OLMo 2 — same “tab-prefixed” family as Llama 3's \tTokenNameIdentifier.

Raw token

"\tRTHOOK"

Observed behaviors

  • 01Rank #1 most under-trained in the OLMo 2 Magikarp repetition verification (E_out cosine-distance indicator -2.38e-07): a max self-repeat probability of just 4e-12 — among the most extreme values in this catalog.GitHub
Observed or documented on
OLMo 2 (AI2)
Behavior types
Under-trained
Tokenizer
GPT2Tokenizer
Discovered by
Sander Land & Max Bartolo

Related tokens