Back to catalog
Qwen
9 glitch tokensThese tokens have been publicly documented on this model or model family. Inclusion does not mean that every version still shows the same behavior.
␣ForCanBeConverted
A C#-compiler-flavored fragment (“can be converted to foreach”) that became the most famous “polysemantic” glitch token: the model perceives it as a different word every time. It exists in cl100k, Llama-3 and Qwen vocabularies because the tokenizers share BPE merges.
GPT-3.5 / GPT-4Llama 3QwenPolysemanticUnder-trained
$PostalCodesNL
A Dutch postal-code API fragment that is glitchy across three separate model families — a good demonstration that glitch tokens transfer whenever tokenizers share BPE merges.
GPT-3.5 / GPT-4Llama 3QwenPolysemanticUnder-trained
\tTokenNameIdentifier
A Roslyn/C# API identifier preceded by a tab character — a code-corpus artifact that is under-trained in Llama 3.
Llama 3QwenUnder-trained
开通天眼生意通银牌及以上会员
Membership-promo boilerplate from a business-data platform (Tianyan Shengyitong). Listed by the Zhihu community as a Qwen dirty token.
QwenFingerprint
转载请附上原文出处链接和本声明␣
Reprint/copyright boilerplate from CSDN-style blogs, with a trailing space. Listed by the Zhihu community as a Qwen dirty token.
QwenFingerprint
useRalative
The second member of the useRal triplet (cl100k id 89472), a C#-flavored identifier fragment; the same string also exists in the Qwen2 vocabulary.
GPT-3.5 / GPT-4QwenUnspeakableUnder-trained
$PostalCodesNL
A Dutch postal-code API fragment. The signature under-trained token of the cl100k lineage, “migrating” into Llama-3 and Qwen vocabularies via shared BPE merges.
Llama 3QwenUnder-trained
\tTokenNameIdentifier
A .NET Selenium documentation fragment beginning with a literal tab — one of the smallest-embedding tokens in the Llama-3 vocabulary.
Llama 3QwenUnder-trained
thuisontvangst
The Dutch word for “receiving clients at home”.
QwenUnspeakable