Skip to main content
Back to catalog

Qwen

9 glitch tokens

These tokens have been publicly documented on this model or model family. Inclusion does not mean that every version still shows the same behavior.

␣ForCanBeConverted

A C#-compiler-flavored fragment (“can be converted to foreach”) that became the most famous “polysemantic” glitch token: the model perceives it as a different word every time. It exists in cl100k, Llama-3 and Qwen vocabularies because the tokenizers share BPE merges.
GPT-3.5 / GPT-4Llama 3QwenPolysemanticUnder-trained

$PostalCodesNL

A Dutch postal-code API fragment that is glitchy across three separate model families — a good demonstration that glitch tokens transfer whenever tokenizers share BPE merges.
GPT-3.5 / GPT-4Llama 3QwenPolysemanticUnder-trained

\tTokenNameIdentifier

A Roslyn/C# API identifier preceded by a tab character — a code-corpus artifact that is under-trained in Llama 3.
Llama 3QwenUnder-trained

开通天眼生意通银牌及以上会员

Membership-promo boilerplate from a business-data platform (Tianyan Shengyitong). Listed by the Zhihu community as a Qwen dirty token.
QwenFingerprint

转载请附上原文出处链接和本声明␣

Reprint/copyright boilerplate from CSDN-style blogs, with a trailing space. Listed by the Zhihu community as a Qwen dirty token.
QwenFingerprint

useRalative

The second member of the useRal triplet (cl100k id 89472), a C#-flavored identifier fragment; the same string also exists in the Qwen2 vocabulary.
GPT-3.5 / GPT-4QwenUnspeakableUnder-trained

$PostalCodesNL

A Dutch postal-code API fragment. The signature under-trained token of the cl100k lineage, “migrating” into Llama-3 and Qwen vocabularies via shared BPE merges.
Llama 3QwenUnder-trained

\tTokenNameIdentifier

A .NET Selenium documentation fragment beginning with a literal tab — one of the smallest-embedding tokens in the Llama-3 vocabulary.
Llama 3QwenUnder-trained

thuisontvangst

The Dutch word for “receiving clients at home”.
QwenUnspeakable