Skip to main content
Back to catalog

Qwen

10 glitch tokens

These tokens have been publicly documented on this model or model family. Inclusion does not mean that every version still shows the same behavior.

␣ForCanBeConverted

A C#-compiler-flavored fragment (“can be converted to foreach”) that became the most famous “polysemantic” glitch token: the model perceives it as a different word every time. It exists in cl100k, Llama-3 and Qwen vocabularies because the tokenizers share BPE merges.
GPT-3.5 / GPT-4QwenLlama 3PolysemanticUnder-trained

$PostalCodesNL

A Dutch postal-code API fragment that is glitchy across three separate model families — a good demonstration that glitch tokens transfer whenever tokenizers share BPE merges.
GPT-3.5 / GPT-4QwenLlama 3PolysemanticUnder-trained

\tTokenNameIdentifier

A Roslyn/C# API identifier preceded by a tab character — a code-corpus artifact that is under-trained in Llama 3.
QwenLlama 3Under-trained

开通天眼生意通银牌及以上会员

Membership-promo boilerplate from a business-data platform (Tianyan Shengyitong). Listed by the Zhihu community as a Qwen dirty token.
QwenFingerprintUnspeakable

转载请附上原文出处链接和本声明␣

Reprint/copyright boilerplate from CSDN-style blogs, with a trailing space. Listed by the Zhihu community as a Qwen dirty token.
QwenFingerprint

useRalative

The second member of the useRal triplet (cl100k id 89472), a C#-flavored identifier fragment; the same string also exists in the Qwen2 vocabulary.
GPT-3.5 / GPT-4QwenUnspeakableUnder-trained

$PostalCodesNL

A Dutch postal-code API fragment. The signature under-trained token of the cl100k lineage, “migrating” into Llama-3 and Qwen vocabularies via shared BPE merges.
QwenLlama 3Under-trained

\tTokenNameIdentifier

A .NET Selenium documentation fragment beginning with a literal tab — one of the smallest-embedding tokens in the Llama-3 vocabulary.
QwenLlama 3Under-trained

thuisontvangst

The Dutch word for “receiving clients at home”.
QwenUnspeakable

出于传递更多信息之目的

A high-frequency fragment of Chinese web “for more information” disclaimers — an under-trained long token in the Qwen3.5 vocabulary (id 128904).
QwenUnder-trained