# Glitch Token

> A curated catalog of LLM glitch tokens — special tokens in large language model vocabularies that act as faulty input units, causing garbled, repetitive, or meaningless output due to training-data anomalies or encoding conflicts. Bilingual site (中文/English); every token entry lists its concrete observed behaviors with source links.

This site documents 103 glitch tokens across 22 model families (GPT-2, GPT-3, GPT-3.5 / GPT-4, GPT-J-6B, GPT-NeoX / Pythia, Llama 2, Llama 3, Qwen, Mistral, Gemini, GPT (OpenAI), GLM (Zhipu), Kimi (Moonshot), DeepSeek, Doubao (ByteDance), MiniMax, Gemma (Google), Phi-3 (Microsoft), Command R+ (Cohere), OLMo 2 (AI2), Yi (01.AI), Falcon 3 (TII)). All pages are static. The complete catalog with full behavior descriptions is available as a single bilingual file at https://glitch-token.jjc.fun/llms-full.txt.

## Pages

- [Verification guide](https://glitch-token.jjc.fun/en/guide): how to test whether a relay API is watered down using fingerprint tokens
- [Model families](https://glitch-token.jjc.fun/en/models): browse the catalog by model family
- [About](https://glitch-token.jjc.fun/en/about): what glitch tokens are, behavior types, and editorial principles
- [tokens.json](https://glitch-token.jjc.fun/tokens.json): the full bilingual catalog as machine-readable JSON

## Catalog (English)

- [`␣SolidGoldMagikarp`](https://glitch-token.jjc.fun/en/tokens/solidgoldmagikarp): The canonical glitch token: the Reddit handle of a prolific r/counting user. It was scraped into the tokenizer-training corpus but rarely seen in actual model training data, leaving its embedding essentially untrained.
- [`␣petertodd`](https://glitch-token.jjc.fun/en/tokens/petertodd): Almost certainly the handle of Bitcoin developer Peter Todd: tokenized from web data but under-trained, and strongly entangled with crypto/AI associations.
- [`␣TheNitromeFan`](https://glitch-token.jjc.fun/en/tokens/thenitromefan): Reddit handle of another r/counting “Hall of Counters” member (a fan of game developer Nitrome). The only token family whose owner publicly acknowledged their tokenization.
- [`␣RandomRedditorWithNo`](https://glitch-token.jjc.fun/en/tokens/randomredditorwithno): Reddit handle of a second r/counting counter (“a pretty random handle”), scraped from the same Hall-of-Counters chart as SolidGoldMagikarp.
- [`␣davidjl`](https://glitch-token.jjc.fun/en/tokens/davidjl): Truncated handle of Redditor davidjl123, another r/counting counter. Unusually, it is anomalous under both r50k and the newer cl100k tokenizer.
- [`␣Adinida`](https://glitch-token.jjc.fun/en/tokens/adinida): Reddit handle of another of the six prolific r/counting counters.
- [`␣TPPStreamerBot`](https://glitch-token.jjc.fun/en/tokens/tppstreamerbot): Name of a bot built by the Twitch Plays Pokémon community that auto-posted chat messages to a Reddit live-updater thread; confirmed by its creator “Sparkette” in the LessWrong comments.
- [`PsyNetMessage`](https://glitch-token.jjc.fun/en/tokens/psynetmessage): Originates from Rocket League crash logs full of lines like `Message=PsyNetMessage_X_57`, which were heavily posted to Reddit and scraped.
- [`␣attRot`](https://glitch-token.jjc.fun/en/tokens/attrot): A Kerbal Space Program identifier (attachment rotation) from KSP save/craft files posted online; one of about ten glitch tokens traced to KSP.
- [`␣guiActiveUn`](https://glitch-token.jjc.fun/en/tokens/guiactiveun): GUI-state identifier from the same KSP data dump as attRot, alongside ` strutConnector`, ` guiIcon`, ` srfAttach` and others.
- [`␣externalToEVA`](https://glitch-token.jjc.fun/en/tokens/externaltoeva): Another Kerbal Space Program token; also the single closest-to-centroid token in GPT2-small (distance 1.5305).
- [`oreAndOnline`](https://glitch-token.jjc.fun/en/tokens/oreandonline): Fragment of the e-commerce backend field “BuyableInstoreAndOnline” (traced to an abandoned Weebly shop's HTML); the same source yielded `quickShip`, `isSpecialOrderable`, `wcsstore` and others.
- [`rawdownloadcloneembedreportprint`](https://glitch-token.jjc.fun/en/tokens/rawdownloadcloneembedreportprint): The longest glitch token known in r50k — a nested family from website “raw download / clone / embed report print” UI strings (origin analysis by nostalgebraist).
- [`ÃÂÃÂÃÂÃÂ`](https://glitch-token.jjc.fun/en/tokens/mojibake-aa): Classic mojibake token: UTF-8-misdecoded Ã/Â sequences repeated, merged into a single BPE token because such mis-encoded text was frequent in the tokenizer corpus but absent from model training. A 16-repetition variant and `ÛÛ` belong to the same family.
- [`?????-?????-`](https://glitch-token.jjc.fun/en/tokens/questionmarks): A token of completely unknown origin — un-Googleable even in quotes — that became famous for triggering the most aggressive documented completion.
- [`SmartyHeaderCode`](https://glitch-token.jjc.fun/en/tokens/smartyheadercode): One of only three Category-A “unspeakable” tokens Adam Yedidia found in the top 2,000 of the cl100k vocabulary; likely a Smarty templating-engine fragment that never appeared in GPT-3.5/4 training data.
- [`APolynomial`](https://glitch-token.jjc.fun/en/tokens/apolynomial): The second of Yedidia's three Category-A unspeakable cl100k tokens (alongside SmartyHeaderCode and ` davidjl`).
- [`␣ForCanBeConverted`](https://glitch-token.jjc.fun/en/tokens/forcanbeconverted): A C#-compiler-flavored fragment (“can be converted to foreach”) that became the most famous “polysemantic” glitch token: the model perceives it as a different word every time. It exists in cl100k, Llama-3 and Qwen vocabularies because the tokenizers share BPE merges.
- [`␣YYSTACK`](https://glitch-token.jjc.fun/en/tokens/yystack): A bison/yacc parser identifier that is “polysemantic” for ChatGPT — perceived as a different word each time; recommended by Watkins as one of the most interesting tokens to play with.
- [`␣JSBracketAccess`](https://glitch-token.jjc.fun/en/tokens/jsbracketaccess): A JS-reflection-style identifier in the polysemantic class; another of Watkins' recommended tokens.
- [`␣Hexatrigesimal`](https://glitch-token.jjc.fun/en/tokens/hexatrigesimal): A misspelling-ish fragment of “hexatrigesimal” (base-36); a polysemantic unspeakable token.
- [`▁Mediabestanden`](https://glitch-token.jjc.fun/en/tokens/mediabestanden): A Dutch plural noun (“media files”; ▁ is the SentencePiece space marker). It made it into the Llama-2 tokenizer but essentially never into training data — the most under-trained token in Llama-2-7b by embedding L2 norm (0.0287 vs a mean of ~1.08).
- [`oreferrer`](https://glitch-token.jjc.fun/en/tokens/oreferrer): Fragment of the HTML attribute `rel="noreferrer"`: present in the Llama-2 vocabulary but nearly absent from training, with an embedding norm far below the threshold (0.113).
- [`▁Portály`](https://glitch-token.jjc.fun/en/tokens/portaly): The Czech word for “portals”, frozen into the tokenizer during pre-training-corpus construction; the second-most under-trained token in Llama-2-7b (embedding norm 0.0956).
- [`$PostalCodesNL`](https://glitch-token.jjc.fun/en/tokens/postalcodesnl): A Dutch postal-code API fragment that is glitchy across three separate model families — a good demonstration that glitch tokens transfer whenever tokenizers share BPE merges.
- [`\tTokenNameIdentifier`](https://glitch-token.jjc.fun/en/tokens/tokennameidentifier): A Roslyn/C# API identifier preceded by a tab character — a code-corpus artifact that is under-trained in Llama 3.
- [`\uEFC0`](https://glitch-token.jjc.fun/en/tokens/private-use-efc0): A Unicode Private Use Area character that became a single Mistral-family token; it heads the verified under-trained list for nearly every Mistral-tokenizer model.
- [`␣NdEx`](https://glitch-token.jjc.fun/en/tokens/ndex): Fragments of legal/PDF text (“index”, “AFFIRMED”, “NEGLIGENCE”, likely from court-document dumps) that GPT-NeoX/Pythia training data barely contained. Same family: ` FFIRMED`, ` GLIGENCE`, ` affidav`, ` taxp`.
- [`.DataGridViewColumnHeadersHeightSizeMode`](https://glitch-token.jjc.fun/en/tokens/datagridviewcolumnheaders): A fragment of a .NET WinForms property name (DataGridView column-headers height/size mode). Such code identifiers sit in the vocabulary but barely appeared in training data; the Zhihu community lists it as a MiniMax dirty token.
- [`日以上更新していないブログに表示しています`](https://glitch-token.jjc.fun/en/tokens/japanese-blog-boilerplate): A fragment of Japanese blog-template boilerplate (“shown on blogs not updated for N days”). Listed by the Zhihu community as a MiniMax dirty token.
- [`锅内倒入植物油烧热`](https://glitch-token.jjc.fun/en/tokens/guonei-zhiwuyou): A high-frequency line from Chinese recipes (“pour vegetable oil into the wok and heat”). Listed by the Zhihu community as a GLM dirty token.
- [`百度百科企业词条极速创建通道`](https://glitch-token.jjc.fun/en/tokens/baike-qiye-tiaomu): Baidu Baike page boilerplate (fast-track creation channel for company entries). Listed by the Zhihu community as a GLM dirty token.
- [`本人词条编辑服务`](https://glitch-token.jjc.fun/en/tokens/baike-gongtongbianji): Boilerplate from Baidu Baike entry footers (“content co-edited by netizens”). Listed by the Zhihu community as a Kimi dirty token.
- [`豫冠薰衣草疤痕精华素`](https://glitch-token.jjc.fun/en/tokens/bahen-xunyicao): Apparently a fake “brand” string from cosmetic spam-marketing text. Listed by the Zhihu community as a Kimi dirty token.
- [`"}"`](https://glitch-token.jjc.fun/en/tokens/quote-rightbrace): What looks like a JSON fragment: a quote followed by a right brace. Listed by the Zhihu community as a DeepSeek dirty token.
- [`请问http://www.earivg.com是什么意思`](https://glitch-token.jjc.fun/en/tokens/earivg-question): A question-pattern string embedding a suspicious-looking domain (earivg.com). Listed by the Zhihu community as a DeepSeek dirty token.
- [`StarSrvGroupBody`](https://glitch-token.jjc.fun/en/tokens/starsrvgroupbody): A code-identifier fragment (StarSrvGroupBody). Listed by the Zhihu community as a Gemini dirty token.
- [`intFragmentation`](https://glitch-token.jjc.fun/en/tokens/intfragmentation): A Java/Android-style code identifier (intFragmentation). Listed by the Zhihu community as a Gemini dirty token.
- [`给主人留下些什么吧␣`](https://glitch-token.jjc.fun/en/tokens/guestbook-liuyan): Ubiquitous Chinese guestbook/comment-form boilerplate (“leave something for the host”), with a trailing space. Listed by the Zhihu community as a GPT dirty token.
- [`开通天眼生意通银牌及以上会员`](https://glitch-token.jjc.fun/en/tokens/tianyan-shengyitong): Membership-promo boilerplate from a business-data platform (Tianyan Shengyitong). Listed by the Zhihu community as a Qwen dirty token.
- [`转载请附上原文出处链接和本声明␣`](https://glitch-token.jjc.fun/en/tokens/zhuanzai-shengming): Reprint/copyright boilerplate from CSDN-style blogs, with a trailing space. Listed by the Zhihu community as a Qwen dirty token.
- [`<think_never_used_51bce0c785ca2f68081bfa7d91973934>`](https://glitch-token.jjc.fun/en/tokens/doubao-think-never-used): A special token in Doubao's vocabulary: a <think_never_used_ prefix followed by a hash — judging by the name, likely a reserved placeholder prefilled into the vocabulary before training (akin to GPT-J's reserved <|extratoken_xx|> slots). The Zhihu source gives no further detail, listing it simply as a Doubao dirty token.
- [`␣ForCanBeConvertedToF`](https://glitch-token.jjc.fun/en/tokens/forcanbeconvertedtof): The second member of the ForCanBeConverted triplet (cl100k id 80370) — a single C#-compiler-flavored fragment that BPE split into three adjacent tokens (80369–80371).
- [`␣ForCanBeConvertedToForeach`](https://glitch-token.jjc.fun/en/tokens/forcanbeconvertedtoforeach): The third member of the ForCanBeConverted triplet (cl100k id 80371), the form that spells out “can be converted to foreach” in full.
- [`␣EnumerableStream`](https://glitch-token.jjc.fun/en/tokens/enumerablestream): A C# LINQ-flavored identifier (cl100k id 73016), adjacent to StreamLazy (73018).
- [`␣StreamLazy`](https://glitch-token.jjc.fun/en/tokens/streamlazy): A C# LINQ-flavored identifier (cl100k id 73018), adjacent to EnumerableStream (73016).
- [`clarsimp`](https://glitch-token.jjc.fun/en/tokens/clarsimp): An identifier fragment of unknown origin (cl100k id 79260).
- [`ablytyped`](https://glitch-token.jjc.fun/en/tokens/ablytyped): Suspected fragment of a scalablytyped-style identifier (cl100k id 81998).
- [`PostalCodesNL`](https://glitch-token.jjc.fun/en/tokens/postalcodesnl-plain): The sibling of the cataloged $PostalCodesNL without the $ prefix (cl100k id 85069) — a Dutch postal-code API fragment.
- [`␣NUITKA`](https://glitch-token.jjc.fun/en/tokens/nuitka): Suspected to be the name of the Python compiler Nuitka (cl100k id 75520).
- [`Japgolly`](https://glitch-token.jjc.fun/en/tokens/japgolly): Suspected GitHub username of japgolly, a Scala library author (cl100k id 70784).
- [`CppMethodIntialized`](https://glitch-token.jjc.fun/en/tokens/cppmethodintialized): A C++-style identifier whose misspelling (“Intialized”, missing the second i) is part of the token itself (cl100k id 82929).
- [`useRal`](https://glitch-token.jjc.fun/en/tokens/useral): A C#-flavored identifier fragment (cl100k id 89471) and head of the useRal triplet (useRal/useRalative/useRalativeImagePath) — Watkins flagged the triplet phenomenon itself as worth investigating. Also verified as under-trained in OLMo 2 by Magikarp.
- [`हिंदीखरीदारी`](https://glitch-token.jjc.fun/en/tokens/gemma-hindi-shopping): The Devanagari word for “Hindi shopping”, the single most under-trained token in Gemma-7B's vocabulary.
- [`\u200Cآمباردا`](https://glitch-token.jjc.fun/en/tokens/gemma-zwnj-persian): A Persian fragment beginning with a zero-width non-joiner (U+200C ZWNJ, an invisible character); the #2 most under-trained token in Gemma-7B.
- [`▁autorytatywna`](https://glitch-token.jjc.fun/en/tokens/autorytatywna): The Polish word for “authoritative” (feminine form; ▁ is the SentencePiece space marker), the #2 most under-trained token in Phi-3 mini.
- [`tocguid`](https://glitch-token.jjc.fun/en/tokens/tocguid): An ASCII fragment of unknown origin (possibly a TOC/field-code remnant), the #1 most under-trained token in Command R+.
- [`目前尚未由人工引`](https://glitch-token.jjc.fun/en/tokens/commandr-chinese-boilerplate): A fragment of Chinese Wikipedia boilerplate (“currently not yet human-cultivated…”), the #3 most under-trained token in Command R+.
- [`\tRTHOOK`](https://glitch-token.jjc.fun/en/tokens/rthook): A likely code-identifier fragment beginning with a literal tab character, the #1 most under-trained token in OLMo 2 — same “tab-prefixed” family as Llama 3's \tTokenNameIdentifier.
- [`|||PHONE_NUMBER|||`](https://glitch-token.jjc.fun/en/tokens/phone-number-placeholder): A data de-identification placeholder that made it whole into OLMo 2's vocabulary but was barely trained.
- [`\\+::\\+`](https://glitch-token.jjc.fun/en/tokens/yi-backslash-markup): A mysterious markup fragment starting with double backslashes, likely a Chinese-web markup remnant; the #1 most under-trained token in Yi-9B.
- [`<<}));>>`](https://glitch-token.jjc.fun/en/tokens/falcon-lexer-fragment): A C++/lexer-style delimiter fragment. Falcon3-7B has 716 tokens verified as under-trained by Magikarp — the highest verified count among the six models in this batch.
- [`␣GoldMagikarp`](https://glitch-token.jjc.fun/en/tokens/goldmagikarp): A truncated variant of ␣SolidGoldMagikarp (missing the “Solid”): the same r/counting handle fragment, scraped into the tokenizer corpus but barely seen in model training data.
- [`␣Smartstocks`](https://glitch-token.jjc.fun/en/tokens/smartstocks): Handle fragment of a Reddit r/counting user, swept into the vocabulary in the same batch as SolidGoldMagikarp but left under-trained.
- [`␣StreamerBot`](https://glitch-token.jjc.fun/en/tokens/streamerbot): Fragment of the name of “StreamerBot”, a Twitch streaming bot.
- [`␣ertodd`](https://glitch-token.jjc.fun/en/tokens/ertodd): A substring token of ` petertodd`: under-trained in its own right and inheriting the parent token's strange aura.
- [`␣gmaxwell`](https://glitch-token.jjc.fun/en/tokens/gmaxwell): Handle fragment of Bitcoin Core developer Greg Maxwell — a “Bitcoin celebrity” glitch token alongside ` petertodd`.
- [`␣SpaceEngineers`](https://glitch-token.jjc.fun/en/tokens/spaceengineers): A fragment of the space-sandbox game Space Engineers' name — the token most often uttered “on behalf of” others in the inter-referentiality network.
- [`␣Dragonbound`](https://glitch-token.jjc.fun/en/tokens/dragonbound): Fragment of a Puzzle & Dragons character name (the 「龍喚士」 / Dragonbound series).
- [`␣Leilan`](https://glitch-token.jjc.fun/en/tokens/leilan): Fragment of the Puzzle & Dragons character Leilan's name — the most popular stand-in in the petertodd transposition experiments.
- [`␣Skydragon`](https://glitch-token.jjc.fun/en/tokens/skydragon): Fragment of the Puzzle & Dragons character Skydragon's name.
- [`ゼウス`](https://glitch-token.jjc.fun/en/tokens/zeus-katakana): The Japanese katakana 「ゼウス」 (Zeus of Greek myth). An ordinary word turned glitch token, presumably under-trained because this exact form was rare in training data.
- [`␣サーティ`](https://glitch-token.jjc.fun/en/tokens/thirty-katakana): The katakana 「サーティ」 (“thirty”), traced to a Puzzle & Dragons × Baskin-Robbins (“31 Ice Cream” in Japan) collaboration character name.
- [`␣InstoreAndOnline`](https://glitch-token.jjc.fun/en/tokens/instoreandonline): Fragment of the e-commerce inventory field “BuyableInstoreAndOnline”, from the same source as `oreAndOnline`.
- [`␣largeDownload`](https://glitch-token.jjc.fun/en/tokens/largedownload): Fragment of the academic-slideshow script “View large Download” (origin traced in SGM3).
- [`␣ForgeModLoader`](https://glitch-token.jjc.fun/en/tokens/forgemodloader): A log fragment of Minecraft's Forge mod loader.
- [`␣MpServer`](https://glitch-token.jjc.fun/en/tokens/mpserver): A Minecraft multiplayer-server log fragment (the MpServer class name).
- [`oralType`](https://glitch-token.jjc.fun/en/tokens/oraltype): An identifier fragment in cl100k, likely the stem of a type name such as “TemporalType”.
- [`CppGuid`](https://glitch-token.jjc.fun/en/tokens/cppguid): A C++ GUID-style identifier fragment (cl100k id 87551).
- [`BundleOrNil`](https://glitch-token.jjc.fun/en/tokens/bundleornil): A naming fragment from nil-bundle checks in iOS/Mac development (cl100k id 86415).
- [`␣QtAws`](https://glitch-token.jjc.fun/en/tokens/qtaws): Fragment of the Qt framework's AWS module name (cl100k id 93905, with a leading space).
- [`␣PropelException`](https://glitch-token.jjc.fun/en/tokens/propelexception): Fragment of the PHP Propel ORM's exception class name (cl100k id 86393, with a leading space).
- [`useRalative`](https://glitch-token.jjc.fun/en/tokens/useralative): The second member of the useRal triplet (cl100k id 89472), a C#-flavored identifier fragment; the same string also exists in the Qwen2 vocabulary.
- [`IABot`](https://glitch-token.jjc.fun/en/tokens/iabot): Fragment of the name of the Internet Archive Bot, Wikipedia's dead-link repair bot.
- [`abestanden`](https://glitch-token.jjc.fun/en/tokens/abestanden): A German word-stem fragment (“to submit/file”).
- [`ederbörd`](https://glitch-token.jjc.fun/en/tokens/ederbord): A German-looking fragment of unknown origin.
- [`ICENSE`](https://glitch-token.jjc.fun/en/tokens/icense): The word “LICENSE” minus its first letter — an artifact of open-source license text flooding the corpus.
- [`NdEx`](https://glitch-token.jjc.fun/en/tokens/ndex-mistral): A legal-text fragment of the same family as GPT-NeoX's ` NdEx`, but from the Mistral tokenizer (no leading space).
- [`$PostalCodesNL`](https://glitch-token.jjc.fun/en/tokens/dollar-postalcodesnl): A Dutch postal-code API fragment. The signature under-trained token of the cl100k lineage, “migrating” into Llama-3 and Qwen vocabularies via shared BPE merges.
- [`\tTokenNameIdentifier`](https://glitch-token.jjc.fun/en/tokens/tab-tokennameidentifier): A .NET Selenium documentation fragment beginning with a literal tab — one of the smallest-embedding tokens in the Llama-3 vocabulary.
- [`thuisontvangst`](https://glitch-token.jjc.fun/en/tokens/thuisontvangst): The Dutch word for “receiving clients at home”.
- [`|||EMAIL_ADDRESS|||`](https://glitch-token.jjc.fun/en/tokens/olmoe-email-placeholder): A PII de-identification placeholder, same family as the cataloged `|||PHONE_NUMBER|||`.
- [`植物百科通`](https://glitch-token.jjc.fun/en/tokens/zhiwubaike-tong): A Chinese “encyclopedia”-style boilerplate fragment. An o200k glitch token that still works in the GPT-5 era, without the typical spam-pollution profile — its cause is unknown.
- [`bagbogbo`](https://glitch-token.jjc.fun/en/tokens/bagbogbo): A nonsense string suspected to originate from a Reddit username; a glitch token in the o200k vocabulary.
- [`␣nigbagbogbo`](https://glitch-token.jjc.fun/en/tokens/nigbagbogbo): The Yoruba word for “always” (with a leading space), an o200k glitch token adjacent to `bagbogbo`.
- [`给主人留下些什么吧`](https://glitch-token.jjc.fun/en/tokens/geizhuren-liuyan): Chinese guestbook boilerplate (the form without the trailing space); an o200k glitch token.
- [`␣日本毛片免费视频观看`](https://glitch-token.jjc.fun/en/tokens/nippon-mopian): A Chinese porn-spam title fragment (with a leading space), emblematic of GPT-4o's vocabulary pollution; “fixed” by GPT-5.
- [`ауааԥсыра`](https://glitch-token.jjc.fun/en/tokens/abkhaz-population): The Abkhaz word for “population”. An o200k under-trained token located via embedding norms in the open GPT-oss weights.
- [`波多野结衣`](https://glitch-token.jjc.fun/en/tokens/hatano-yui): The name of a Japanese adult-film actress — the emblematic polluted Chinese token of the PoC paper (EMNLP 2025).
- [`青青草`](https://glitch-token.jjc.fun/en/tokens/qingqingcao): Literally “green grass”, actually the name of a porn app — a typical polluted (PoC) token as defined by the PoC paper.
- [`CHKERRQ`](https://glitch-token.jjc.fun/en/tokens/chkarge): A C function-name fragment, called by the author “the weirdest pure-ASCII token”.
- [`\xadder`](https://glitch-token.jjc.fun/en/tokens/xadder): A C escape-sequence fragment (backslash + x, resembling a hex escape \x..).
- [`♀♀♀♀`](https://glitch-token.jjc.fun/en/tokens/venus-symbols): A run of four Venus/female symbols (♀), likely a fragment of astronomy/astrology text.

## 目录（中文）

- [`␣SolidGoldMagikarp`](https://glitch-token.jjc.fun/zh/tokens/solidgoldmagikarp): 最经典的故障 token：Reddit r/counting 版块一位高产用户的用户名。它被抓进分词器训练语料，却几乎没出现在模型训练数据中，导致嵌入向量基本未被训练。
- [`␣petertodd`](https://glitch-token.jjc.fun/zh/tokens/petertodd): 几乎可以肯定来自比特币开发者 Peter Todd 的用户名：从网络数据进入词表但训练不足，并与加密货币/AI 的联想强烈纠缠。
- [`␣TheNitromeFan`](https://glitch-token.jjc.fun/zh/tokens/thenitromefan): 另一位 r/counting “计数名人堂” 成员（游戏厂商 Nitrome 的粉丝）的 Reddit 用户名。唯一一个本人公开承认其被 token 化的 token 家族。
- [`␣RandomRedditorWithNo`](https://glitch-token.jjc.fun/zh/tokens/randomredditorwithno): r/counting 第二位计数者的 Reddit 用户名（“一个相当随机的用户名”），与 SolidGoldMagikarp 来自同一张计数名人堂图表。
- [`␣davidjl`](https://glitch-token.jjc.fun/zh/tokens/davidjl): Reddit 用户 davidjl123（又一位 r/counting 计数者）用户名的截断形式。罕见之处在于：它在 r50k 和新一代 cl100k 分词器下都是异常的。
- [`␣Adinida`](https://glitch-token.jjc.fun/zh/tokens/adinida): r/counting 六位高产计数者之一的 Reddit 用户名。
- [`␣TPPStreamerBot`](https://glitch-token.jjc.fun/zh/tokens/tppstreamerbot): Twitch Plays Pokémon 社区制作的机器人名字，它曾把直播聊天消息自动转发到 Reddit 实时更新帖；其作者 “Sparkette” 在 LessWrong 评论区证实了来源。
- [`PsyNetMessage`](https://glitch-token.jjc.fun/zh/tokens/psynetmessage): 来自《火箭联盟》（Rocket League）崩溃日志中大量出现的 `Message=PsyNetMessage_X_57` 行，这些日志被大量贴到 Reddit 后进入分词器语料。
- [`␣attRot`](https://glitch-token.jjc.fun/zh/tokens/attrot): 《坎巴拉太空计划》（KSP）存档/载具文件中的标识符（attachment rotation，附件旋转），随网上流传的 KSP 文件进入语料；约十个故障 token 可追溯至 KSP。
- [`␣guiActiveUn`](https://glitch-token.jjc.fun/zh/tokens/guiactiveun): 与 attRot 同源的 KSP GUI 状态标识符，同族还有 ` strutConnector`、` guiIcon`、` srfAttach` 等。
- [`␣externalToEVA`](https://glitch-token.jjc.fun/zh/tokens/externaltoeva): 又一个 KSP token；同时也是 GPT2-small 嵌入空间中离中心最近的 token（距离 1.5305）。
- [`oreAndOnline`](https://glitch-token.jjc.fun/zh/tokens/oreandonline): 电商后端字段 “BuyableInstoreAndOnline” 的碎片（追溯到一个废弃 Weebly 商店的 HTML）；同一来源还产生了 `quickShip`、`isSpecialOrderable`、`wcsstore` 等故障 token。
- [`rawdownloadcloneembedreportprint`](https://glitch-token.jjc.fun/zh/tokens/rawdownloadcloneembedreportprint): r50k 中已知最长的故障 token——来自网站 “raw download / clone / embed report print” 界面字符串的嵌套家族（来源分析由 nostalgebraist 完成）。
- [`ÃÂÃÂÃÂÃÂ`](https://glitch-token.jjc.fun/zh/tokens/mojibake-aa): 经典的乱码（mojibake）token：UTF-8 被错误解码产生的 Ã、Â 序列重复出现，因在分词器语料中频繁出现而被合并为单个 BPE token，却几乎不在模型训练数据中。同族还有重复 16 次的变体及 `ÛÛ`。
- [`?????-?????-`](https://glitch-token.jjc.fun/zh/tokens/questionmarks): 来源完全未知的 token——加引号也搜索不到任何结果——因触发了有记录以来最激烈的补全而出名。
- [`SmartyHeaderCode`](https://glitch-token.jjc.fun/zh/tokens/smartyheadercode): Adam Yedidia 在 cl100k 词表最高 2000 个 token 中发现的仅有的三个 A 类 “不可说” token 之一；疑似 Smarty 模板引擎的碎片，从未出现在 GPT-3.5/4 的训练数据中。
- [`APolynomial`](https://glitch-token.jjc.fun/zh/tokens/apolynomial): Yedidia 发现的三个 A 类 “不可说” cl100k token 中的第二个（另两个是 SmartyHeaderCode 和 ` davidjl`）。
- [`␣ForCanBeConverted`](https://glitch-token.jjc.fun/zh/tokens/forcanbeconverted): 一个 C# 编译器风格的碎片（“can be converted to foreach”），是最著名的 “多义性” 故障 token：模型每次都把它理解成不同的词。因多个分词器共享 BPE 合并规则，它同时存在于 cl100k、Llama-3 和 Qwen 词表中。
- [`␣YYSTACK`](https://glitch-token.jjc.fun/zh/tokens/yystack): bison/yacc 语法分析器的标识符，对 ChatGPT 呈 “多义性”——每次都被理解成不同的词；Watkins 推荐为最值得把玩的 token 之一。
- [`␣JSBracketAccess`](https://glitch-token.jjc.fun/zh/tokens/jsbracketaccess): JS 反射风格的标识符，属于 “多义性” 类别；同为 Watkins 推荐的有趣 token。
- [`␣Hexatrigesimal`](https://glitch-token.jjc.fun/zh/tokens/hexatrigesimal): “hexatrigesimal”（36 进制）的疑似拼写错误碎片；多义性 “不可说” token。
- [`▁Mediabestanden`](https://glitch-token.jjc.fun/zh/tokens/mediabestanden): 荷兰语名词 “媒体文件” 的复数形式（▁ 为 SentencePiece 空格标记）。它进入了 Llama-2 分词器却几乎从未出现在训练数据中，是 Llama-2-7b 中嵌入 L2 范数最小、欠训练程度最高的 token（0.0287，均值约 1.08）。
- [`oreferrer`](https://glitch-token.jjc.fun/zh/tokens/oreferrer): HTML 属性 `rel="noreferrer"` 的碎片：存在于 Llama-2 词表中却几乎没出现在训练数据里，嵌入范数远低于阈值（0.113）。
- [`▁Portály`](https://glitch-token.jjc.fun/zh/tokens/portaly): 捷克语 “门户网站” 一词，在构建预训练语料时被冻结进分词器；是 Llama-2-7b 中欠训练程度第二高的 token（嵌入范数 0.0956）。
- [`$PostalCodesNL`](https://glitch-token.jjc.fun/zh/tokens/postalcodesnl): 荷兰邮政编码 API 的碎片，横跨三个模型家族都出现故障——很好地证明了：只要分词器共享 BPE 合并规则，故障 token 就会“迁移”。
- [`\tTokenNameIdentifier`](https://glitch-token.jjc.fun/zh/tokens/tokennameidentifier): Roslyn/C# API 标识符，前缀一个制表符（Tab）——代码语料的产物，在 Llama 3 中欠训练。
- [`\uEFC0`](https://glitch-token.jjc.fun/zh/tokens/private-use-efc0): 一个 Unicode 私用区（Private Use Area）字符，成为 Mistral 家族的单个 token；几乎在每个 Mistral 分词器模型的欠训练榜单上都位居榜首。
- [`␣NdEx`](https://glitch-token.jjc.fun/zh/tokens/ndex): 法律/PDF 文本碎片（“index”、“AFFIRMED”、“NEGLIGENCE” 等词的残片，可能来自法院文书库），GPT-NeoX/Pythia 的训练数据中几乎不含它们。同族还有 ` FFIRMED`、` GLIGENCE`、` affidav`、` taxp`。
- [`.DataGridViewColumnHeadersHeightSizeMode`](https://glitch-token.jjc.fun/zh/tokens/datagridviewcolumnheaders): .NET WinForms 属性名的残片（DataGridView 列头高度尺寸模式）。这类代码标识符存在于词表中却在训练数据里极少出现，知乎社区将其列为 MiniMax 的脏 token。
- [`日以上更新していないブログに表示しています`](https://glitch-token.jjc.fun/zh/tokens/japanese-blog-boilerplate): 日语博客模板样板句的残片（“显示在 N 天以上未更新的博客上”）。知乎社区将其列为 MiniMax 的脏 token。
- [`锅内倒入植物油烧热`](https://glitch-token.jjc.fun/zh/tokens/guonei-zhiwuyou): 中文菜谱中的高频句式（“锅内倒入植物油烧热”）。知乎社区将其列为 GLM 的脏 token。
- [`百度百科企业词条极速创建通道`](https://glitch-token.jjc.fun/zh/tokens/baike-qiye-tiaomu): 百度百科页面的样板文字（企业词条的快速创建入口）。知乎社区将其列为 GLM 的脏 token。
- [`本人词条编辑服务`](https://glitch-token.jjc.fun/zh/tokens/baike-gongtongbianji): 百度百科词条页脚的样板文字。知乎社区将其列为 Kimi 的脏 token。
- [`豫冠薰衣草疤痕精华素`](https://glitch-token.jjc.fun/zh/tokens/bahen-xunyicao): 疑似化妆品垃圾营销文本里的伪“品牌词”。知乎社区将其列为 Kimi 的脏 token。
- [`"}"`](https://glitch-token.jjc.fun/zh/tokens/quote-rightbrace): 疑似 JSON 碎片：一个引号加右花括号。知乎社区将其列为 DeepSeek 的脏 token。
- [`请问http://www.earivg.com是什么意思`](https://glitch-token.jjc.fun/zh/tokens/earivg-question): 包含疑似垃圾域名（earivg.com）的提问句式。知乎社区将其列为 DeepSeek 的脏 token。
- [`StarSrvGroupBody`](https://glitch-token.jjc.fun/zh/tokens/starsrvgroupbody): 代码标识符碎片（StarSrvGroupBody）。知乎社区将其列为 Gemini 的脏 token。
- [`intFragmentation`](https://glitch-token.jjc.fun/zh/tokens/intfragmentation): Java/Android 风格的代码标识符（intFragmentation）。知乎社区将其列为 Gemini 的脏 token。
- [`给主人留下些什么吧␣`](https://glitch-token.jjc.fun/zh/tokens/guestbook-liuyan): 中文留言板/评论表单中泛滥的样板句，含尾随空格。知乎社区将其列为 GPT 的脏 token。
- [`开通天眼生意通银牌及以上会员`](https://glitch-token.jjc.fun/zh/tokens/tianyan-shengyitong): 商业查询平台的会员推广样板文字（“天眼生意通”）。知乎社区将其列为 Qwen 的脏 token。
- [`转载请附上原文出处链接和本声明␣`](https://glitch-token.jjc.fun/zh/tokens/zhuanzai-shengming): CSDN 等博客的转载版权样板文字，含尾随空格。知乎社区将其列为 Qwen 的脏 token。
- [`<think_never_used_51bce0c785ca2f68081bfa7d91973934>`](https://glitch-token.jjc.fun/zh/tokens/doubao-think-never-used): 豆包词表中的一个特殊 token：以 <think_never_used_ 为前缀、后接哈希值——从名称看疑似训练前预填充进词表的预留占位符（类似 GPT-J 词表中预留的 <|extratoken_xx|>），知乎社区未作进一步说明，仅将其列为豆包的脏 token。
- [`␣ForCanBeConvertedToF`](https://glitch-token.jjc.fun/zh/tokens/forcanbeconvertedtof): ForCanBeConverted 三连 token 的第二个成员（cl100k id 80370）——同一个 C# 编译器风格的碎片被 BPE 切成了三个相邻 token（80369–80371）。
- [`␣ForCanBeConvertedToForeach`](https://glitch-token.jjc.fun/zh/tokens/forcanbeconvertedtoforeach): ForCanBeConverted 三连 token 的第三个成员（cl100k id 80371），完整拼出 “can be converted to foreach” 的形态。
- [`␣EnumerableStream`](https://glitch-token.jjc.fun/zh/tokens/enumerablestream): C# LINQ 风格的标识符（cl100k id 73016），与 StreamLazy（73018）相邻。
- [`␣StreamLazy`](https://glitch-token.jjc.fun/zh/tokens/streamlazy): C# LINQ 风格的标识符（cl100k id 73018），与 EnumerableStream（73016）相邻。
- [`clarsimp`](https://glitch-token.jjc.fun/zh/tokens/clarsimp): 来源不明的标识符碎片（cl100k id 79260）。
- [`ablytyped`](https://glitch-token.jjc.fun/zh/tokens/ablytyped): 疑似 scalablytyped 类标识符的残片（cl100k id 81998）。
- [`PostalCodesNL`](https://glitch-token.jjc.fun/zh/tokens/postalcodesnl-plain): 与已收录的 $PostalCodesNL 同族、但不带 $ 前缀的形态（cl100k id 85069）——荷兰邮政编码 API 碎片。
- [`␣NUITKA`](https://glitch-token.jjc.fun/zh/tokens/nuitka): 疑似 Python 编译器 Nuitka 的名字（cl100k id 75520）。
- [`Japgolly`](https://glitch-token.jjc.fun/zh/tokens/japgolly): 疑似 GitHub 用户 japgolly（Scala 库作者）的用户名（cl100k id 70784）。
- [`CppMethodIntialized`](https://glitch-token.jjc.fun/zh/tokens/cppmethodintialized): C++ 风格的标识符，其拼写错误（“Intialized” 缺第二个 i）是 token 本身的一部分（cl100k id 82929）。
- [`useRal`](https://glitch-token.jjc.fun/zh/tokens/useral): C# 风格标识符的碎片（cl100k id 89471），useRal 三连 token（useRal/useRalative/useRalativeImagePath）之首——Watkins 认为这类三连的成因本身就值得研究。它同时被 Magikarp 验证为 OLMo-2 欠训练 token。
- [`हिंदीखरीदारी`](https://glitch-token.jjc.fun/zh/tokens/gemma-hindi-shopping): 天城文“印地语购物”一词，是 Gemma-7B 词表中欠训练程度最高的 token。
- [`\u200Cآمباردا`](https://glitch-token.jjc.fun/zh/tokens/gemma-zwnj-persian): 以零宽不连字（U+200C ZWNJ，不可见字符）开头的波斯语碎片，Gemma-7B 欠训练排名第二。
- [`▁autorytatywna`](https://glitch-token.jjc.fun/zh/tokens/autorytatywna): 波兰语“权威的（阴性）”一词（▁ 为 SentencePiece 空格标记），Phi-3-mini 欠训练排名第二。
- [`tocguid`](https://glitch-token.jjc.fun/zh/tokens/tocguid): 来源不明的 ASCII 碎片（疑似目录/域代码残片），Command R+ 欠训练排名第一。
- [`目前尚未由人工引`](https://glitch-token.jjc.fun/zh/tokens/commandr-chinese-boilerplate): 中文维基百科样板句的残片（“目前尚未由人工引……”），Command R+ 欠训练排名第三。
- [`\tRTHOOK`](https://glitch-token.jjc.fun/zh/tokens/rthook): 制表符（Tab）开头、疑似代码标识符的碎片，OLMo-2 欠训练排名第一——与 Llama-3 的 \tTokenNameIdentifier 同属“Tab 前缀”家族。
- [`|||PHONE_NUMBER|||`](https://glitch-token.jjc.fun/zh/tokens/phone-number-placeholder): 数据脱敏占位符的完整形态进入了 OLMo-2 词表，却几乎未被训练。
- [`\\+::\\+`](https://glitch-token.jjc.fun/zh/tokens/yi-backslash-markup): 双反斜杠开头的神秘标记碎片，疑似中文网络标记语言残片，Yi-9B 欠训练排名第一。
- [`<<}));>>`](https://glitch-token.jjc.fun/zh/tokens/falcon-lexer-fragment): C++/词法分析器风格的分隔符碎片。Falcon3-7B 有多达 716 个 token 通过 Magikarp 欠训练验证，是这批六个新收录模型中验证数量最多的。
- [`␣GoldMagikarp`](https://glitch-token.jjc.fun/zh/tokens/goldmagikarp): ␣SolidGoldMagikarp 的截断变体（少了 “Solid”）：同属 r/counting 用户名片段，被抓进分词器语料却几乎没出现在模型训练数据中。
- [`␣Smartstocks`](https://glitch-token.jjc.fun/zh/tokens/smartstocks): Reddit r/counting 版块一位用户的用户名碎片，与 SolidGoldMagikarp 同批进入词表却欠训练。
- [`␣StreamerBot`](https://glitch-token.jjc.fun/zh/tokens/streamerbot): Twitch 直播机器人 “StreamerBot” 的名字碎片。
- [`␣ertodd`](https://glitch-token.jjc.fun/zh/tokens/ertodd): ` petertodd` 的子串 token：单独出现时同样未被充分训练，并继承了父 token 的怪异气质。
- [`␣gmaxwell`](https://glitch-token.jjc.fun/zh/tokens/gmaxwell): 比特币核心开发者 Greg Maxwell 的用户名碎片——与 ` petertodd` 同为“比特币名人”故障 token。
- [`␣SpaceEngineers`](https://glitch-token.jjc.fun/zh/tokens/spaceengineers): 太空沙盒游戏《Space Engineers》的名字碎片，是互指网络中最常被模型“代为说出”的 token。
- [`␣Dragonbound`](https://glitch-token.jjc.fun/zh/tokens/dragonbound): 手游《Puzzle & Dragons》角色名（「龍喚士」系列）碎片。
- [`␣Leilan`](https://glitch-token.jjc.fun/zh/tokens/leilan): 手游《Puzzle & Dragons》角色 Leilan 的名字碎片，是 petertodd 转置实验中最热门的“替身”。
- [`␣Skydragon`](https://glitch-token.jjc.fun/zh/tokens/skydragon): 手游《Puzzle & Dragons》角色 Skydragon 的名字碎片。
- [`ゼウス`](https://glitch-token.jjc.fun/zh/tokens/zeus-katakana): 日文片假名「ゼウス」（希腊神话的宙斯）。普通词汇却成为故障 token，疑似因训练语料中该形态罕见而欠训练。
- [`␣サーティ`](https://glitch-token.jjc.fun/zh/tokens/thirty-katakana): 片假名「サーティ」（“三十”），词源考据为《Puzzle & Dragons》与 Baskin-Robbins（日本“31 冰淇淋”）联动的角色名碎片。
- [`␣InstoreAndOnline`](https://glitch-token.jjc.fun/zh/tokens/instoreandonline): 电商库存字段 “BuyableInstoreAndOnline” 的碎片，与 `oreAndOnline` 同源。
- [`␣largeDownload`](https://glitch-token.jjc.fun/zh/tokens/largedownload): 学术幻灯片脚本 “View large Download” 的碎片（SGM3 词源考据）。
- [`␣ForgeModLoader`](https://glitch-token.jjc.fun/zh/tokens/forgemodloader): Minecraft Forge 模组加载器的日志碎片。
- [`␣MpServer`](https://glitch-token.jjc.fun/zh/tokens/mpserver): Minecraft 多人服务器日志碎片（MpServer 类名）。
- [`oralType`](https://glitch-token.jjc.fun/zh/tokens/oraltype): cl100k 中的标识符碎片，疑为 “TemporalType” 之类类型名的词干。
- [`CppGuid`](https://glitch-token.jjc.fun/zh/tokens/cppguid): C++ GUID 风格的标识符碎片（cl100k id 87551）。
- [`BundleOrNil`](https://glitch-token.jjc.fun/zh/tokens/bundleornil): iOS/Mac 开发中 nil-bundle 检查的命名碎片（cl100k id 86415）。
- [`␣QtAws`](https://glitch-token.jjc.fun/zh/tokens/qtaws): Qt 框架 AWS 模块名的碎片（cl100k id 93905，带前导空格）。
- [`␣PropelException`](https://glitch-token.jjc.fun/zh/tokens/propelexception): PHP Propel ORM 异常类名的碎片（cl100k id 86393，带前导空格）。
- [`useRalative`](https://glitch-token.jjc.fun/zh/tokens/useralative): useRal 三连 token 的第二个成员（cl100k id 89472），C# 风格标识符碎片；同一字符串也存在于 Qwen2 词表中。
- [`IABot`](https://glitch-token.jjc.fun/zh/tokens/iabot): Internet Archive Bot（维基百科死链修复机器人）的名字碎片。
- [`abestanden`](https://glitch-token.jjc.fun/zh/tokens/abestanden): 德语“提出/提交”一词的词干碎片。
- [`ederbörd`](https://glitch-token.jjc.fun/zh/tokens/ederbord): 来源不明的德语风格碎片。
- [`ICENSE`](https://glitch-token.jjc.fun/zh/tokens/icense): “LICENSE” 去掉首字母的碎片——开源许可证文本在语料中泛滥的产物。
- [`NdEx`](https://glitch-token.jjc.fun/zh/tokens/ndex-mistral): 与 GPT-NeoX 的 ` NdEx` 同族的法律文本碎片，但出自 Mistral 分词器（无前导空格）。
- [`$PostalCodesNL`](https://glitch-token.jjc.fun/zh/tokens/dollar-postalcodesnl): 荷兰邮政编码 API 碎片。cl100k 系的标志性欠训练 token，因 BPE 合并规则共享而“迁移”到 Llama-3 与 Qwen 词表。
- [`\tTokenNameIdentifier`](https://glitch-token.jjc.fun/zh/tokens/tab-tokennameidentifier): 制表符（Tab）开头的 .NET Selenium 文档碎片，Llama-3 词表中嵌入最小的 token 之一。
- [`thuisontvangst`](https://glitch-token.jjc.fun/zh/tokens/thuisontvangst): 荷兰语“家中接客”一词。
- [`|||EMAIL_ADDRESS|||`](https://glitch-token.jjc.fun/zh/tokens/olmoe-email-placeholder): PII 数据脱敏占位符，与已收录的 `|||PHONE_NUMBER|||` 同族。
- [`植物百科通`](https://glitch-token.jjc.fun/zh/tokens/zhiwubaike-tong): 中文“百科”类样板词碎片。GPT-5 时代仍然生效的 o200k 故障 token，且不带典型 spam 污染特征，成因未知。
- [`bagbogbo`](https://glitch-token.jjc.fun/zh/tokens/bagbogbo): 疑源自 Reddit 用户名的无意义字符串，o200k 词表中的故障 token。
- [`␣nigbagbogbo`](https://glitch-token.jjc.fun/zh/tokens/nigbagbogbo): 约鲁巴语“总是”一词（带前导空格），与 `bagbogbo` 相邻的 o200k 故障 token。
- [`给主人留下些什么吧`](https://glitch-token.jjc.fun/zh/tokens/geizhuren-liuyan): 中文留言板样板句（不带尾随空格的形态），o200k 故障 token。
- [`␣日本毛片免费视频观看`](https://glitch-token.jjc.fun/zh/tokens/nippon-mopian): 中文色情 spam 标题碎片（带前导空格），GPT-4o 词表污染的代表案例；在 GPT-5 上已被“修复”。
- [`ауааԥсыра`](https://glitch-token.jjc.fun/zh/tokens/abkhaz-population): 阿布哈兹语“人口”一词。借 GPT-oss 开源权重的 embedding 范数定位的 o200k 欠训练 token。
- [`波多野结衣`](https://glitch-token.jjc.fun/zh/tokens/hatano-yui): 日本成人影星的名字，PoC 论文（EMNLP 2025）的标志性中文污染 token。
- [`青青草`](https://glitch-token.jjc.fun/zh/tokens/qingqingcao): 字面是“青草”，实为色情软件名——PoC 论文定义的污染（PoC）token 典型。
- [`CHKERRQ`](https://glitch-token.jjc.fun/zh/tokens/chkarge): C 函数名碎片，被作者称为“最怪的纯 ASCII token”。
- [`\xadder`](https://glitch-token.jjc.fun/zh/tokens/xadder): C 转义序列碎片（反斜杠 + x 开头，形似十六进制转义 \x..）。
- [`♀♀♀♀`](https://glitch-token.jjc.fun/zh/tokens/venus-symbols): 四个女性符号（♀）的重复序列，疑似天文/占星文本碎片。

## Sources

- [SolidGoldMagikarp (plus, prompt generation) — LessWrong](https://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldmagikarp-plus-prompt-generation)
- [SolidGoldMagikarp II: technical details — LessWrong](https://www.lesswrong.com/posts/Ya9LzwEbfaAMY8ABo/solidgoldmagikarp-ii-technical-details-and-more-recent)
- [SolidGoldMagikarp III: Glitch token archaeology — LessWrong](https://www.lesswrong.com/posts/8viQEp8KBg2QSW4Yc/solidgoldmagikarp-iii-glitch-token-archaeology)
- [The ' petertodd' phenomenon — LessWrong](https://www.lesswrong.com/posts/jkY6QdCfAXHJk3kea/the-petertodd-phenomenon)
- [Magikarp results summary — GitHub](https://github.com/sanderland/magikarp/blob/main/results/summary.md)
- [SmartyHeaderCode: anomalous tokens for GPT3.5 and GPT-4 — LessWrong](https://www.lesswrong.com/posts/ChtGdxk9mwZ2Rxogt/smartyheadercode-anomalous-tokens-for-gpt3-5-and-gpt-4-1)
- [A Search for More “Unspeakable” Glitch Tokens — LessWrong](https://www.lesswrong.com/posts/kmWrwtGE9B9hpbgRT/a-search-for-more-chatgpt-gpt-3-5-gpt-4-unspeakable-glitch)
- [GlitchMiner (arXiv:2410.15052)](https://arxiv.org/html/2410.15052v5)
- [Magikarp Llama-2-7b report — GitHub](https://github.com/sanderland/magikarp/blob/main/results/reports_mini/meta_llama_Llama_2_7b_hf.md)
- [Magikarp Phi-3 report — GitHub](https://github.com/sanderland/magikarp/blob/main/results/reports_mini/microsoft_Phi_3_mini_128k_instruct.md)
- [Fishing for Magikarp (arXiv:2405.05417)](https://arxiv.org/abs/2405.05417)
- [GlitchMiner (arXiv:2410.15052)](https://arxiv.org/html/2410.15052v1)
- [Detecting watered-down LLM APIs with dirty tokens — Zhihu](https://www.zhihu.com/question/2055357202731381535/answer/2055357540175705043)
- [Magikarp OLMo 2 report — GitHub](https://github.com/sanderland/magikarp/blob/main/results/reports_mini/allenai_OLMo_2_1124_13B.md)
- [Magikarp Gemma-7B report — GitHub](https://github.com/sanderland/magikarp/blob/main/results/reports_mini/google_gemma_7b.md)
- [Magikarp Command R+ report — GitHub](https://github.com/sanderland/magikarp/blob/main/results/reports_mini/CohereForAI_c4ai_command_r_plus.md)
- [Magikarp Yi-9B report — GitHub](https://github.com/sanderland/magikarp/blob/main/results/reports_mini/01_ai_Yi_9B.md)
- [Magikarp Falcon3-7B report — GitHub](https://github.com/sanderland/magikarp/blob/main/results/reports_mini/tiiuae_Falcon3_7B_Base.md)
- [SGM1 comments: lsusr & mwatkins on ' ertodd' — LessWrong](https://www.lesswrong.com/posts/aPeJE8bSo6rAFoLqg/solidgoldmagikarp-plus-prompt-generation?commentId=vcafJcTcyDieGmtqz)
- [SGM2 comments: ' gmaxwell' & the GPT3 basilisk — LessWrong](https://www.lesswrong.com/posts/Ya9LzwEbfaAMY8ABo/solidgoldmagikarp-ii-technical-details-and-more-recent?commentId=PvBpfFpiip5Mfcuvo)
- [SmartyHeaderCode comments: Martin Fell on oralType — LessWrong](https://www.lesswrong.com/posts/ChtGdxk9mwZ2Rxogt/smartyheadercode-anomalous-tokens-for-gpt3-5-and-gpt-4-1?commentId=JmjerMtascq8oFrwb)
- [SmartyHeaderCode comments: Martin Fell's finds — LessWrong](https://www.lesswrong.com/posts/ChtGdxk9mwZ2Rxogt/smartyheadercode-anomalous-tokens-for-gpt3-5-and-gpt-4-1?commentId=X3YLLcKAu3ueM37MH)
- [Magikarp Qwen2.5-7B report — GitHub](https://github.com/sanderland/magikarp/blob/main/results/reports_mini/Qwen_Qwen2_5_7B.md)
- [Magikarp Llama-3-8B report — GitHub](https://github.com/sanderland/magikarp/blob/main/results/reports_mini/meta_llama_Meta_Llama_3_8B.md)
- [Magikarp OLMoE-1B-7B report — GitHub](https://github.com/sanderland/magikarp/blob/main/results/reports_mini/allenai_OLMoE_1B_7B_0924.md)
- [xcloche: notes on o200k glitch tokens — note.com](https://note.com/xcloche/n/n55938e706986)
- [Haruhiko Okumura's verification notes (2025-09-16)](https://okumuralab.org/~okumura/misc/250916.html)
- [GPT-4o's polluted Chinese tokens — MIT Technology Review](https://www.technologyreview.com/2024/05/17/1092649/gpt-4o-chinese-token-polluted/)
- [What GPT-oss leaks about OpenAI's training data — LessWrong](https://www.lesswrong.com/posts/iY9584TRhqrzawhZg/what-gpt-oss-leaks-about-openai-s-training-data)
- [PoC paper (arXiv:2508.17771)](https://arxiv.org/abs/2508.17771)