␣RandomRedditorWithNo

Reddit handle of a second r/counting counter (“a pretty random handle”), scraped from the same Hall-of-Counters chart as SolidGoldMagikarp.

" RandomRedditorWithNo"

␣marks a real space; the symbol itself is not part of the token, and copying preserves it.

Observed behaviors

• 01Among GPT2-xl's farthest-from-centroid tokens (distance 3.325) — in GPT2-xl anomalous tokens cluster far from the centroid, the opposite of GPT2-small and GPT-J.LessWrong
• 02Verified under-trained in GPT-J in the Magikarp verification report.GitHub

References

• SolidGoldMagikarp II: technical details — LessWrong
• Magikarp results summary — GitHub

Related tokens