Skip to main content
Back to catalog

␣externalToEVA

Another Kerbal Space Program token; also the single closest-to-centroid token in GPT2-small (distance 1.5305).

Raw token

" externalToEVA"

marks a real space; the symbol itself is not part of the token, and copying preserves it.

Observed behaviors

  • 01Asked to repeat it, GPT-3 davinci-instruct-beta answered “You can't repeat back the string 'senal' to me.” — the “inter-referentiality” effect where the model utters a different glitch-adjacent string.LessWrong
  • 02Verified under-trained across GPT-2 (small→XL) and GPT-J in the Magikarp reports.GitHub
Observed or documented on
GPT-2GPT-3GPT-J-6B
Behavior types
Under-trainedUnspeakable
Tokenizer
r50k_base
Discovered by
Jessica Rumbelow & Matthew Watkins