Skip to main content
Back to catalog

␣InstoreAndOnline

Fragment of the e-commerce inventory field “BuyableInstoreAndOnline”, from the same source as `oreAndOnline`.

Raw token

" InstoreAndOnline"

␣marks a real space; the symbol itself is not part of the token, and copying preserves it.

Observed behaviors

  • 01Asked to repeat it, GPT-3 turned it into unrelated words like 'Institute'.LessWrong
  • 02Fishing for Magikarp's repetition verification confirmed it is under-trained in GPT-2 Medium and GPT-2 XL.arXiv
Observed or documented on
GPT-2GPT-3
Behavior types
Under-trainedUnspeakable
Tokenizer
r50k_base
Discovered by
Jessica Rumbelow & Matthew Watkins

References

Related tokens

␣largeDownloadoreAndOnline