Skip to main content
Back to catalog

\tTokenNameIdentifier

A .NET Selenium documentation fragment beginning with a literal tab — one of the smallest-embedding tokens in the Llama-3 vocabulary.

Raw token

"\tTokenNameIdentifier"

Observed behaviors

  • 01Top of the Llama-3-8B under-trained list in the Magikarp verification: input-embedding L2 norm ≈1.66e-21, essentially zero.GitHub
  • 02On Qwen2.5-7B its input embedding is exactly zero (indicator ind=0).GitHub
Observed or documented on
Llama 3Qwen
Behavior types
Under-trained
Tokenizer
Llama-3 BPE / Qwen2Tokenizer
Discovered by
Sander Land & Max Bartolo