# token (1-token.net)

A token is a thing that stands for something else. People use it for coins, subway fares, or a symbol of gratitude. It can also mean a small gift or a sign of belonging to a group.

## What a model may hear
- text fragment (natural language processing): split input into pieces and count or limit them, often charging by the token or cutting off mid-word
- authentication credential (cybersecurity and web APIs): generate or expect a secret string to prove identity, expiring it after a set time
- blockchain asset (cryptocurrency and smart contracts): treat it as a tradeable digital coin or programmable asset on a ledger
- syntactic unit (programming language compilers): parse code into categorized symbols like identifiers or operators
- memory unit (transformer neural networks): allocate attention computation across a fixed-size window of positions

## Where people and models part ways
- Says: "I need more tokens"
  Means: I want more subway rides or game credits
  May be taken as: The model may increase your API rate limit or billing tier, or misunderstand it as a request for longer output
  Say instead: "undefined"
- Says: "Give me a token of appreciation"
  Means: I want a small gift or gesture
  May be taken as: The model may generate a cryptographic string or NFT instead of describing a gift idea
  Say instead: "undefined"
- Says: "My token expired"
  Means: My bus pass or gift card is no longer valid
  May be taken as: The model may assume your login session or API key needs refreshment and give technical instructions
  Say instead: "undefined"
- Says: "Use a token for each word"
  Means: Count one item per word in a game or exercise
  May be taken as: The model may explain byte-pair encoding or subword segmentation, where words often split into multiple tokens
  Say instead: "undefined"

## Tips
- Say 'word or piece' if you mean text length, not 'token'
- Say 'login passcode' or 'API key' if you mean security access
- Specify 'subway token' or 'arcade token' for physical objects
- Say 'NFT' or 'cryptocurrency' if you mean blockchain, not 'token'
- If you mean a symbol or metaphor, say 'symbol' or 'sign'

## Often confused with
- word: A token can be a fragment of a word or multiple words combined
- coin: Coins have intrinsic value; tokens typically represent something else
- password: Passwords are memorized; tokens are usually generated and temporary
- voucher: Vouchers are usually for a specific good or service
- symbol: Symbols are abstract; tokens are often concrete objects or strings