Token

Tokens are the basic units into which LLMs break down text - such as words, word parts, or characters. The token count determines costs and context window limits. A German word corresponds to approximately 1-2 tokens. Marketing teams need to consider token limits when performing longer analyses or generating content.