Large Language Model Glossary

Key terms and concepts in LLM technology: tokens, context windows, temperature, RAG, fine-tuning, quantization, KV cache, and emergence.

The data

Terms

TermDefinition
TokenA unit of text processed by LLMs, typically a word fragment or punctuation
Context WindowMaximum number of tokens an LLM can process in a single inference
TemperatureSampling parameter controlling randomness in generation (0 = deterministic, >1 = creative)
RAGRetrieval-Augmented Generation: combining LLMs with external knowledge retrieval
Fine-tuningAdapting a pre-trained model to specific tasks with additional training
QuantizationReducing model precision (e.g., FP16 to INT8) to decrease size and increase speed
KV CacheKey-Value cache storing attention computations for efficient autoregressive generation
EmergenceCapabilities that appear only at certain model scales, not predictable from smaller models

Fetch the same bytes

The static files are identical to what the API returns, but with no rate limit and no server round trip. Use the API when you want a query and a content type; use the files when you want to cache one document.

curl "https://yjtoon.com/api/dataset/llm-glossary?format=toon"
const res = await fetch(
  "https://yjtoon.com/static-data/dataset/llm-glossary.toon"
);
const toon = await res.text();

Rate limit: 120 requests per minute per IP, no key and no signup. API reference →

Topics

  • llm
  • ai
  • glossary
  • nlp