Parameters

Top-p (Nucleus Sampling)

Also known as: nucleus sampling

In one line

A sampling parameter that limits the AI to picking from the most likely next words.

What does Top-p (Nucleus Sampling) mean?

Top-p 0.9 means "only sample from the smallest set of tokens whose combined probability is 90%". It's an alternative to temperature for controlling randomness.

A real-world example

Setting top-p to 0.5 to make outputs more focused without freezing them completely.

Related terms