Definition
Tree-of-Thought (ToT) is a reasoning technique where the model explores multiple solution paths in parallel, evaluates each, and picks the best — instead of committing to one chain. Lifts accuracy on hard reasoning beyond what self-consistency CoT achieves but at significantly higher token cost. More common in research papers than production due to expense.
Example
For a complex puzzle, the model generates 4 candidate first-step approaches, evaluates each, expands the most promising 2, and continues until a solution is reached.
When to use
Research, hardest reasoning problems, when CoT and self-consistency don't converge.
Also known as
tree of thought, tot