Monte Carlo Tree Search

AI and Machine Learning · World Models · 2006 · also: MCTS · monte-carlo-tree-search.yaml

Grows a search tree unevenly, spending rollouts where the value estimate is most uncertain. Needs a simulator it can query, which is exactly what most real problems lack.

Colour is the family; a dashed line is the second member of it.

Drag to pan · scroll to zoom · click a node to open it
G markov-decision-process Markov Decision Process monte-carlo-tree-search Monte Carlo Tree Search monte-carlo-tree-search->markov-decision-process it searches the tree those transitions define upper-confidence-bound Upper Confidence Bound monte-carlo-tree-search->upper-confidence-bound every node of the tree is its own bandit problem muzero MuZero muzero->monte-carlo-tree-search it plans by searching inside the learned model

This node

Referenced by

References