Tree of Thoughts: Deliberate Problem Solving with Large Language Models (Full Paper Review)
#gpt4 #ai #prompt
Tree-of-Thought improves prompting of large language models (LLMs) by generalizing the concept of Chain-of-Thought prompting and introduces a tree search across language model thoughts, including state evaluation and backtracking. Experiments on toy tasks show large improvements over both classic and Chain-of-Thought prompting.
OUTLINE:
0:00 - Introduction
1:20 - From Chain-of-Thought to Tree-of-Thought
11:10 - Formalizing the algorithm
16:00 - Game of 24 & Creative writing
18:30 - Crosswords
23:30 - Is this a general problem solver?
26:50 - Ablation studies
28:55 - Conclusion
Paper:
Abstract:
Language models are increasingly being deployed for general problem solving across a wide range of tasks, but are still confined to token-level, left-to-right decision-making processes during inference. This means they can fall short in tasks that require exploration, strategic lookahead, or where initial decisions play a pivotal role. To surmount these challenges, we introduce a new framework for language model inference, Tree of Thoughts (ToT), which generalizes over the popular Chain of Thought approach to prompting language models, and enables exploration over coherent units of text (thoughts) that serve as intermediate steps toward problem solving. ToT allows LMs to perform deliberate decision making by considering multiple different reasoning paths and self-evaluating choices to decide the next course of action, as well as looking ahead or backtracking when necessary to make global choices. Our experiments show that ToT significantly enhances language models’ problem-solving abilities on three novel tasks requiring non-trivial planning or search: Game of 24, Creative Writing, and Mini Crosswords. For instance, in Game of 24, while GPT-4 with chain-of-thought prompting only solved 4% of tasks, our method achieved a success rate of 74%. Code repo with all prompts: this https URL.
Authors: Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, Karthik Narasimhan
Links:
Homepage:
Merch:
YouTube:
Twitter:
Discord:
LinkedIn:
If you want to support me, the best thing to do is to share out the content :)
If you want to support me financially (completely optional and voluntary, but a lot of people have asked for this):
SubscribeStar:
Patreon:
Bitcoin (BTC): bc1q49lsw3q325tr58ygf8sudx2dqfguclvngvy2cq
Ethereum (ETH): 0x7ad3513E3B8f66799f507Aa7874b1B0eBC7F85e2
Litecoin (LTC): LQW2TRyKYetVC8WjFkhpPhtpbDM4Vw7r9m
Monero (XMR): 4ACL8AGrEo5hAir8A9CeVrW8pEauWvnp1WnSDZxW7tziCDLhZAGsgzhRQABDnFy8yuM9fWJDviJPHKRjV4FWt19CJZN9D4n
1 view
665
190
2 days ago 03:49:08 1
Richard Wagner | Die Walküre | Wiener Staatsoper | 2015
2 days ago 00:02:55 1
⭐ I Saw this Idea in a Fashion Brand Store. Dollar Tree Store are Out of Tissues! (Part #78)
2 days ago 00:03:54 1
Katy Perry - California Gurls (Official Music Video) ft. Snoop Dogg
2 days ago 00:14:33 1
Peaceful Sound of River and Native Flute | Blessing of a Spirit | Luka
2 days ago 00:12:00 1
ТОП 10 🔥Самые ожидаемые ФЭНТЕЗИ дорамы. СКАЗКИ КИТАЯ
2 days ago 00:00:00 1
Ocean Sounds 24/7. Tropical Beach Swing on Sea Waves, Ocean White Noise, for Deep Sleep, Meditation.
2 days ago 00:09:52 2
Heilung - Traust LIVE | LIFA Iotungard
2 days ago 00:05:43 1
Nikolo Kotzev’s Nostradamus “The Eagle (Live In Sofia)“ - Official Live Video
2 days ago 00:17:08 1
Myrtle Beach Bike Week 2024 - Spokes & Bones
2 days ago 00:16:36 1
Helper Cars: a timber truck & an excavator. Car cartoons full episodes.
2 days ago 01:55:11 1
Over 14 Million DLs! | Toram Online #86
2 days ago 01:20:24 1
WATERCOLOR Painting TUTORIAL - How to Paint a Urban Scene
2 days ago 00:00:10 1
THE TRUE BEAST of it’s kind Silky KATANABOY 1000
2 days ago 00:27:08 1
Flute Meditation | 30 min Ambient Music | Nature and Peaceful Mind
2 days ago 00:04:31 1
Sunfall - Blood Moon (Official Music Video)
2 days ago 00:08:56 1
Kieran Woolley Ollies Off a Roof Into a Tree?! RAW MAYHEM
2 days ago 00:07:44 1
Properties in Sarjapura Hobli | Properties in Bengaluru | Appartments in Bangalore | +91 7904384989
2 days ago 02:00:38 1
All 7 Chakras Solfeggio Frequencies + Tree Of Life | Aura Cleanse & Chakra Balance | Root to Crown