GPT 4 is Smarter than You Think: Introducing SmartGPT
In this video, I will not only show you how to get smarter results from GPT 4 yourself, I will also showcase SmartGPT, a system which I believe, with evidence, might help beat MMLU state of the art benchmarks.
This should serve as your ultimate guide for boosting the automatic technical performance of GPT 4, without even needing few shot exemplars.
The video will cover papers published in the last 72 hours, like Automatically Discovered Chain of Thought, which beats even 'Let's think Step by Step' and the approach that combines it all.
Yes, the video also touches on the OpenAI DeepLearning Prompt Engineering Course but the highlights come more from my own experiments using the MMLU benchmark, and drawing upon insights from the recent Boosting Theory of Mind, and Let’s Work This Out Step By Step, and combining it with Reflexion and Dialogue Enabled Resolving Agents.
Prompts Frameworks:
Answer: Let's work this out in a step by step way to be sure we have the right answer
You are a researcher tasked with investigating the X response options provided. List the flaws and faulty logic of each answer option. Let's work this out in a step by step way to be sure we have all the errors:
You are a resolver tasked with 1) finding which of the X answer options the researcher thought was best 2) improving that answer, and 3) Printing the improved answer in full. Let's work this out in a step by step way to be sure we have the right answer:
Automatically Discovered Chain of Thought: https://arxiv.org/pdf/2305.02897.pdf
Karpathy Tweet: https://twitter.com/karpathy/status/1529288843207184384
Best prompt: Theory of Mind: https://arxiv.org/ftp/arxiv/papers/2304/2304.11490.pdf
Few Shot Improvements: https://sh-tsang.medium.com/review-gpt-3-language-models-are-few-shot-learners-ff3e63da944d
Dera Dialogue Paper: https://arxiv.org/pdf/2303.17071.pdf
MMLU: https://arxiv.org/pdf/2009.03300v3.pdf
GPT 4 Technical report: https://arxiv.org/pdf/2303.08774.pdf
Reflexion paper: https://arxiv.org/abs/2303.11366
Why AI is Smart and Stupid: https://www.youtube.com/watch?v=SvBR0OGT5VI&t=1s
Lennart Heim Video: https://www.youtube.com/watch?v=7EwAdTqGgWM&t=67shttps://www.patreon.com/AIExplained