ChatGPT will now have vision, but can it do basic logic? I cover the latest news – including GPT Chess! – as well as go through almost a dozen papers and how they relate to the central question of LLM logic and rationality. Starring the Reversal Curse and featuring conversations with two of the authors at the heart of it all.
I also get to a DALL-E 3 vs Midjourney comparison, MuZero, MathGLM, Situational Awareness and much more!
https://www.patreon.com/AIExplained
OpenAI GPT-V (Hear and Speak): https://openai.com/blog/chatgpt-can-now-see-hear-and-speak
Reversal Curse: https://owainevans.github.io/reversal_curse.pdf
Mahesh Tweet: https://twitter.com/madiator/status/1705376797293183208
Neel Nanda Explanation: https://twitter.com/NeelNanda5/status/1705995593657762199
Karpathy tweet: https://twitter.com/karpathy/status/1705322159588208782
Trask Explanation: https://twitter.com/iamtrask/status/1705361947141472528
Play Chess vs GPT 3.5 Instruct: https://parrotchess.com/
Paige Bailey on Cognitive Revolution: https://www.youtube.com/watch?v=K-XYxLifpQE
Faith and Fate Paper: https://arxiv.org/pdf/2305.18654.pdf
Counterfactuals Paper: https://arxiv.org/pdf/2307.02477.pdf
Lesswrong AGI Timelines: https://www.lesswrong.com/posts/SCqDipWAhZ49JNdmL/paper-llms-trained-on-a-is-b-fail-to-learn-b-is-a?commentId=bkxcTqAtYW8wgHKb5
Professor Rao Paper w/ Blocksworld: https://arxiv.org/pdf/2305.15771.pdf
Math Based on Number Reasoning: https://aclanthology.org/2022.findings-emnlp.59.pdf
MuZero: https://www.deepmind.com/blog/muzero-mastering-go-chess-shogi-and-atari-without-rules
https://www.nature.com/articles/s41586-020-03051-4.epdf?sharing_token=kTk-xTZpQOF8Ym8nTQK6EdRgN0jAjWel9jnR3ZoTv0PMSWGj38iNIyNOw_ooNp2BvzZ4nIcedo7GEXD7UmLqb0M_V_fop31mMY9VBBLNmGbm0K9jETKkZnJ9SgJ8Rwhp3ySvLuTcUr888puIYbngQ0fiMf45ZGDAQ7fUI66-u7Y%3D
Efficient Zero: https://arxiv.org/pdf/2111.00210.pdf
Let’s Verify Step by Step OpenAI paper: https://cdn.openai.com/improving-mathematical-reasoning-with-process-supervision/Lets_Verify_Step_by_Step.pdf
My Video on That: https://www.youtube.com/watch?v=hZTZYffRsKI&t=5s
Superintelligence Poll: https://www.vox.com/future-perfect/2023/9/19/23879648/americans-artificial-general-intelligence-ai-policy-poll?s=09
Anthropic Announcement: https://www.anthropic.com/index/anthropic-amazon
DALL-E 3 Tweet Thread: https://twitter.com/OfficialLoganK/status/1704850313889595399
https://www.patreon.com/AIExplained
