Episode 70: Sparks of Artificial General Intelligence?
The Theory of Anything - A podcast by Bruce Nielson and Peter Johansen
Categories:
How does ChatGPT really work? Is there a relationship between a program like ChatGPT and artificial general intelligence (AGI)? This time we review the famous paper "Sparks of Artificial General Intelligence: Early Experiments with GPT-4" from Microsoft Research as well as Melanie Mitchell's criticisms of it. Other papers mentioned: The Unreasonable Effectiveness of Recurrent Neural Networks (2015) GPT-4 Technical Report (2023) Language Models are Few-Shot Learners (2020)
