Introducing the Sakana AI Frontier Intelligence Group 🪷
sakana.ai/frontier-intellige…
Current AI systems are incredibly capable, but is intelligence “solved”? And if not, what’s missing?
At Sakana AI’s Frontier Intelligence Group (FIG), we believe that there are still breakthroughs to be made in AI. The Transformer and language modeling may be incredibly powerful, but it doesn’t mean that better alternatives don’t exist.
Natural intelligence still beats artificial intelligence across many dimensions. Agents lack the deep insights and creativity of humans. Individual models require far more data than the brain to learn robustly, and require far more energy to run. If we set these as targets, what kinds of AI systems could we develop?
Research at FIG has sought to address the gaps between natural and artificial intelligence. Here are some of our works, and the fundamental research questions that motivated them:
• Continuous Thought Machines: How can we improve information processing by leveraging temporal dynamics?
• Augmented Lagrangian Predictive Coding: How can local learning solve multilayer credit assignment?
• Sparser, Faster, Lighter Transformer Models: How can we massively increase data efficiency and generalization?
• The AI Picbreeder Experiment: How can we make artificial open-ended systems?
• Smart Cellular Bricks: How can physical systems achieve collective intelligence and self-repair without a central brain?
We hope that this encourages other researchers to also explore different paradigms, and take a leap of faith with us. After all, in the words of a dear friend of ours, “greatness cannot be planned”.