I had the pleasure of catching up with Geoff Hinton yesterday to celebrate his birthday. As we took a long, winding walk along the coast, I was reminded of: not all tokens are born equal.
Just as his insights and words from a decade ago still trigger new chains of thought for me, yesterday’s conversation was exceptionally fruitful. We spent some time discussing Tim Lillicrap, my current manager and co-lead of Gemini thinking, whose research on random matrix feedback from ten years ago actually inspired my very first paper with Ilya Sutskever. Geoff offered his perspective on exactly why that method worked, dissecting the phenomenon with precise intuitions grounded in mathematics.
Our discussion ranged from the technical to the philosophical. He remains as intellectually open-minded as ever, still imagining for true novel breakthroughs that go beyond the current paradigms of backpropagation. Our last (brief) chat was shortly after his foward-forward algorithm in late 2022. We also explored global perspectives, touching on the dynamics between China, Japan, and the West. We discussed how the philosophical roots of Asian cultures might be better suited for the societal shifts of a post-AGI world, and what the West could learn from the East to ensure that the future is positive.
On a personal note, I was touched by his genuine concern for the next generation. When I mentioned my daughter, he agreed that raising children is the ultimate way to reshape one’s priorities--a grounding force that liberates you from immediate 'capitalist FOMO' and refocuses you on the long term. His words carry the weight of years of high-quality processing; they aren't just outputs of raw intelligence, but of deep, sincere care for humanity. It is clear he cares about far more than any single technology or nation. His reasoning and stories serve as a powerful reminder to understand and explore the broader world—proof that a vast perspective is what shapes greater wisdom and enhances our humanity.
I attended NeurIPS 2024 hoping to congratulate him on his Nobel Prize but missed the chance. I am so glad I was finally able to do so this year on his birthday. And finally, he left me with a few more important predictive tokens: 'Google and Gemini will win' :)"