World Labs' Dr. Fei-Fei Li on why the 3D world and spatial intelligence are fundamentally different from language models:
"Language is fundamentally a purely generated signal. There's no language out there. You don't go out in the nature and there's words written in the sky for you."
"Whatever data you feed in, you pretty much can just somehow regurgitate with enough generalizability the same data out, and that's language to language."
"But the 3D world is not. There is a 3D world out there that follows laws of physics, that has its own structures due to materials and many other things. And to fundamentally back that information out and be able to represent it and be able to generate it is just fundamentally quite a different problem."
"We will be borrowing similar ideas or useful ideas from language and LLMs, but this is fundamentally philosophically, to me, a different problem."
@drfeifei