Alex Karp said AI labs may need to be nationalized instead of going public, because markets can't underwrite their unbounded liability.
It's a good point and one I think of as an investor, and it's true that it would help to address the fundamental conflict between corporate profits and public safety.
I'm thinking about parallels to the Cold War, where advancement wasn't driven by private sector initiatives but was carefully managed and regulated by governments due to the existential stakes involved.
So if the potential liability from advanced AI systems is large enough (comparable to that of nuclear weapons) that private markets simply cannot underwrite or responsibly manage the risk, is the traditional model of profit driven innovation flawed in this case?
That said, I see three challenges.
1. Stifling innovation. The Cold War was about incremental improvements on an existing technology whereas AI is more of a discovery process, requiring a lot of trial and error, failure and efficiency...not well suited for government.
2. The government is impacted by politics, election cycles, budget battles, etc. Basically we'd be replacing profit motives with political ones.
3. Shifting the risk from corporate to government doesn't remove the risk. You could argue that a corporation has more financial incentive to manage liability than a government.
It's just not obvious to me. Seems to me a hybrid approach makes more sense, with heavy regulation, oversight, audits, etc.