cosign
my view is basically: “with even moderate prudence, things will probably go extraordinarily well.”
to expand a bit, I believe that, with moderate prudence beyond what the incentives of advanced capitalism on its own might provide for, I believe it will be possible to bring transformative ai into the world, make it available to everyone, and have that work out in a way that, when we look back on it 100 years hence, we’ll say, “of *course* that was worth it,” even if there were growing pains.
and yet there are people out there who call me a doomer. those people tend to believe that artificial superintelligence is the next app store, or something similarly deflationary and unimaginative.
but my view finds no home among the “doomers,” either. indeed, my view flummoxes the vast majority of people I know who work in “ai safety,” despite us agreeing about quite a bit with regard to near-term policy objectives (transparency, auditing, etc). these disagreements have a lot to do with what kind of a thing I think superintelligence will be, and what kind of a thing they think it will be.
I admit I don’t know who is right. that is one of several reasons that prudence is called for.
“moderate prudence,” when you step back and think about what it represents when exercised across a whole society, still means entire organizations started, thousands of smart people devoting their lives (and lots of tokens) to getting the ai transition right. and it means the collective effort of countless millions more of other, adjacent people.
a collective effort to exercise “moderate prudence,” in a global civilization as capable as ours, is equal to more mindpower and strength than all of humanity combined up until very recently. “moderate prudence,” exercised across the whole of advanced civilization today, is a mightier thing than many ancient armies.
some people believe humanity cannot muster even a modest effort, but that our failure won’t matter, because ai is nothing new. it was never necessary to worry about a transformation because no transformation will occur, they believe. others believe the transformation will be so swift and dramatic that it will overwhelm us puny humans.
I believe our species has been through very many transformations, and I believe we can do it again. I believe we are stronger now than ever before in most ways that matter, and getting stronger still. I believe that America, in particular, is a nation founded in reverence of the idea of exercising prudence and wisdom at the frontier. If any country can lead this, then, I believe it is us.
who, in the end, is the optimist? who, in the end, is the doomer?