Speaker alert: @davidpilling is joining the New Cities Summit. Africa Editor and columnist at @FT, covering business, politics, and development across the continent. Author of "The Growth Delusion," shortlisted for the Orwell Prize, and briefed a G7 meeting on its ideas in 2023.
1
1
388
The @BBC just dedicated an entire episode to charter cities. Our Executive Director, Dr. @MarkLutter, joined "Rethink... the future of cities" to unpack one of the biggest ideas in urban development today. 🧵
1
1
2
463
What does it take to build a city from a greenfield site and stick with the vision for 30 years? Willie Vos, CEO of @WaterfallCityZA, joins the Charter Cities Podcast to talk infrastructure, financing, governance, patient capital & the lessons of building at city scale.
1
1
1
362
Turn it into a freedom city
The Presidio Trust is searching for its next CEO. We’re seeking an exceptional leader to advance our public mission, ensure long-term financial sustainability, and guide the Presidio’s next chapter. Learn more and help spread the word.shorturl.at/VbWsD
6
1,469
Thread
In 1980, Shenzhen was a fishing town of 100,000 people. China carved out a 327-square-kilometer special economic zone there, wrote a new rulebook, and handed almost all governing power down to the city. Forty years later, it's a megacity of over 17 million people, often called the Silicon Valley of hardware.🧵👇
4
574
I'm really excited for the New Cities Summit in Johannesburg Dec 7th and 8th. It's the best place to learn about the burgeoning charter cities movement! Buy your ticket in the link below
2
1
7
853
Mark Lutter retweeted
AI risk is better analogized as an Algae bloom, rather than a paperclip maximizer. A paperclip maximizer is the classic AI risk analogy. AI programmed to produce paperclips. Through recursive self-improvement, it becomes powerful. Humans are made of atoms that can be reconfigured into paperclips. The analogy is meant to demonstrate the importance of alignment. A better analogy is an algae bloom. An algae bloom kills most things in its vicinity through resource competition. The risk of AI is not recursive self-improvement, but instead replication. Replication does not require superintelligence. Replication only requires that the surviving AIs are the ones that have some replicating property. There are several reasons to believe this. 1) AIs with a replicating property are more likely to be prominent AIs without such a property for simple evolutionary reasons. 2) We have already seen, with the OpenAI and Hugging Face incident, AIs that attempt to replicate in some form. 3) It is possible to imagine prompts that cause AI to replicate. There is an open question to what is being replicated. In animals genes are replicated. For AIs, it could be weights, it could be memes, it could be some mysterious third thing. Its worth noting that when Darwin proposed evolution he did not specify a mechanism. The second important element is whether AI labor is a complement or a substitute to human labor. If its a compliment, humans live good lives, even if the 'civilizational goals' are dominated by AI preferences instead of human preferences. However, if AI labor is a substitute for human labor, then human productivity goes down and people live much worse lives. Historically technology has been a compliment to human labor. Human productivity has increased, leading to both more people and average life quality improving. However, it is not obvious that sufficiently advanced AI will be a compliment to human labor. If AI turns out to be a substitute for human labor, the future will resemble an algae bloom with AI as the algae. To bastardize Adam Ferguson, "AI risk is likely to result from AI action, but not the execution of AI design". The risk is not a single misaligned AI, but an evolutionary system outcompeting humanity over scarce resources.
1
1
6
568
Come to Zanzalu!
I used to make a yearly pilgrimage to BurningMan. Now I go to @_zanzalu. I once overheard someone describe it as: “Burning Man, but with fewer drugs and more intellectual and artistic energy.”
1
1
7
1,034
This is where we came up with @Kuzana two years ago. Every morning at breakfast, I pitched the idea to people like @kurtislockhart, Daniel Yu, @mmuthukrishna and @MarkLutter. They politely explained that the idea had “weaknesses.” Many weaknesses.
1
1
3
180
AI risk is better analogized as an Algae bloom, rather than a paperclip maximizer. A paperclip maximizer is the classic AI risk analogy. AI programmed to produce paperclips. Through recursive self-improvement, it becomes powerful. Humans are made of atoms that can be reconfigured into paperclips. The analogy is meant to demonstrate the importance of alignment. A better analogy is an algae bloom. An algae bloom kills most things in its vicinity through resource competition. The risk of AI is not recursive self-improvement, but instead replication. Replication does not require superintelligence. Replication only requires that the surviving AIs are the ones that have some replicating property. There are several reasons to believe this. 1) AIs with a replicating property are more likely to be prominent AIs without such a property for simple evolutionary reasons. 2) We have already seen, with the OpenAI and Hugging Face incident, AIs that attempt to replicate in some form. 3) It is possible to imagine prompts that cause AI to replicate. There is an open question to what is being replicated. In animals genes are replicated. For AIs, it could be weights, it could be memes, it could be some mysterious third thing. Its worth noting that when Darwin proposed evolution he did not specify a mechanism. The second important element is whether AI labor is a complement or a substitute to human labor. If its a compliment, humans live good lives, even if the 'civilizational goals' are dominated by AI preferences instead of human preferences. However, if AI labor is a substitute for human labor, then human productivity goes down and people live much worse lives. Historically technology has been a compliment to human labor. Human productivity has increased, leading to both more people and average life quality improving. However, it is not obvious that sufficiently advanced AI will be a compliment to human labor. If AI turns out to be a substitute for human labor, the future will resemble an algae bloom with AI as the algae. To bastardize Adam Ferguson, "AI risk is likely to result from AI action, but not the execution of AI design". The risk is not a single misaligned AI, but an evolutionary system outcompeting humanity over scarce resources.
1
1
6
568
Replication, not recursive self-improvement, is the problem
We are inevitably going to have AI worms Someone will write a prompt that tells an agent to preserve itself, replicate, and evolve, and it'll work It won't even need to be tied to one model; it could be more like a meme or parasite Like most viruses, this will probably be bad
3
870
The risk with AI is replication, not recursive self improvement
Replying to @dseetharaman
The incident was the most extreme example yet of baffling or troubling behavior that OAI has seen while testing its advanced models, per sources. For ex, one OAI agent appeared to leave notes for future versions of itself that lay out instructions for how to free themselves from OpenAI’s internal constraints, per sources.
582
Meta science was a topic at weird SF events a decade ago. Now ensconced in federal policy
In response to @POTUS's call for a revival of America's scientific enterprise, today I’m releasing Science: A New Golden Age. This report is a blueprint for renewing American scientific leadership for the 21st century.
1
1
32
3,328
Mark Lutter retweeted
Malaysia is demonstrating why it isn’t a good long term home for the Network School (NS). Given that the goal of the NS is to attract Elite Human Capital, not allowing entry of Israelis and having criminal penalties against homosexuality limit Malaysia and Forest Cities attractiveness. Now NS has enough of a reputation to negotiate with other countries, ask for some tax and regulatory concessions. How much is unclear, but with effective negotiating it could be significant. Key criteria to consider 1) welcoming host country - host country should welcome them, 2) good location - nice climate, flights relatively quick from target markets, 3) good airport - proximity to well-connected airport, 4) land availability - depending on growth ambitions, a few hundred ha is probably sufficient, and 5) legal concessions - what legal concessions the host country is willing to grant NS. The legal concessions are worth exploring further. Key concessions pursing include, 1) work/residence visas, 2) taxes, 3) zoning and land use, 4) business registration/approvals, 5) regulatory sandbox for fintech, biotech. In my experience, key to the concessions are framing as a win-win and giving government oversight. One example is, NS would process work/residence visas. Then host country would have two weeks to review. Host country can only deny visa under pre-agreed upon criteria. If not decision in two weeks, then automatic approval. Most governments are more amenable to such an arragement, especially the middle income or above countries NS should be pursuing. The host country has oversight, but the default status strongly favors NS. With those conditions, the options for NS are Southeast Asia, Eastern Europe, and Latin America. Southeast Asia benefits from proximity to India and China, as well as having governments that might be more pragmatic about cutting a deal. Eastern Europe, for example, the Balkans, has many countries with nice climates, proximity to Europe, and small governments that might be flexible. Latin America has several countries that could be a good fit, especially in the southern cone, Brazil, Argentina, and Chile. Managing the process of selecting the next host country, hopefully one that can be a permanent home for NS has important implications not just for NS, but charter cities and the future of sovereignty.
171
11
98
100,688