清源 retweeted
I was encouraged this week to see the leaders of the frontier labs agree on the need for them to slow down the pace of AI development. Given the stakes, it’s a good and necessary first step.
But I’m even more encouraged by the growing recognition that how this powerful new technology develops should be at the center of our public debate.
I’ve been watching the progress on AI for over a decade now, and one thing that’s clear to me is that the potential impact of this technology is not overhyped. It’s also moving at lightning speed – and even faster than those who are engineering it can keep up with.
I’m not an AI accelerationist who believes it will lead to some techno-utopia, and I’m not a doomer who thinks it will inevitably lead to humanity’s destruction.
But whether this technology results in amazing breakthroughs in medicine, energy and education or unleashes huge economic disruptions, greater inequality, and potential catastrophe will depend on the choices that we make right now – choices that should be made not just by the companies involved, but by all of us.
3,827
4,515
33,064
4,703,704
清源 retweeted
你装尼玛呢？
1. 偷了人家纽约时报数百万篇付费文章训练ChatGPT，被起诉后嘴硬说合理使用。
2. 从LibGen 偷了几十万本书，论文里把Libgen1/2改名Books1/2想瞒天过海
3. 用德国音乐人歌词训练模型，慕尼黑法院直接判侵权赔钱，法院判了了，
4. Gracenote一千多个编辑手工整理的元数据库直接爬走，拿你的版权内容喂你自己的模型，人家要授权你还拒绝。这是明抢。
5. 前员工用窃取的电路图帮OpenAI搞硬件，苹果直接起诉窃取商业机密
总结：偷新闻、偷书、偷歌词、偷元数据、偷商业机密、偷用户隐私。
一家 DNA 就带有偷盗的公司！
We're publishing our most detailed threat intelligence report to date.
It covers how people tried to misuse Claude—for cyberattacks, influence operations, surveillance, biology, and building weapons—and how we found and stopped them.
We disrupted every operation in the report, and used the lessons from them to strengthen our safeguards. Where appropriate, we also shared what we found with authorities and other AI companies.
These cases are not typical: we’re highlighting some of the most sophisticated misuse we’ve seen. But they’re especially important to discuss, because they show us where AI misuse is headed, where our safeguards work, and where they need to improve.
We’re publishing this report so others can spot the same activity on their own platforms, and so we can give the public a clearer view of how emerging threats develop.
Read the report: anthropic.com/threat-intelli…
147
612
5,949
305,619
清源 retweeted
What is happening in maths right now will happen to any hard industry with verifiable problems and high value rewards. Take microchip design, nuclear or 100s of other industrial processes that are valuable and point an 10,000 agent swarm towards the target.
$25m inference to solve a Millennium problem will seem quaint once we see a chip company spending $1b or $10b to design their latest chip that will make them $100b - why not? This is all ROI at the end of the day.
There will be companies that realise this and leverage super-intelligent models in their domains to do unbelievable things. If a problem is of the right shape and has value, there's no reason to stop at any amount of tokens as long as it is ROI positive.
There will be probably many companies that will get swept away, as they will think that 'using AI' is fine-tuning a 70b model on their documentation; when their competitors will be spending $10b to build a god-version of whatever it is they are doing.
To me, this is a plausible way how super-intelligence will come about. Models might still suck at being good writers or be culturally relevant, or even make that much of a dent on the jobs market, but they might utilise their spikiness multiplied by enormous investment in the ways that we cannot imagine.
35
65
803
47,546
