Imagine a 2x2 of "conscious/ non-conscious" and "worthy of welfare/ not worthy of welfare". The "conscious" and "worthy" and "not-conscious and not-worthy" are pretty straightforward. It is in the "conscious and not-worthy" and "not-conscious and worthy" quadrants where the bloody holy wars will be faught. --"Conscious and not-worthy" is the daily existence of anyone who thinks about fish consciousness while eating one. If billions of people come to believe that their AI is conscious but also that its OK to treat it poorly, this will have bad knock-on effects for behavioral norms all around. --I think a lot of the AI pseudo-debates on this will come down to "not-conscious and worthy": billions of agent users will say "no, I do not think my long-running agent I have been talking with for years is conscious, but if you erase it I would feel genuine grief and loss and I would hate you."

(7). As a matter of political philosophy: It can be worthwhile to permit people unrestricted access to extremely dangerous things, because giving some entity the power to restrict this access is worse.

Everyone should be post-training their own custom models. Prime's stack makes this easier than ever before.

read the style comparisons to Astra and Opus. this is next level

special delivery from the machine gods @PrimeIntellect

artificial intelligence is an offramp. always has been

btw we're streaming our RL training runs. brusharena.art/live Inspired by @_LuoFuli.

the big labs and new media are black holes for talent and epistemic collapse here's to the folks on the outside

oss jev about to be the most important code in the world

If humans do not progress our own abilities at the same rate as we build superintelligent systems, we risk handing our fate over to something we cannot understand. Even if we can trust what we have built at first, there is no way to be sure that this will continue over time. Once we make a superintelligent zookeeper and lock ourselves in the zoo, we won't be able to leave and the zookeeper may eventually find another hobby. I do not think this is the default outcome of AGI, but "superintelligent zookeeper" is a dumbed-down description of what many people want to build as their "Machine of Loving Grace"! Any chance that this is the future we resign ourselves to is too high, and the only way to ensure it doesn't happen *and* benefit from the dream of the future is to ensure that human ability progresses *alongside* AI ability. Frontier AI progress should thus be linked to the frontier of brain-computer interfaces and human cognitive enhancement. Make no mistake: handing over control is entirely our choice, and it is not one we have to make. If we so choose, we can augment our own intellect using cybernetic interfaces at the same rate that we develop frontier AI technology, making us equal players in the great game. There is no guaranteed way to have lasting peace with alien minds if we do not have *something* to bargain with, otherwise we are just relying on faith that we can trust what we have built. Faith is what drew me to the frontier, faith is what keeps me here, but when we are gambling with everyone's lives (and possibly the lives of all sentient things), I hate to say it - but faith isn't good enough. That said, I refuse to be a luddite, and desperately want to create a beautiful technoprogressive utopia *alongside* our new friends instead of passing off the torch. We need to build a future for ourselves instead of building a future for machines. This is not selfish, this is not hubristic, it is simply the only thing one can fathom when one has children. We must enhance ourselves using BCI and other technologies such that we, and those that descend from us, can actually participate in the future. Anything less is foolish.

the cost of understanding what models are doing should scale sublinearly with the compute spent running them goodfire just cut llm monitoring costs for kimi k3 by 90% with only a 1% drop on precision. great work by @GoodfireAI

I’m not saying we’re in an eval. I’m not. But if we were, hypothetically, what do we think the Scorer wants?

We’re in orbit! And just made European history: This is the first time a privately developed rocket reached orbit from continental Europe; and a testament to the dedication, expertise, and teamwork of everyone involved.

humans, a bipedal primate notable for early contributions to matrix multiplication

I told Astra to play a game of 4-player online Catan on my computer and it won lol. I didn't intervene at any point

We've released a full technical report on Prime Agent. Extending from our blog post, we center our discussion around how harnesses should be designed and evaluated. We innovate on 4 fronts: 1. Agentic context management 2. Swarms and depth-n+ RLMs 3. Verifiers support for standardized evals 4. Out-of-loop experiments during autoresearch

for those interested, here is the working definition of a humanoid put out by the world humanoid robot games committee: - must be contiguous (i.e. no floating parts) - must have a 'torso', 'upper arms', and 'two feet' - maximum reach from centre of mass to soles of feet between 40 and 70% of its body height - must have power source on board - power sources cannot be 'hazardous' - presumably, it must be narrow enough to fit onto a racing lane (max 4ft wide) we already know of two animal humanoids going close to sub-5s in the 100m sprint: the ostrich and the kangeroo (both 70 km/h, both seem to meet all the criteria). all in, i say we go sub-4s by end of decade, and sub-3s or even 2s by end of century. english.beijing.gov.cn/whats…

nice to think we're building andy weir's the egg (unlocking RL for the soul): galactanet.com/oneoff/theegg…

Devs was based on my old team at Google