Deregulating #energy is arguably the most impactful foreign policy. Most hostile countries are energy powerhouses (e.g. Russia, Iran, China). If the West unleashed oil/natural gas pipelines/drills & nuclear…hostile regimes would be weakened tremendously without firing a shot.

The federal government is spending America into oblivion

Clearly LLMs must one day run in Space Step 1 we harden llm.c to pass the NASA code standards and style guides, certifying that the code is super safe, safe enough to run in Space. en.wikipedia.org/wiki/The_Po… (see the linked PDF) LLM training/inference in principle should be super safe - it is just one fixed array of floats, and a single, bounded, well-defined loop of dynamics over it. There is no need for memory to grow or shrink in undefined ways, for recursion, or anything like that. Step 2 we've already sent messages out to Space, for possible consumption by aliens, e.g. see: Arecibo message, beamed to space: en.wikipedia.org/wiki/Arecib… Voyager golden record, attached to probe: en.wikipedia.org/wiki/Voyage… The Three Body problem (ok bad example) But instead of sending any fixed data, we could send the weights of an LLM packaged in the llm.c binary, with instructions for the machine code. The LLM would then "wake up" and interact with the aliens on behalf of the human race. Maybe one day we'll ourselves find LLMs of aliens out there, instead of them directly. Maybe the LLMs will find each other. We'd have to make sure the code is really good, otherwise that would be kind of embarrassing. :) Step 2 is clearly not a serious proposal it's just fun to think about. Step 1 is a serious proposal as, clearly, LLMs must one day run in Space.

New (2h13m 😅) lecture: "Let's build the GPT Tokenizer" Tokenizers are a completely separate stage of the LLM pipeline: they have their own training set, training algorithm (Byte Pair Encoding), and after training implement two functions: encode() from strings to tokens, and decode() back from tokens to strings. In this lecture we build from scratch the Tokenizer used in the GPT series from OpenAI.

This is huge: Llama-v2 is open source, with a license that authorizes commercial use! This is going to change the landscape of the LLM market. Llama-v2 is available on Microsoft Azure and will be available on AWS, Hugging Face and other providers Pretrained and fine-tuned models are available with 7B, 13B and 70B parameters. Llama-2 website: ai.meta.com/llama/ Llama-2 paper: ai.meta.com/research/publica… A number of personalities from industry and academia have endorsed our open source approach: about.fb.com/news/2023/07/ll…

Liftoff of Starship!

We’ve just released a major milestone of Unison, version M4 🎉 ✅ Anyone can now self-publish code to share.unison-lang.org ✅ Base library additions: mutable/immutable arrays, date/time primitives, efficient regexes. ✅ ... and lots more Blog post: unison-lang.org/blog/m4-code…

Today 😁

A year ago...

Splashdown! Welcome back to planet Earth, @Inspiration4x!

Watch Dragon and the @Inspiration4x crew return to Earth → spacex.com/launches nitter.net/i/broadcasts/1yoKMAPVa…

View from Dragon’s cupola

Second phasing burn complete. Dragon and the @inspiration4x crew have reached a circular orbit of 585km – a new Dragon altitude record

Flight profile for @inspiration4x

Liftoff of @Inspiration4X! Go Falcon 9! Go Dragon!

windowscentral.com/partys-ov… Good times; way back we showed the Silverlight was obsolete before it even launched and that you could do everything using just standard HTML+JS (en.wikipedia.org/wiki/Micros…). Nearly got fired for showing that.

Haskell Symposium 2021 keynote on linear types just out. If you wanted an intro to the *why* of linear types (resource hygiene, safe FFI, performance, correctness wrt protocols, ...), this talk gives you part of the puzzle. piped.video/watch?v=WZ_0FSGe…

A farewell to Simon Peyton Jones as he leaves Microsoft Research Subject: RE: New horizon   I would like to add a few words to what Chris has written.  I know I am also speaking for Mads, the current lead designer of C# (cc’d)

Starship landing nominal!