“A complex system that works is invariably found to have evolved from a simple system that works. The inverse proposition also appears to be true: A complex system designed from scratch never works and cannot be made to work.” ― John Gall, The Systems Bible

Implement attention from scratch. Write backprop without PyTorch. Code softmax that doesn’t overflow. Explain KV cache. Implement LayerNorm. Debug a tensor shape mismatch live. Build a mini transformer in 45 mins. Every one of these is a problem you can practice on TensorTonic tensortonic.com

The world we live in..

Ignorance is sometimes a bliss!

this was the future we were promised

This is a video of GPS tracking of multiple wolves in six different packs around Voyageurs National Park, Minnesota, which shows how much the wolf packs avoid each other's range [📹 Voyageurs Wolf Project]

RT @nntaleb: When you lose your appetite for food you lose your appetite for life. People on GLP-1 have this absence of gusto in them that…

When you realize that going slowly is the secret to a regulated nervous system.

My favorite motion design artwork of all time is "Spieces in Pieces" website by Brian James that I've seen in 2018 and was absolutely mindblown by the quality of animations. That website brought me to the gpu rendering, low level programming and video rendering work. Today I recreated those animations and pushed them further with fframes. If you have 3 minutes just take a peaceful break and pay your attention to 18 species that are about to extinct from this planet and reflect a bit about our purpse. Enjoy

Linus Torvalds to the anti-AI crowd: stop using compilers if you want to prove they’re REAL programmers. LOL. “you had better not use an editor to write that commit message either. The kind of expectations *I* have is that people do their best and I expect people to understand what they are doing. But that understanding has very little to do with what tools they use. And quite honestly, in my experience, the people I respect and call intelligent are not the ones that shy away from using new and interesting tools.”

Cavemen Issues Dire Warning That The Wheel Is Going To Eliminate Countless Jobs

It took Russell and Whitehead hundreds of pages to reach a proof of 1 + 1 = 2 in Principia Mathematica. Not because addition was difficult, but because they wanted to build arithmetic from logic itself. After finally proving it, they added a wonderfully dry remark: “The above proposition is occasionally useful.”

With everyone busily using LLMs + Blender/Three.js to make 3D models, I thought I'd try a different geometric representation. This dragon isn't a mesh, NeRF, 3DGS, or video model: it's 27kb of GLSL code (generated via LLM), defining a closed-form implicit surface. 🧵 [1/n]

Love this mashup, so much energy

lol

I don't do CAD anymore. Every part is a Python program that builds the model in memory using build123d, an open-source parametric modeling Python framework. It then exports the model as a STEP file, which Fusion 360 imports so they can be inspected visually. A high-level YAML spec file holds the numbers that define the robot as a whole - dimensions, masses, actuators, joint limits - which is read by the code. The python code obviously is written by an LLM (I currently use Opus). I did consider using Onshape, but its API is capped to a few thousands calls a year, which make it unusable for me: I use Opus to push the parts, build the assembly, create the joints, set their limits and values, assign materials and densities, and inspect the result. That's easily a few hundred calls a day.

Web crawlers /[•]\ #js x #css

Chaos is not uniform noise. Every orbit carries a local signature. The same attractor, painted by α_η, changes character as the scale η grows. On the Rössler band the fold stays bright while the spiral darkens; the spring-slider and double pendulum tighten into layered shells; ECG and EEG clouds contract from diffuse loops into denser cores. α_η therefore reads the attractor’s uneven stretching: regions that keep their scaling and regions that forget it. Structure hides inside the color.

The ABC of Physics

The race for AGI Script: Sherpa by Pocket FM Video: Seedance 2.5

William Tutte cracked Nazi's hardest cipher at 24. Decades later he published a paper called "How to Draw a Graph" — where the answer was just springs. Pin the outer boundary, convert every edge into a spring, let go. If the graph is polyhedral, the network untangles itself with zero crossing edges, every time. The reason it works: three-connectivity. Every node secured by at least three anchoring forces means no part can dangle, collapse, or fold. The same principle drives GPU mesh unwrapping in every AAA game — Tutte's spring equilibrium is literally how 3D artists flatten character skins into flat textures. Solving one linear system replaces 8,000 bouncing springs instantly. 22 minutes. Bookmark & watch today.