ml research engineer | physical learning, evals prev google, kaggle, tcl @anyactai

SF
Astra, can you write a Python script for the Fibonacci sequence i mean physically
i’ve seen GPT-6 Astra draw in Paint, how about drawing with a robot in a physics simulation? asked it to build a MuJoCo setup and write a controller to draw Picasso’s dove using a robot arm and a five-fingered hand
25
54
614
68,979
so i was curious to see how opus 5.5 compares to astra in token usage when acting as a robotic policy TLDR: opus used ~6x more tokens but astra is still more expensive on average. in this particular example, astra got further and completed more tasks before giving up though was fun watching their approaches to failure recovery nobody beat the triangle
2
3
27
1,803
trained a smol RL policy to rotate two baoding balls with a Sharpa hand interestingly, astra managed to define most of the RL environment by itself (including verifiers and rewards) but didn't bother by the fact that balls go around the ring finger while inspecting the policy
6
4
86
5,535
Dmytro Hrybov retweeted
I asked Opus 5.5 to create an interactive 3D visualisation explaining how robot actuators work. zerotimedrift.github.io/insi… Repo in comments
3
2
20
1,990
Dmytro Hrybov retweeted
Introducing FLUX 3 Action. An open weights 7B World Action Model that achieves first place on the RoboLab benchmark. It outperforms the previous best open model by 6.1 percentage points while using 56% fewer parameters and running up to 3.95x faster.⁠⁠ FLUX 3 Action removes the usual trade-off between world action model performance and VLA speed: it still predicts video and actions together, but plans more than twice as far ahead and runs faster per second of robot motion than the strongest open VLA. Teams can fine-tune FLUX 3 Action on their own demonstrations to create policies for a particular robot and task. Together with @nvidia, we also integrated FLUX 3 Action natively into @huggingface's LeRobot, with fine-tuning recipes included and edge deployment on NVIDIA Jetson. Beyond robotics, we’re also seeing promising results training task-specific policies for acting in simulated environments like gaming, controlling a vehicle, computer use, and wherever else a model needs to understand a visual environment and then choose what to do next. FLUX 3 Action builds on the same image, video, and audio pretraining as FLUX 3, but uses a smaller architecture designed for practical deployment. In midtraining, we trained the model to predict actions and future frames together. We’re releasing the weights, code, fine-tuning recipe, benchmarks, and reproducible examples so researchers and developers can build on the model with their own robots, environments, and tasks (see below).
76
234
1,788
164,982
now opus 5.5 visualized how @physical_int π0.5 inference works on DROID, built from open code and paper
love this format, visualized a V-JEPA 2.1 training step based on public materials
7
19
200
14,050
wish i could've visualized all papers like that when i was at uni
178
love this format, visualized a V-JEPA 2.1 training step based on public materials
Continúa la saga ahora con el diagrama de un modelo de difusión, a manos de Opus 5.5
1
2
33
14,909
beautiful, asked opus 5.5 and astra to show how they see Kyiv in Monet style there’s something peculiar to the fact that this is all coded, like when we had our early text to image models back in 2021 can you tell which is which?
for the past few months i've been asking our models to paint. opus 5.5 is very skilled at emulating different styles every image here is a python program generated pixel by pixel. there is no image model, and no off-the-shelf art software. instead, it's about 7,500 lines of code using standard libraries to emulate different brush styles. the agents don't use any pictures as reference, instead working only from what they know about each painter
4
24
1,736
some more
3
153
compared GPT-6 Sol and Astra on my "robot drawing on the board" bench Sol used ~25k output tokens vs ~22k for Astra. interestingly, Sol's controller drew twice as fast to be honest, i expected stronger spatial reasoning from new Sol here, but it was way cheaper to run (almost 5x)
9
4
91
48,398
great paper, their model trained on 1k filtered RL tasks outperformed the one trained on 8k vanilla tasks (on the validation set) 8k vanilla tasks are sampled right after the test construction step 2 as i understand it
CodeMidas: Scaling Agentic Coding RL Environments from Code Itself 🤗: hf.co/papers/2609.22068
11
1,139
or these systems will implicitly emerge inside a single model with enough scale and proper data engineering #bitterlesson
right now, systems 1 and 2 in robotics communicate with each other mainly through text, one example is task planners prompting VLAs to execute subtasks i think this will be a major bottleneck, it’s hard to express richness of the physical intent with text, if you think about it e.g. when we try to grab a cup, our exact actions depend on whether it was hot/slippery/damaged somewhere/many other things the way our brains “handoff” this information from system 2 to system 1 during actions feels way more integrated
2
8
902
right now, systems 1 and 2 in robotics communicate with each other mainly through text, one example is task planners prompting VLAs to execute subtasks i think this will be a major bottleneck, it’s hard to express richness of the physical intent with text, if you think about it e.g. when we try to grab a cup, our exact actions depend on whether it was hot/slippery/damaged somewhere/many other things the way our brains “handoff” this information from system 2 to system 1 during actions feels way more integrated
4
1
38
4,320
Jev reminds me of times when CLIP was used for image classification without task-specific training
7
969
tested Jev as a real-time robotics policy in MuJoCo it struggled at first, so i split each update into two calls: decide what to do next, then decide how to move the arm and gripper Jev doesn’t accept images, it gets simplified geometry and contacts as text here
22
52
633
45,677
the first call chooses an intent, like grasp, carry or release. the second chooses x/y/z movement and finger commands the intents and their conditions are defined in the prompt. the bars show jev’s actual output probabilities
2
14
2,209
After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x cheaper (w/ output tokens free) • Frontier composable intelligence optimized for decisions AFAICT the shortest path to AI-based economic revolution
15
1,748