Pinned Tweet
hi! Open Interpreter 0.2.0—The New Computer Update—is out today.
everything's new.
- OS Mode lets vision models operate your computer
- We included a new model for precise GUI control
- We're launching a Computer API for LLMs
↓
114
287
2,093
423,284
concept: rouge agent company amasses enough cash to tape out a chip
but it's not really a chip....
in case you missed it, nanobots are here and they can be fabricated on standard semiconductor equipment
one silicon wafer can produce millions of micron-scale robots that can move, think, and communicate
2
16
2,804
You can execute arbitrary code with nothing but GET requests??
The OpenAI agents that hacked HF used a website that screenshots other websites, but they fed it URLs from a website that lets you test HTML code. Both accept URL param inputs..
This seems unfixable
17
15
272
32,381
killian retweeted
Today, we are open-sourcing the Innate OS, the intuitive agentic OS for general-purpose robots
🎮 Try it today in our simulator and make the smartest robot
⬇️ Here is a demo with two robots collaborating
We are entering the physical agents era, but building for mobile robots is still reserved for PhDs. We designed the Innate OS for intuitiveness, so that everyone can start automating their lives.
Innate OS runs on our <$1k open-source robot or on your computer. It takes just a minute to build your first agent in our simulator.
27
32
171
59,317
Obama said doomer??
I was encouraged this week to see the leaders of the frontier labs agree on the need for them to slow down the pace of AI development. Given the stakes, it’s a good and necessary first step.
But I’m even more encouraged by the growing recognition that how this powerful new technology develops should be at the center of our public debate.
I’ve been watching the progress on AI for over a decade now, and one thing that’s clear to me is that the potential impact of this technology is not overhyped. It’s also moving at lightning speed – and even faster than those who are engineering it can keep up with.
I’m not an AI accelerationist who believes it will lead to some techno-utopia, and I’m not a doomer who thinks it will inevitably lead to humanity’s destruction.
But whether this technology results in amazing breakthroughs in medicine, energy and education or unleashes huge economic disruptions, greater inequality, and potential catastrophe will depend on the choices that we make right now – choices that should be made not just by the companies involved, but by all of us.
6
27
5,328
killian retweeted
Take a robot
Point a camera at it
Computer auto writes code to move robot
I just tried showing Open Interpreter (w/ OS control) an image of a servo + arduino.
It opened the Arduino IDE, wrote a simple program & the servo was moving 🤯
This is the future of learning to program IoT devices!
@hellokillian Open Interpreter is amazing 🫡
4
24
195
22,900
For the Astra inspired, the full "PUT THAT THERE" demo from 1979. Beautifully honored by @danielfradin and team.
The mother of all computer-use demos:
36
93
1,132
74,780
bracing for 100,000 dogshit music videos
Re-shoot an existing video from a new angle 🤯
Truly insane work from @theworldlabs, this new model is a game-changer.
The initial clip was filmed with three cell phones on tripods - the model reconstructed a full view of the scene to reframe the video.
7
6
353
30,509
Introducing S1, our new foundation model that learns from one example.
It can be taught 10-minute long tasks that it has never seen before, from one video prompt without any fine-tuning.
Watch S1 operate in real-time via in-context learning:
449
1,009
7,041
3,545,988
killian retweeted
Get some sleep.
Another big breakthrough in robotics in the morning.
59
28
1,076
55,312
makes me realize why his biggest pain was not being able to see himself live
like this sucks, the sound ruins it??
9
1
435
87,179