THIS IS INSANE
For computer use agent, I have been thinking of what is the best demo case of agent is capable controlling the computer as the human
Finally, the best one I found is playing a REAL game, for example the king of fighters, from STEAM on Windows
This requires almost ZERO latency if you want to win.
So I built one using Sai
@sai_borg leveraging
@typesafeai
- Pretrained a few skills/move to play the game in Sai, including the special move
- Sai navigates to start the game and decides which character he is most comfortable playing
- Jev decides the best move to make almost simultaneously
- Uses special moves when they’re ready - e.g. once enough energy has accumulated
- Lost the first match, learned from the it, and won the second one
0 speed up the part when Sai is playing the game
If you want to watch a computer use agent plays the game itself, try
sai.work
#robosecretary #SaiFleet