Today we're announcing our @sesame iOS app preview, giving you a first look at our collection of personal agents, a new way to explore your curiosity and think out loud.
We’ve come a long way since the Research Preview from last year: new features, new characters, and better capabilities.
apps.apple.com/us/app/sesame…
sesame.com/blog/voice-your-c…
A collection of personal agents, crafted for everyday conversation.
Preview available now on iOS.
apps.apple.com/us/app/sesame…
106
52
985
409,590
love the page navigation here where it zooms out, pans, then zooms in. reminds me of the scrolling on the steve jobs archive book site. was great to meet this week anders! andersdrage.com/
46
7,613
whenever I open DoorDash I can’t unsee that they put quotes around food in the header.
Looking at “Chinese” food doesn’t exactly build confidence. What’s wrong with this food that you need to put it in quotes?
This was not a search but a page I tapped into directly from their permanent UI. But my hunch was they did this starting with searches and didn’t want to be on the hook that all search results were representative of your query or something?
11
1
46
13,999
if you are in the Apple ecosystem this card is a must. 0% financing for Apple gear. that money can earn you interest in investments or hysa elsewhere.
they have done holiday promos in the past where cash back jumps to 6%. got that when I got my Pro Display XDR long ago
14
1
163
79,901
Stammy retweeted
User interfaces are not going away.
Yes, humans will use computers alongside agents. When working with agents, we will need the ability to audit what agents do in a human-readable way.
Yes, some interfaces (ex: dashboards, in-chat UI for ephemeral tasks, etc) will be generated. Most important interfaces will be intentionally designed. We will want both deterministic and non-deterministic interfaces in different situations. We're thinking a lot about the best ways to help designers shape non-deterministic systems at Figma.
Yes, new input modalities like voice, VR/AR and BCI will change the way we use computers and introduce lots of new interaction paradigms. This is all very exciting :)
Overall, the surface area of design will continue to grow much broader. Design is the new code and the key differentiator for software moving forward. Expect more and more energy to go into design / craft in the years ahead... it will be how you win or lose.
Eric is right about plenty of things, but the market will prove him wrong on this one...
"User interfaces are largely going to go away.
Because the agents speak English, or other languages. You can talk to them. You can say what you want. The UI can be generated.
So I can say, generate me a set of buttons that allows me to solve this problem, and it's generated for you."
- Eric Schmidt is the former CEO of Google.
Today’s websites are designed for humans, with carefully crafted UIs.
But we are probably moving towards UI-less web.
automated bot traffic has already surpassed human activity on the web. with AI agents, this number will explode.
In near future its very plausible that 90% or more of web traffic will be non-human.
Imagine a web with no websites. All your favorite apps are now just databases, queried for information by agents that zip around on your behest.
In a world primarily composed of bots, what happens to websites? Do agents learn to navigate them like a human? Do they go away entirely? 🤔
---
Video from 'Peter H. Diamandis' YT channel
147
123
1,503
202,567
the iPhone Duo seems promising as an agent device. just needs a third party (or Apple) to make a nice foldable keyboard to go with it.
21
1
146
25,232
I’ve never used Superhuman mail but now I want to sign up just to see what everyone’s talking about with this redesign.
are there any before and after screenshots?
the new superhuman redesign is terrible. the logo is disgusting and generic. feels like yahoo mail. the app itself is way harder to read + use. huge downgrade. after loving the app for 3 years I am seriously considering changing. anyone else have any alternatives?
14
43
28,003
after much iteration, I have landed on the best ai voice dictation mic setup.
great mic placement so you can whisper if you need, no big mic arm in the way or wireless one to clip to you and talk down to.
- a split keyboard like my glove80
- rode ds2 mic stand + whatever mic
20
1
84
12,472
We published our first paper at @sesame, in collaboration with researchers from Carnegie Mellon and more.
It’s focused on evaluating conversational turn-taking. Take a look at the benchmark with leaderboard too: turnbench.sesame.com/
To craft for conversation, timing is everything. Natural conversation is a social dance, and timing matters just as much as tone and delivery.
Most voice AI doesn't do this well yet.
So we built TurnBench: an open benchmark that measures whether voice AI knows when your turn is really over, and when an "mm-hmm" is agreement, not an interruption.
Learn more about how we built this on our blog.
sesame.com/blog/turnbench
1
38
6,854
peep the turnbench tool vid from @freemanjiangg
I'm excited to share some of what i've been working on at Sesame!
turnbench.sesame.com is our turn-taking benchmark for real-time conversation: when to speak and when to yield
2
1,966
Deep partial lunar eclipse happening tonight. here's a shot i took one of the last times it happened paulstamatiou.com/photo/2015…
1
22
2,894
cloudflare has been getting polished lately. just migrated 2 simple sites i've had from vercel to cloudflare and it was a breeze.
love this little motion for progressing through a flow (and it lets you go back by clicking on the previous step that's hovering up at the top too)
28
15
660
56,869
I remember hearing this Stanford talk from @jack ages ago, and I think about this part often:
"You have to make every single detail perfect and you have to limit the number of details. That's it."
piped.video/watch?v=w7j0VEwW…
(sorry for digging up a 15yr old video @jack!)
i like the concise way @jack approached it long ago: make every detail perfect, limit the number of details.
6
5
188
22,428