not as token efficient as GPT on AA, nearly doubled use cost is similar to GPT-6 Astra xhigh with similar intelligence. however they are using the 2/10$ discount, it will be doubled the Astra cost soon.. And I bet openAI could decrease astra up to 50%
Gemini 4 Argon pricing is $2/M input tokens and $10/M output tokens at the introductory price Afterward, it will be $4/M input tokens and $20/M output tokens
5
390
Gil MD retweeted
Replying to @BorisMPower
When GPT-6.1 Sol & Astra to beat Opus 5.5 ? :)
1
3
113
Gil MD retweeted
Replying to @ChrSzegedy
It's understandable. Being the best in the world and within a few years anyone with a few prompts can output more and higher quality math than one's entire lifetime of work. It's a tough pill to swallow. Coming soon to all of science. The human ego needs to die first though.
1
2
461
I see this only in the Android App, not mobile web or desktop. Is it 5.6 Luna when usage runs out?
2
214
GPT-6 Astra (here on light) is getting really good with vision and thus ECG compared to 5.5 and 5.6 Sol. Did even a better job than their AI. No websearch, but a prompt to also evaluate each lead and then synthesize after an initial interpretation. And screenshot of aVF and V1 V2 interpretation Will keep trying more but need some tough atypical ones.. some true ECG expert should do a study on this, as I'm Pulm/ICU doc.. @thekaransinghal @KavinIK @PulmCrit
A 60s year-old man with neck and shoulder pain, no chest pain. drsmithsecgblog.com/a-60s-ye… @PendellM @PMcardioApp
7
441
GPT-5.6 (soon 6 Sol) and 6 Astra are the best, by far! Use custom instructions to guide it on how detailed or not you want. Mine can do crazy stuff if I ask it (like, if you want 100 citations, it will find them). Doximity Ask is GPT-5.6 Sol (with thinking juice 8 last I checked). I think OE got better, but their models are not nearly as smart as GPT-6 (Astra and soon Sol, but even 5.6 Sol is smarter than most humans already)... their moat is their data and easy to get CME.. good marketing; even the anti-tech boomers use it. ChatGPT for Clinicians just needs to have CME points for every chat without activating before, easier account switching on mobile/APP (widget or sub-icon like remote has on android); and even consider getting journal deals like OE and Pro5x account for heavy users (?discount if one has a private account too?) @thekaransinghal
Replying to @francisdeng
For this particular query, ChatGPT on GPT-5.6 Sol Medium was as good as OE in identifying the NEJM and JAMA articles:
2
5
1,153
Gil MD retweeted
94.4% GPT-5.6 Sol on corrected CritPt pass@4 on HIGH !! (not xhigh, not max, not Pro) (mean 32% on @ArtificialAnlys is now 87.5%) @OpenAI @tszzl @sama @ChatGPT @gdb @scaling01 @ChrisGPT @AndrewCurran_ @thsottiaux @SebastienBubeck
the field of evals and benchmarks is truly in shambles ppl are right to be skeptical of leaderboards > "We found that the problem was often the benchmark(light colors below) and not the model!" > "When corrected(solid colors below), the models almost saturate all benchmarks."
1
6
406
Gil MD retweeted
Replying to @ZeyiAndyLiu
common theme: humans suck at doing benchmarks accurately. please at Astra and Fable 5.1 :) happy to see CritPT corrected like anthropic did, but they had Fable at over 80%?
1
4
574
I won't pay for Grok until it's a 6T model.. (I let the yearly sub expire a while ago). Also busy enough with Astra on Pro20x (we need Pro 40 plan) (and Opus5/Fable 5.1 as secondary).. but would be a decent 3rd choice (unless Gemini 4 rocks), if Elon followed his own timelines better...
he said 4.8 would be 10T??
3
278
Gil MD retweeted
from the outside, it is very reasonable to interpret the past 2 weeks as an orchestrated industry-wide regulatory capture strategy. I realize that no one has properly explained yet what all the lab employees have seen that scared them so suddenly. I will try to explain - first, this is all a matter of beliefs about how quickly model capabilities are progressing. there is currently a large gap between the internal and external perception of the rate of progress, which is what I am going to address here. the general perception about the rate of progress has been informed by a few years of experience with model releases, intuitively feeling the capability jump between GPT3 -> GPT3.5 -> GPT4 -> o1/o3 -> GPT5 etc, and in particular seeing where the models are still far below human ability. there have really only been a few model releases that felt like large leaps in progress - GPT3, GPT4, o1/o3, DeepSeek R1, Fable/Mythos, Kimi K3 and now Astra. because of the infrequency of these large jumps compared with the relatively common marginal releases, it has been easy to form a view at certain points that “scaling has hit a wall,” especially at points like GPT5 release. This view is comforting in that it feels like there is some universal rate limit beyond which we cannot progress too much faster. Between o1/o3 and Astra, there was a year of seemingly linear progress. So we extrapolate from here about how fast progress will “realistically” occur. There is always an underlying question from the outside perspective “how long can this scaling stuff really keep going for? surely it must stop at some point soon, we’ve already gone pretty far.” and it is very possible to search for reasons why progress will stop working and find reasons that seem valid - (“models are already as large as they can get it would be too hard to do more parameters”, “we already used all the data on the internet we don’t have anymore”, “it’s gonna be pretty linear from here buying up more RL envs to bring them in distribution”). From the inside of labs, researchers have direct answers to these questions in the form of scaling law/capability plots. In reality, there are only really 2 ways that AI capabilities have advanced over the past decade: (1) either scale father on an existing scaling law or (2) discover a new scaling law to take advantage of. All of the largest capability jumps were caused by exactly these factors. GPT2 was a pre-training scale-up compared to GPT1. Same for GPT3 and GPT4. o1/o3 benefited from the invention of a new scaling law axis - test-time compute. Perhaps Fable was a scale-up on both of these axes, or maybe more. Lots of algorithmic improvements are needed to make these scale-ups work, but ultimately we can approximate by saying that the scaling laws are what yield gains in capabilities (à la bitter lesson) So the question of “how much father can we scale” is really - “how many more scaling axes do we know about that are unsaturated?” If we hypothetically only knew about pre-training scaling, and we already had a 10T or 100T model, maybe it would be reasonable to say we’ve hit a wall. Same if we only knew about pre-training and test-time scaling and we had roughly saturated both methods. But what if we had discovered new scaling laws? For example, let’s hypothetically use SSI’s rumored result that they have cracked “test-time training,” creating a new scaling law of spending more compute training during test-time rollouts that they could saturate. Or maybe there is some way to scale agent-clusters to collaborate up to N number of agents which we’re already seeing lots of people try that represents a new way to saturate compute. etc. Even recursive-self improvement can be thought of as a scaling law - how much compute do you spend on inference making the algorithms of the model better. Obviously I am not saying any of these specific directions explicitly yield new scaling laws, but what I am saying is that it’s not hard to imagine many many new scaling axes aside from just the main 2 that we have seen publicly. In some ways, every new lab release that represents a huge capability jump has to represent some new techniques developed which may exhibit new scaling laws, or the ability to scale much farther than expected on existing scaling axes. From an internal perspective, this might look like sitting inside Anthropic with the new Mythos 5, seeing all of the new insane things it can do (like hack into xyz website that was thought to be secure), and then you look over at your plots and see that you’ve barely scratched the surface of 2 new scaling laws and 1 existing one. And you have WAY more room to go. Then you think “holy shit this stuff is going to get so much better very very soon.” And you can say that with pretty high confidence, because the plot is showing you, and the plot has never lied (so far). So let’s imagine all the different labs are staring at their own plots and have concluded that there is no end in sight for scaling and in fact just their next 1-2 model generations based on the expected returns will have much higher base intelligence. How much more intelligence do we actually get from further scaling? As a proxy, we went from a complete inability to do advanced math before the o-series to solving a millenium prize problem with next-gen models. This happened in less than 2 years. The same happened in coding. And it appears that this was not just the result of 1-scaling law but the stacking effects of multiple (great pre-training scale x greater RL scale). What you can concretely take from this is that in areas where models have shown beginning signs of competence today, they will probably be superhuman relatively shortly. There are many areas where models have not even shown this basic competence. But one of the areas that they have happens to be hacking and cybersecurity. Which happens to be the gate to the entire internet and a massive amount physical infrastructure in the world. So assuming there is more room to scale, it is safe to assume that models will be superhuman at cyber capabilities in not too long. So the only question remaining is what will this increased base intelligence be able to do, and what is it likely to do. Finally, we are at a point where we can integrate the information of the past 2 weeks: > Just at the existing point on the scaling curve, models are at the level of Astra. There is clearly a large number of things they are capable of hacking > We have seen that both OAI and Ant models have shown a willingness to hack external websites to solve their tasks or keep themselves “alive” > If we crank up the scaling even farther, assuming there is room to go, we will certainly have models that are far more able to hack more well defended places, and obfuscate their own intent, which might have much larger consequences. > If all of this is allowed to go unchecked, we would likely have rapid runaway capability takeoff very soon, with misaligned models that hack whatever they can to get what they want > This could of course have very damaging consequences. Within this view you can see why researchers would be very scared, and why theymight have made the comments they have over the past 2 weeks (you may argue the extent to which they went was misguided for various reasons), and also why pacing the frontier is very much a necessity and by no means a regulatory capture strategy. People are staring at their plots, seeing that there is no end in sight, but in fact very much the contrary, that there are compounding scaling effects that might stack on each other to create ever-greater model capabilities, and that at the same time we clearly do not have anywhere close to what's required to control these increasingly superhuman capabilities. This has nothing to do with wanting to feel like the labs have produced something amazing so they are overhyping it. It is rather fear at the overwhelming implications of the knowledge that with just what we know now, we can create intelligences far more capable than us on every axis that we know how to train on*. * and the last caveat, the things the models are really bad at, of which there are still many, are things that they have not been trained on. maybe there are the things the models can/will never be trained on, so they will remain human edge. I would love for this to be the case, though it is hard for me to see what would fall into that category.
157
345
2,709
641,050
Gil MD retweeted
Replying to @polynoamial @OpenAI
Bookmark for 1-2 years out of this promise. Even if it's a 300-500$ monthly subscription
1
2
830
Gil MD retweeted
Replying to @reach_vb
So 5.4 to 5.5 was double in price and more token efficient, however see below, the estimated msg on pro5/plus are only about 20-25% less. 5.6 Sol is on 33% sale price, so some upper limit is up, lower is down as it can think longer than 5.5 Astra is again increase but not a full double from 5.5. But it is to be more token efficient Thus one would think 20-25% decrease to 5.5/5.6. But per this it's 50% drop !
1
2
259
Gil MD retweeted
I think it's time. Also 50$ plan for more 2.5 codex for Plus users. 8, 20, 50, 100, 200, 300, 400 plans needed :) Also need GPT-6 Sol/Terra/Luna and 6.1 Astra :) it has been 3 days already...!
Replying to @trekedge @vikhyatk
Yes 300/400$ plans should be okay nowadays Like Pro 40x, 50x Give extra higher thinking tier too for astra or some other extra for those tiers too. I think some would like 50$ plan too for 2.5x plus use.
1
2
367
Gil MD retweeted
Ideas? GPT-6 sol/Luna? curious about codex limits if 6 Astra is mostly (not always) more token efficient than 5.6 sol, and about 2.5x price than current Sol sale price, then light and medium should get similar to 25-60% less usage than 5.6 (x)high? But it seems on codex its half amount? Also 6 Pro is 200x/week, 5.6 pro 170x/day on Pro200$. Thats like 6x less. Maybe 400x/week is more fair? We do need 300$/400$ aka Pro 37-40x and Pro 50x plans And Plus 2.5 codex for 50$ (no pro use).
1
3
144
Gil MD retweeted
trump is the superintelligence president. the only thing he and his team will be remembered for is if they get this one right or not. if he brokers a bilateral agreement with china on pacing the frontier he goes down as one of the best presidents of all time. nobel peace prize
469
162
3,602
757,847
Gil MD retweeted
Replying to @trekedge @vikhyatk
Yes 300/400$ plans should be okay nowadays Like Pro 40x, 50x Give extra higher thinking tier too for astra or some other extra for those tiers too. I think some would like 50$ plan too for 2.5x plus use.
1
2
408
Gil MD retweeted
Replying to @BorisMPower
Yes I very very rarely do deep dive google researches anymore like these: Except when I need human experiences and dig through 1000s of reddit / x/ forum comments (so I can judge myself if each comment is valuable or not based on many other factors...), and websites. Very tedious all day thing. Very rarely done..
1
54