r/OpenAI • u/ThunderStorm420 • 10h ago
News Fable 5.1 released. Significant benchmark improvements, what do you think?
Same input/output pricing and 75% price reduction for cache.
57
u/Bloated_Plaid 10h ago
Fucking crazy for 0.1 but the important part is lower cost on cache reads which was killing me. Cannot wait for Astra, it’s gonna be insane.
13
u/CartographerAble9446 9h ago
the cache cost doesnt matter much for average subscription, it's only for the API, and most of us are peasants and dont pay API price
3
u/Bloated_Plaid 9h ago
where did you see that the cost savings dont transfer to subs? They havent explicitly said anything like that.
3
u/hydralisk_hydrawife 7h ago
he's wrong, cache savings translates into lower costs for the company which allows more usage for the users
3
u/RealSuperdau 7h ago
Unless companies actually start using Fable/Mythos with the on-premise retention policies, then subscriptions are fucked
2
1
u/ThunderStorm420 9h ago
Why do you think that Astra will be insane? I see all hype no facts, unless I don't know something
2
1
1
u/Bloated_Plaid 9h ago
Lot of outputs on Twitter.
3
u/ThunderStorm420 8h ago
I don't doubt that it will be good. But X "leaks" are of questionable authority.
2
u/Bloated_Plaid 8h ago
There is no other good source for AI discussion and discourse right now unfortunately.
0
u/coloradical5280 8h ago
Not really though, if you know who to trust they’re basically always consistent and correct.
And this always on agent that just is just, always running, forever, like a real assistant, sounds like it’s for sure being announced in dev day on the 29th
1
10
u/EbbExternal3544 9h ago
So does that mean Astra should release this week?
17
u/ThunderStorm420 8h ago edited 8h ago
I'm sure they're hurrying now. Only thing left to wait after Astra is a 50% usage increase from Anthropic.
1
u/Your_mortal_enemy 8h ago
Everyone keeps saying that but they're releasing something massive at openai dev day at the end of the month and it's this... Surely? I hope Im wrong, almost four weeks seems like an eternity
9
u/Supermax64 8h ago
AA benchmark lists it as nearly 4x more expensive than Sol (max) to complete a task. Am I missing something?
6
u/RealSuperdau 7h ago
Damn, it's 17% more expensive on AA than Fable 5 max, despite cutting cached input rates by 4x.
Fable 5.1 max just seems really token inefficient.
4
u/Keep-Darwin-Going 7h ago
One major upgrade is it stop talking like some obnoxious tech bro that try to show off all the time. The progress and decision making feels more like normal human being
11
u/Euphoric_North_745 9h ago
don't care, codex is currently working, writing code, no need to mess up my work, it is already in progress
2
u/djLiTh 7h ago
Seeing opus5 have any score higher than 5.6 makes me think this is all made up. I’m mostly doing scientific research and opus is unusable, fable5 is usable but makes mistakes but sometimes comes up with things 5.6 doesn’t, but 5.6 is currently in the lead. I’ll be trying out fable 5.1, as my workflow is to leverage two modals against each other as I find that fingers the best result. So gpt 5.6 to Fable 5.1 and back and forth.
2
5
u/Key-Injury-1875 9h ago
Complete shit. Ran out of usage already on max 20x
12
u/ThunderStorm420 8h ago
What the hell are you running, genuinely?
2
1
u/Key-Injury-1875 8h ago
Autonomous drone racing stack it didnt even start coding it literally just reasoned on what I should do
5
u/unfathomably_big 7h ago
To use your entire 20x with a single prompt has got to be the worst prompt engineering I’ve ever seen. This sub needs a Wall Street bets style loss porn tag for you “I only asked it to digest encyclopaedia Brittanica and now I’m out of dollars” guys
2
1
u/Practical-Positive34 9h ago
For coding I think a 3-4% improvement at the cost of nearly 2x as much is simply not worth it. I would only use this after Sonnet and Opus have coded things to go find or solve things that are broken that Opus or Sonnet couldn't fix properly. My 2 cents.
3
u/Healthy-Nebula-3603 9h ago
Did you even read ? Is cheaper a lot comparing to fable 5.
1
u/Practical-Positive34 4h ago
Making something absurdly expensive slightly cheaper does not make that absurdly thing cheaper than what it was already absurdly more expensive in comparison to. Its shocking you don't get this very basic concept.
0
u/Healthy-Nebula-3603 4h ago
I just answered to your X2 more expensive claim.
Your current answer had 0 logic and sense to the topic you mentioned.
1
1
1
u/creamyshart 8h ago
Artificial Analysis shows it costing significantly more than 5 to run its tests.
1
u/christianbro 7h ago
I trust more Reddit comments about a new model than these "benchmarks" which they probably train for higher scores than real world scenarios and after that pick the ones that show best
1
u/czmax 7h ago
W/o reading anything else:
I think the foundation models will continue to get better and expect this is more incremental improvement.
I also think, like any vendor, this is work will be “enshittified” and the first step is probably tweaking the cost model to start making money for VCs so folks will likely be complaining about the pain/hate/dislike of whatever limits are here.
1
1
u/JayArrCoffee 6h ago
From what I can tell, seems pretty good! I gave it a relatively difficult engineering problem that Sol had trouble with and it had no issues.
1
u/jaraxel_arabani 6h ago
How was the token usage vs fable 5 do you know?
1
u/JayArrCoffee 6h ago
It actually figured out the core solution in like 70k tokens and the solution was quite elegant. I was impressed!
1
1
1
1
u/mortredclay 3h ago
I work in biology, so Fable shuts me down every time. I have no opinion on any Fable because it won't engage.
1
1
1
u/_404_LogicNotFound_ 1h ago
how tf do these benchmarks get buffed with the release of every new model, yet persist in this 60-70% range!?
1
u/danscava 1h ago
I'm hoping for a new model with significant benchmark deterioration. Time for something different.
1
-3
u/Efficient-Cat-1591 9h ago
End game - much better performance at a relatively good cost. OpenAI cannot match this at the moment.
7
u/tsunami_forever 9h ago
Astra is rumored to release tomorrow
5
2
u/rapsoid616 9h ago
My finger is ready on the switch button, I hope they release a true competitor at least.
2
-4
u/Efficient-Cat-1591 9h ago
Rumoured but no released. Fable 5.1 IS now available and I can tell you the performance is phenomanal! Sol 5.6 max/ultra pales in comparison. one shot a recurring bug I spent DAYS with sol going in circles to solve. such a shame though as I really wish Sol can be better.
-2
u/getmeoutoftax 5h ago
This model is good enough to replace most jobs. It’s seriously over at this point.
1
176
u/ben_bliksem 10h ago
I think we'll see countless reviews by the Reddit crowd over the next couple days, it'll be the most amazing thing and then in two weeks' time the real sentiment will surface.
Just like every other time.