Which benchmarks? Are you sure you didn’t misread Qwen3.8-Max for Qwen3.8-27B? That one’s up there, but if a benchmark ever compares 27B to Fable then that benchmark is probably just trying to sell you their vibecoded harness or something lol
Edit: Don’t get me wrong, I’ve been especially impressed with Qwen3.8-Flash-Next on my PC and to say it’s barely better than Opus 4.6 is a huge achievement in my eyes. Opus 4.6 was the point where people finally felt like that AI actually spits out mostly useful stuff and having models that can be ran on a realistic PC finally catching up is fantastic, but it’s still far from the frontier stuff. No way in hell am I going to get anywhere with this for decompiling/reverse-engineering stuff unfortunately. I really like coding the important stuff by hand and having it spit out bash scripts in parallel or reviewing my code in the end for oversights, for that I really can’t complain anymore and like Opus 4.6 any model better than that is just luxury. Would I let it vibecode the whole thing then it would end up being unmaintainable slop, but as an actual tool, not a crutch, it’s fantastic. But yeah, Fable 5, not in a dream lol
Yeah, webdev is one of those areas where it’s really not that deep and LLMs have pretty much figured that out by this point so the distance between local and frontier is basically non-existant. I mean ask Fable 5 or a model on my B70 to make a website and it’s pretty much going to look like the identical vibecoded slop site, that benchmark is old news. But to have it THIS close is honestly pretty funny, even in this benchmark I didn’t expect the difference to be a rounding error.
Interesting, I guess the benchmarks aren’t always accurate.
Which benchmarks? Are you sure you didn’t misread Qwen3.8-Max for Qwen3.8-27B? That one’s up there, but if a benchmark ever compares 27B to Fable then that benchmark is probably just trying to sell you their vibecoded harness or something lol
Edit: Don’t get me wrong, I’ve been especially impressed with Qwen3.8-Flash-Next on my PC and to say it’s barely better than Opus 4.6 is a huge achievement in my eyes. Opus 4.6 was the point where people finally felt like that AI actually spits out mostly useful stuff and having models that can be ran on a realistic PC finally catching up is fantastic, but it’s still far from the frontier stuff. No way in hell am I going to get anywhere with this for decompiling/reverse-engineering stuff unfortunately. I really like coding the important stuff by hand and having it spit out bash scripts in parallel or reviewing my code in the end for oversights, for that I really can’t complain anymore and like Opus 4.6 any model better than that is just luxury. Would I let it vibecode the whole thing then it would end up being unmaintainable slop, but as an actual tool, not a crutch, it’s fantastic. But yeah, Fable 5, not in a dream lol
Hugging face code arena | webdev gives qwen3.8 27b a 1590 and fable 5 high a 1624 which seams very close.
Yeah, webdev is one of those areas where it’s really not that deep and LLMs have pretty much figured that out by this point so the distance between local and frontier is basically non-existant. I mean ask Fable 5 or a model on my B70 to make a website and it’s pretty much going to look like the identical vibecoded slop site, that benchmark is old news. But to have it THIS close is honestly pretty funny, even in this benchmark I didn’t expect the difference to be a rounding error.
Oh okay. What benchmarks do test actual programming performance properly then?