Yeah, webdev is one of those areas where it’s really not that deep and LLMs have pretty much figured that out by this point so the distance between local and frontier is basically non-existant. I mean ask Fable 5 or a model on my B70 to make a website and it’s pretty much going to look like the identical vibecoded slop site, that benchmark is old news. But to have it THIS close is honestly pretty funny, even in this benchmark I didn’t expect the difference to be a rounding error.
Yeah, webdev is one of those areas where it’s really not that deep and LLMs have pretty much figured that out by this point so the distance between local and frontier is basically non-existant. I mean ask Fable 5 or a model on my B70 to make a website and it’s pretty much going to look like the identical vibecoded slop site, that benchmark is old news. But to have it THIS close is honestly pretty funny, even in this benchmark I didn’t expect the difference to be a rounding error.
Oh okay. What benchmarks do test actual programming performance properly then?