Post

legit, I do not think we need better large models than we have now and I’m still not seeing substantial improvement in the places where models are struggling. the trend is to topically RL harder and to try to just make them guess your under-specified prompts better and I think that’s a mug’s game

Ed@ed3d.net

No, I think that's still true, but lots of people are selling inference while not doing training, and that shouldn't be forgotten. And OAI/Anthropic's training budgets, tbh, don't really interest me now either -- we are at the stage where model dev could 100% stop and we would be Just Fine, so, eh.

if we Simply Stopped at GLM 5.3 and 5.3 Flash price and performance, it would be five years or more before the median programmer caught up and longer for non-programmers The new tiny Qwen model is good too, runs on my MacBook even.

1 repost39 likes

No replies yet.