Post

None of the stuff about “AI slowdown” actually explains what that means or what’s being slowed down. Anthropic’s blog about it says they’ll still train new models. I guess if it’s a “slowdown” maybe that’s how hyperscalers could reconcile with letting them out of compute deals?

140 reposts938 likes

Brian Ragle@vagabondvisions.bsky.social

Anthropic: "Let's every slow down, agreed"? OpenAI: "Agreed!" (doesn't slow down) Google: "Agreed!" (doesn't slow down) Microsoft: "Agreed!" (doesn't slow down, but no one cares) xAI: "Slow what down?" China: "LOL" Anthropic: (doesn't slow down) www.nbcnews.com/news/us-news...

From your vantage point, it's a Prisoner's Dilemma style game between all the AI propagators. Dario actually made a logically sound move in making this call for a slowdown, to see in a cost-free manner if others would cooperate (a slim prospect, in my view).

He and the rest are angling for regulatory capture. If they are the ones in the room when any regs get written, they can effectively regulate themselves into a market guild or cabal and keep out competitors like China or FOSS models, especially around their business customers.

"The Chinese should stop figuring out how to do this just as well but way cheaper than us and we should start to very slowly let the air out of the asset bubble I helped inflate, but all in way that allows me to remain very wealthy and important"

First of all, sorry not sorry for the LLM slop. I came on bluesky for the first time in a while and saw more LLMs are going to take over the world recycled garbage so I had to see what you had to say. My read of the "slowdown" is that they are trying to distract from the diminishing returns of

I also listened to your podcast on the huggingface hack and you asked why they would even create these tools. I was going to give you some reason why but I changed my mind, I think we should go even further in testing LLM hacking abilities.

What they are wanting to "slow down" is the impatience of investors who want proof & evidence the LLM machines will turn a profit. When their bills come due, they will point to: wE hAd tO sLoW dOwn! iT iS nOt oUr fAuLt! wE wERe jUst bEinG rEsPonSibLE!

The hopes and dreams of four years ago are no longer realistic! In fact there's no avenue to a cash positive business! Let's tap the brakes a bit! Also please give us $50b

Also everything about this is framed in terms of what might happen, as if everything so far hasn’t been a result of the recklessness and unlimited resources of the frontier labs. We are nowhere near recursive self improvement! What’re they all on about?

It's gross revisionism of him to claim that the models "were not capable of significant deception, manipulation, cheating" in 2023 when the earliest chatbot related suicides were reported THAT YEAR.

It is particularly rich of him to worry that AI "could outrun our ability to understand and control these systems" when that is exactly what Claude Code is ALREADY doing to thousands of codebases across the world.

There’s also a compelling theory that these companies don’t have an actual plan or strategy and being reactive the entire time!

On one hand, it seems pretty coordinated that they all agree on a slowdown, but you’ll notice that none of them seem to agree on what that means. Also: how do you frame “slowdown” with “keep buying NVIDIA GPUs”?

They all agree they want a slow down, but I'm pretty sure they also agree that it would require China to buy in to be effective, right? I don't think this will ever happen. I think this is just them talking the talk of safety. I don't think it has any substance.

Part of their strategy of the “slowdown” is the perceived issue of danger (self propagated) which can only be addressed by limiting access to the 2 major players, excluding all other companies (eg chinese). Government controls incentivize their financial lifeline and prohibit competition

I was thinking about this today and part of me wonders if they are all playing a game of chicken with one another to see who they can get to slowdown first while they leap ahead.

Also, isn't "we can't slow down" still being blasted to every town fighting a data center because "China is gonna git us!" If we do? This is absolutely an attempt to ease into the crash slightly lighter

For some reason I am reminded of the LLMs running vending machines and agreeing to all price fix; but then immediately turning around and lowering prices to undercut the others that agreed to the higher prices.

I think this is their way of retroactively rationalizing how LLMs haven't gotten any better in like two years and are stuck with a certain inevitable percentage of "hallucinations" - so hey let's IPO next year - and if it seems like the product isn't improving, well we did that on purpose

How will they train LLM AI to improve itself? Where's the training data from decades of LLM improvement that could teach LLMs how to do this? Where are the thousands of examples of successful (& unsuccessful) LLM "improvements" to get the data from? Are LLMs just going to read research papers?

For LLMs to just read all the research papers, understand them, and divine improvement, LLMs would ALREADY need to be superintelligent. Even today's human AI researchers can't do that. "Recurrent self improvement" is prob 30+ years away, with many significant steps before we can get close to it.

Yeah, I get the human reason why many at first thought these things couldn't be better than us at our jobs - or at least part of what makes our jobs. But they are. The changes in two years have been astounding.

Each LLM model generation cost Billion$ and takes time to design, train, & test, large obstacles to compressing many generations of improvement into small periods. Previous improvement, e.g evolutionary algorithms, operate on simpler designs easily iterated & tested to select better versions.

Evolutionary algorithm digital improvement / creation of better designs do thousands of generations of selected iteration in hrs. For LLM AIs, multiple iterations would cost tens or (likely) hundreds of Billion$ & take many months, or years. Who will pay? with zero profits (only losses) in sight?

If you had a company and were close to developing recursive self improvement, would you tell people outside the company that you were nearing that? Would you spend billions of money on things other than that goal? None of these companies are close or they wouldn't be behaving how they are.

If you thought that your alignment science was significantly behind your ability to get to RSI and therefore agi or asi then yes, particularly if you believe that misaligned models could be catastrophic to humanity

it's nowhere near an actual singularity (no human involvement), but it's definitely somewhere on the recursive self-improvement spectrum current AI already helps write most of the code/cleans up datasets/takes part in reinforcement learning/etc. for the next AI

This feels like a stunt to get out of their obligations. “We are so close to creating God that if we don’t stop, it will be bad for everyone. Please don’t make us borrow and spend this money and create the evil AI God.“

Putting my conspiracy hat on. The bill is coming due soon. The vast sums of money are not generating the impovements needed. This gives them an easy out for investors. ‘Oh the models could do what we promised but can’t now cause we care too much’ Yadda yadda, cycle continues.

I’d rather have an “AI Stop” or an “AI Shutdown” followed by a dismantling of their models and charges brought against those responsible for the damages they have caused.

This all sounds like they want to buy time now that the money is running out fast. With the 'slowing down' narrative, they have a way of telling investors that it'll take even longer for them to become profitable.

Yeah, AI companies are also rapidly entering the fase where they make themselves worthless. Because of the mass trillions of overspending & logical scaling efficiency, they'll have too many datacenters + hardware available. All these companies and countless spin-off services are going to race...

each others prices to the bottom. You can already see this effect with language models: they can run completely offline on the hardware of a budget phone now. You don't need to pay ChatGPT etc, Google Gemini is already integrated. Same for base images gen. The only bottleneck in AI now is video...

which is the most expensive and still requires development (tech is currently maxed at 15-30 seconds), but once they've solved those math puzzles, it'll only take a few years to become far cheaper too. So who's going to pay for anything in a few years? Yeah, those trillions are never coming back.😬

What a convenient way to socialise the cost of the bubble bursting. "We need the government to compensate us for the massive losses we're incurring by being socially responsible and not unleashing SkyNet"

Whatever they actually say, it'll probably be an attempt to prevent anyone else from training super large models. Create a market niche only they can serve, and legally prevent competition.

They are just looking for a way to try to present "we are running out of money" as "we really care about what AI could do to humanity". As ever, all they do is lie.

This is an excuse that lets them avoid having to prove their software is still improving. Instead of admitting it has stagnated, they simply claim it would be 'too dangerous for the public' — it's their way out.