Post

I think a lot of people in tech are probably feeling something close to despair about what to do about LLMs, since it’s clear that those with power are not going to relent with their advocacy, and they have enough uses that they’ve gained critical mass, yet the harms & risks are so wildly egregious…

I think the answer has to be a multiplicity of responses. There need to be *many* alternatives, created by many entities. The answer to McDonald’s being unhealthy isn’t “make another fast food joint” — it’s getting rid of food deserts and improving nutrition overall. Give power back to the people…

If people want some of the things AI can do, have those technologies be provided by tools & platforms created by cooperatives, by unions, by universities and governments, by municipalities and by individual creators, or as open source owned by nobody. Destroy the economic value of proprietary tools.

There is a long history of communities effectively competing with closed platforms — and certainly a worker’s coop could make a tool that is better for the environment, better about intellectual property, not prone to hallucinations, and that has safety guard rails so it won’t incite self-harm.

15 reposts170 likes

But you think a worker's coop LLM would change the state of the market sufficiently to eliminate OpenAI's problematic dynamics? Isn't it possible that worker's coop LLM could suffer the same problems without significant effort? I'm not trying to completely poo-poo the idea, but it is very complex...

No, you're right. The problems Anil describes are fundamental to LLMs. ChatGPT doesn't hallucinate because OpenAI engineers are evil or incompetent, it's just how the tech works. Having a co-op make it doesn't fix that

Coming back to this thread... After deeper research I'm finding lots of people who've built LLM products who are excited about the prospect of individual software developers spending $200 a month on side projects. Sounds to me like some people are dreaming of a world where wealth builds code.

And it could even be regular-ass companies! An insurance company could make an LLM that has a lot of use for a lot of folks and isn’t evil! Or a supermarket. Like… it’s not exclusive to giant evil tech tycoons!

insurance companies can't do this because it's too difficult, even if they have the budget; technical skill is a bottleneck. it 100% has to be either gov or open source

Do you think insurance companies and supermarkets have the resources / technical skills to create something worthwhile here? Do you think that would reduce the usage of OpenAI for other reasons (how people are using it today to just chat with it)?

Not really… training is still stunningly expensive and requires a ton of investment, which is why these companies want to sell a service. But I think the rest of your point is great! The bubble will burst in 6 months at the latest and AI will take a different shape.

As a followup to this: the best and most reliable computing is done by small sharp tools. Obviously massive service meshes and big platforms do things, but the people who make those trust low level, discrete components. I think AI needs to become a series of small sharp tools as well. AGI == BS.

Training the massive general purpose LLM (GPT-4 is rumored to be a 1 trillion parameters model). Most of the specialized models can probably be trained with just 24 billion parameters, and in some cases 7B is enough. Furthermore, those sizes foundational models are all available with

Oh I’m keenly aware of those harms. I’m thinking more of the nonprofit orgs in that space that are more aligned to public welfare.