Post

we would not actually know how and why either CSAM or heroin or burning plastic is bad and affects victims/drug users without actual studies involving their impact. you cannot just from-first-principles every single possible issue.

A lot of people's priors are locked in 2024, and haven't adjusted to the reality that, in 2026, you can run an open source model that is approximately Claude Sonnet quality on a $5000 Mac M5 and it uses less than 300 watts to operate. No water. And it's way, way more capable than the 4o they mocked.

It’s still a pain in the ass and 100-200/mo is more palatable than dropping 5k+ on a dedicated machine that generates tokens slower and overall slows to a crawl when generating. It’s not yet The Year of Linux on the Desktop.

Exactly. The time will come when it will make sense for end users to run their own LLMs locally, though. Apple is famous for not entering a market until it's ready for a polished, premium product, and then dragging the rest of the market to create the low-cost, commodity alternatives.

“write the next three paragraphs of this essay” tier home AI has been available for the last few years. “create a quicken clone” tier home AI is still a decade out, at current chip availability, i reckon