antirez

antirez

@antirez.bsky.social

Reproducible bugs are candies ๐Ÿญ๐Ÿฌ I like programming too much for not liking automatic programming.

13.9K followers379 following1.4K posts

Credits where credits is due: kudos to @OpenAI in the context of the new scientific releases, for putting the scientists that worked in a given field for a long time at the center of the process of understanding and announcing the new discoveries.

I believe StarTrek Voyager to be a masterpiece and often I think that, to make it happen, an incredible level of trust in a crazy project was needed (for StarTrek in general): people writing scripts and acting like all that crazy stuff mattered (they matter). It's not obvious.

Work in progress, Iris.c in a DGX Spark running Flux 3 Klein. I know prompts for Flux 3 should be post-processed for better results, but it kind works even with humans written descriptions, more or less. New Iris release in the next days.

Even if the DGX Spark is SM121 and not SM100, yet maybe we can get something good for DwarfStar kernels from DeepSeek Infer. Let's try.

DeepSeek infer is the cloud version of DwarfStar, conceptually. Vertical inference engine for one model and specific hardware. Good move. And well, a lesson to the ones that criticized this approach as well.

For the ZX Spectrum lovers, there was enough documentation around to also simulate the whole Spectrum PCB with very precise ULA emulation (cross checked with the actual gates implementing it). On my GitHub as usually.

DwarfStar GGUF for DeepSeek v4.1 Flash new checkpoint is now available. It is an improvement even only for the better token efficiency. Upgrading is a must.

We in Europe have a lot of problems in creating companies. But a big one was getting funding to pay programmers and create big companies. I believe that with AI, if people change mentality a little bit, even just the young folks, we can move a lot of IT back to Europe.

That said, even if copying the behavior of software is legal and was instrumental in shaping modern computing, I do not like that folks copy almost pixel-exact other software UX. Why don't you use your head and create the new cooler different CAD, graphics program, and so forth?

What Tao should do right now instead of slide decks? Use AI and his skills to make the AI results understandable. Never bet against technology.

DeepSeek v4 .1 score in DeepSWE 1.1 is higher than Mistral Large 4. The same for other benchmarks as well. Happy to see more europeans LLMs but unhappy when the comparisons are not the ones obvious.

[Thread] That's interesting, on HN there is a "from Redis creator" news right now (community site, the DwarfStar real site is GitHub) and somebody replied that since it is "from Redis creator" people should probably we skeptical because Jepsen Redis results.

View full thread

So a system that takes some care to avoid common failure modes, or that just limits the outcome of failures, if it pays this compromise to have stellar properties when things don't go bad, it is a system that has a place.

I'm thankful I was thinking like that. And I believe many other systems and companies that failed in between, all considered, now would not blindly buy the "lineraizable at all the costs" argument anymore.

[Thread] That's interesting, on HN there is a "from Redis creator" news right now (community site, the DwarfStar real site is GitHub) and somebody replied that since it is "from Redis creator" people should probably we skeptical because Jepsen Redis results.

View full thread

That's not to say that linearizability is not a good property for certain use cases, but that safety is actually a tradeoff, and one can be still vulnerabile to complex partitions/restarts scenarios while still having different degrees of real-world safety for most setups.

Back in the days I realized that a system can't be characterized just for the way it handles whatever complex failure modes can be simulated, but it is actually the sum of how it behaves across all its lifetime of execution.

[Thread] That's interesting, on HN there is a "from Redis creator" news right now (community site, the DwarfStar real site is GitHub) and somebody replied that since it is "from Redis creator" people should probably we skeptical because Jepsen Redis results.

But I believe that not following the vision that wanted, in the late 2000s, every database to be able to guarantee strong consistency properties, was one of my best views that basically *saved* Redis from the same fate of many other systems that failed.

Calling classifiers "decision models" is a crime against machine learning. Those models decide *less* than LLMs, as you can think the CoT as a form of serial processing of information that such classifiers lack.

Those models can be either *small* LLMs that are not let think, but instead the logits at the last position of the prefill are used to categorize in classes or, when they are BERT-alike, they compress the input meaning and project a class: in both cases they decide a lot less than an LLM.

Wrong advice for junior developer: look at the AI generated code, since you need to mature as a programmer. Right advice: save time with AI coding and write by hand "get-better" programs: interpreters, games, ray tracers, ...

Don't look at generation tokens per second as the main metric for local inference. Soon Cinese open model providers will realize that the game is all about making the thinking phase as short as possible, and 20/30 t/s will be enough if you have fast prefill.

This in turn will make the DGX Spark and Strix Halo a lot more compelling, so do not assume that the hardware you got can be valuated in the void. It depends a lot on the class and exact strengths of models that are released.

I claim that if you are a normal person that like me don't have "fuck you money", so unable to spend large sums of money randomly, you should do all your programming work with two max accounts (OpenAI / Anthropic for instance) in the worst case, and never buy tokens via API.

The most ridiculous thing about the AI-coding age is that in the last 20 years programmers accepted otherwise all the kind of shit: terrible frameworks, languages, layers of complexity everywhere, everything super slow. Very few protested, since destroying the field didn't involve their paycheck.

Now "slop! sl00p! SLOP!!!111". Just tell the truth: you are rightfully scared about how to pay your invoices and bring forward your family, and this is a correct and respectable concern. But say things as they are.

Good programmers state they use models like GPT 6 Astra without obtaining good results: it makes me feel I live in a parallel universe. But the explanation is not that hard: good programming in the past and now requires a different skill set, even if there is some overlap.

I'm worried to see people that think the right move is to question AI companies and narratives around AI regardless of logic and the actual significance of events we are living. They act just as an inverted flock, but still a flock. Sometimes it's fear of friends judgement.

Jev may have its (narrow) use cases but the hype you see around is the perfect representation of the fact the greatest part of the AI bubble don't know what is important and what is not. Jev is a minor thing happening on AI compared to all the rest, yet the hype exploded.

Started yesterday as a joke without any code reference if not papers. Because of fillets already better than TinkerCAD for certain stuff. There is something odd, here: in theory open source should explode right now, but we don't have, apparently, folks motivated to do wonders.

At this point DwarfStar contains many fast fused kernels for important model families: feel free to steal everything you want from there according to the MIT license, in order to improve your own implementation.

Witch hunting level: some guy uses AI to reverse engineer an M4 GPU driver for Linux and part of the community that should be for the open source, for the hacking, for the liberation and freedom is against him.

The irreconcilable misunderstanding about AI is that for some of us is the way to remove suffering, inequality, limits from the human race. For others, a tool: and, right now, the capabilities are at tool level, giving the illusion that the tool is the point.

Qwen3.8 Flash Next is now supported in DwarfStar, covering 64GB Mac systems very well and with very fast inference of 50~70 t/s and > 1400 t/s prefill. For now this is Metal only. Thanks to @ivanfioravanti.bsky.social for all the cool work in the PR. N-grams on SSD like for DS4.1F.

Not sure if this makes sense on the DGX Spark. You have 128GB there, however the extra speed could be very tempting for the Spark users, as well as having a lot of RAM free for other stuff. For ROCm it makes sense as many folks have a Framework Desktop with 64GB.

It drive me nuts that now people use AI to write tweets. If you think that this way you will get more popular and so forth, think twice. Write something authentic. AI is great but it is easy to misuse. Your tweets must be your more cared thoughts.

With the last commit into DwarfStar now you can use DeepSeek v4.1 Flash in a single DGX Spark as well, with SSD streaming. Around 9 t/s generation. It works also dual-spark RDMA at ~22 t/s.

Conspiracy theories are, very often, illogical. If AI companies were worried by open weight models (they probably are btw) the logical response would be to *not* slow down the development of frontier AI, to try locking the advantage. Stop with nonsense.

DwarfStar running DeepSeek v4.1 Flash on a 128GB M5 Max at steady 15 t/s. I didn't expect with SSD streaming it could be so fast. Recent SSD streaming changes to retain the right experts surely helped, but also maybe DS4.1 uses the same experts more. Will push online when ready QA > ASAP.