Pinned
I create a starter pack of current and former @explosion-ai.bsky.social. Give some of the people who made spaCy, Prodigy, Thinc, etc. a follow: go.bsky.app/VngRFva
Daniël de Kok
@danieldk.eu
Machine Learning, Natural Language Processing, LLM, transformers, macOS, NixOS, Rust, C++, Python, Cycling. Working on inference at Hugging Face 🤗. Open source ML 🚀.
1.5K followers164 following59 posts
Pinned
I create a starter pack of current and former @explosion-ai.bsky.social. Give some of the people who made spaCy, Prodigy, Thinc, etc. a follow: go.bsky.app/VngRFva
Next week on Netflix: AI Gone Wild With Clem 🤗 www.youtube.com/watch?v=9l9r... #huggingface #netflix #ai
So cool! transformers can now run GGUF models efficiently. To bring the performance close to llama.cpp, it uses the underlying ggml kernels through our kernels library. Awesome work by @marcsun.bsky.social et al.! huggingface.co/blog/transfo...
Daniël de Kok reposted
It is with great sadness that we announce the recent loss of a dear GroNLP group member. Gosse Bouma will always remain in our hearts! If you would like to write down memories or your condolences, you are welcome to do so via this www.condoleance.nl/19800.
Daniël de Kok reposted
Exactly 10 years ago today, Matthew and I sat at the notary's office overlooking the city of Berlin, and signed the founding documents of our company, @explosion.ai. So much has happened since and we got to witness the field evolve, "AI" become mainstream, and hypes come and go. (1/8)
Daniël de Kok reposted
Daniël de Kok reposted
Daniël de Kok reposted
Replying to @inesmontani.bsky.social
You can think of human-agent collaboration like a centaur, and we imagine we're the head. But if the computer tells you what to do and you just click buttons and report back, you've got the horse's head and the human butt. That's why so many AI workflows feel bad. We need shared interfaces.
Daniël de Kok reposted
People not in tech have been interested in what happened with the Open AI agent/Hugging Face hack. So, I "Explain it Like I'm 5"-ed it and made a cartoon in 8 panels. Apologies for some anthro-ing. 🫤 m-mitchell.com/HF-hack-cart... 1/8
Daniël de Kok reposted
Volkswagen blocks custom ROM users from VW app https://www.heise.de/en/news/Volkswagen-blocks-custom-ROM-users-from-VW-app-11370557.html?utm_source=flipboard&utm_medium=activitypub Posted into heise online international @heise-online-international-heiseonline
We recently made a lot of updates to the kernels ecosystem, from improving security, adding a dedicated kernels repo type on the hub, to support for Apache tvm-ffi. We made a write-up of these recent changes in this blog post: huggingface.co/blog/revampe...
We have recently added Torch Stable ABI support to @hf.co kernels and kernel-builder. So you can now target a specific minimum Torch version for long-term support. We're rolling out Stable ABI builds of kernels in kernels-community, starting with Flash Attention 3: huggingface.co/kernels/kern...
And on the heels of Flash Attention 3, we also have the vLLM fork of Flash Attention 3: huggingface.co/kernels/kern... This is used for e.g. gpt-oss, since that model uses attention sinks.
I switched from Claude Sonnet/Opus to mostly using Kimi K2.7 Code and GLM-5.2, and... nothing bad happened. The @hf.co Inference API makes it super easy to switch between different models and providers: huggingface.co/inference/mo... Open models are really competitive - great pricing and fast.
Daniël de Kok reposted
The flexibility of #nix and #nixos is insane. What if you are building compute kernels with Nix, but you need them to be compatible with manylinux_2_28 (based on Enterprise Linux 8)? Simple, repackage the EL8 gcc toolset RPMs as Nix derivations and wrap it in a stdenv. github.com/huggingface/...
Daniël de Kok reposted
Daniël de Kok reposted
We released kernels 0.15.1, packed with new features, including: * Torch stable ABI support * Better manylinux_2_28 support * A skill for making XPU kernels * Better offline support * Docs on IDE support for local development. github.com/huggingface/...
We also update the first kernel to use the Torch stable ABI: huggingface.co/kernels/kern...
Daniël de Kok reposted
Safetensors has become one of the cornerstones of machine learning tooling for safe loading of arrays. Safetensors has now joined the @pytorch.org Foundation: pytorch.org/blog/pytorch... The repository has also moved to a new home: github.com/safetensors/...
Daniël de Kok reposted
Happy Trans Day of Visibility! 🏳️⚧️ The mere act of existing and being visible shouldn’t be as fraught as it is today. Let’s keep fighting to set things right. en.wikipedia.org/wiki/Interna...
Daniël de Kok reposted
Daniël de Kok reposted
More embedding models and an even more reliable inference engine is what you get with @hf.co Text Embeddings Inference v1.9.0 💥 More in the thread 🧵
Kernels now has an agent skill to write custom Hub kernels: huggingface.co/blog/custom-... Awesome work by @benburtenshaw.bsky.social and Sayak Paul! 🔥
kernels 0.12 is out! 🎉 Changes: * Support for kernel version branches to gracefully roll out kernel API changes. * Support for PyTorch 2.10. * kernel-builder is now merged into the kernels repo. * Initial support for standardized kernel benchmarks. github.com/huggingface/...
Daniël de Kok reposted
DeepSeek R1 dropped one year ago 🐳 and a lot has changed. With Irene Solaiman, we’re launching a blog series on @hf.co about how that moment reshaped AI + open source in 2025, starting with strategic shifts and the explosion of new open models in China! huggingface.co/blog/hugging...
Daniël de Kok reposted
Daniël de Kok reposted
👀 Look what 🎅 has broght just before Christmas 🎁: a brand new Research Master in Natural Language Processing at @facultyofartsug.bsky.social @rug.nl Program: www.rug.nl/masters/natu... Applications (2026/2027) are open! Come and study with us (you will also learn why we have a 🐮 in our logo)
I finally made a page on my Dish activation function, replacing my deleted Tweet: danieldk.eu/Dish-Activat... It's a non-monotonic function similar to GELU/SiLU, but does not require elementary functions, making it faster on various hardware. I'll leave the empirical evaluation to someone else 😁.
It started out as a joke with @kadarakos.bsky.social in 2022 when we worked at @explosion.ai that we should make an activation function using the fast inverse sqrt of Kahan/Walsh and famously used in Quake 3.
We are currently doing a reading group on RISC-V and its vector extension. I actually got to implement it using the fast inverse square root because the T-Head board that we use does not have the vfrsqrt7.v instruction. So, full-circle I guess. github.com/danieldk/low...
Daniël de Kok reposted
Training LLMs end to end is hard. But way more people should, and will, be doing it in the future. The @hf.co Research team is excited to share their new e-book that covers the full pipeline: · pre-training, · post-training, · infra. 200+ pages of what worked and what didn’t. ⤵️
Daniël de Kok reposted
The Hub is on 100% on Xet. 🚀 A little over a year ago, @hf.co acquired XetHub to unlock the next phase of growth in models and datasets. huggingface.co/blog/xethub-... In April, there were 1,000 Hugging Face repos on Xet. Now every repo (over 6M) on the Hub is on Xet.
We made a blog post on how you can use kernel-builder to develop and build compute kernels for the @hf.co Kernel Hub: huggingface.co/blog/kernel-...
Yesterday we released support for GPT OSS (the new OpenAI open weight model) across the @hf.co ecosystem. The latest Transformers now integrates support for the kernels package and uses kernels from the HF Kernel Hub to run models like GPT OSS as fast as possible. 🚀 huggingface.co/blog/welcome...
Also a huge shout-out to @nixos-org.bsky.social! All the kernels in huggingface.co/kernels-comm... are built using kernel-builder, which uses Nix under the hood to build ABI3 kernels for all the supported Torch configurations (various CUDA/ROCm versions, Metal): github.com/huggingface/...
Transformers 4.54.0 is out! This release adds support for compute kernels hosted on the Hub. When enabled, transformers can replace PyTorch layer implementations by fast, specialized kernels from the hub. github.com/huggingface/...
The kernel ecosystem is completely open: you can make your own kernels with kernel-builder, upload them to the hub, and register a mapping using the kernels package and they get used by transformers. github.com/huggingface/... github.com/huggingface/...
David Holz made an introduction video showing how to make your own kernels with kernel-builder: www.youtube.com/watch?v=HS5P...
Daniël de Kok reposted
Just released a new version of mktestdocs. It now also supports huggingface docstrings! github.com/koaning/mkt...
Daniël de Kok reposted
Daniël de Kok reposted
So excited to finally release our first robot today: Reachy Mini A dream come true: cute and low priced, hackable yet easy to use, powered by open-source and the infinite community. Read more and order now at huggingface.co/blog/reachy-...
Daniël de Kok reposted
SUSE has released Cavil-Qwen3-4B, a fine-tuned, #opensource #LLM on #HuggingFace. Built to detect #legal text like license declarations, it empowers #devs to stay #compliant. #fast #efficiently. #openSUSE #AI #Licenses news.opensuse.org/2025/06/24/s...
Over the past few months, we have worked on the @hf.co Kernel Hub. Kernel Hub allows you to get cutting-edge compute kernels directly from the hub in a few lines of code. David Holz made a great writeup of how you can use kernels in your projects: huggingface.co/blog/hello-h...
Daniël de Kok reposted
Hi Berlin people! @hugobowne.bsky.social is in town & we're celebrating by hosting a meetup together 🎉 This one is all about building with AI & we'll also open the floor for lightning talks. If you're around, come hang out with us! 📆 June 16, 18:00 📍 Native Instruments (Kreuzberg) 🎟️ lu.ma/d53y9p2u
TGI v3.3.1 is released! This version switches to Torch 2.7 and CUDA 12.8. This should improve support for GPUs with compute capabilities 10.0 (B200) and 12.0 (RTX50x0 and NVIDIA RTX PRO Blackwell GPUs). github.com/huggingface/...
Daniël de Kok reposted
We just released text-generation-inference 3.3.0. This release adds prefill chunking for VLMs 🚀. We have also Gemma 3 faster & use less VRAM by switching to flashinfer for prefills with images. github.com/huggingface/...