Rasmus Aagaard

Rasmus Aagaard

@rasgaard.com

Industrial PhD Student @ Laerdal.com & DTU.dk, research in efficient machine learning, edge deployment and model compression

416 followers599 following194 posts

I tried deploying DeepSeek-v4-flash-1017 on Azure to try it out in OpenCode. I kept getting an "unknown_model" error code. Searching online I found another person with the same issues with a similar reaction as I'm currently having

Rasmus Aagaard reposted

while you port and emulate games, I ported Jira to my PSP

Rasmus Aagaard reposted

NobodyWho in 25 seconds 🎬 Run open-weight AI models fully offline: 💬 Text generation 🖼️ Image + audio ingestion 🔊 STT, TTS & VAD 🔎 Embeddings & RAG Python, Flutter, RN/Expo, Swift, Kotlin, Godot... No cloud. No API keys. Open source. docs.nobodywho.ooo

Rasmus Aagaard reposted

All-new trailer for Nathan Fielder and Lance Oppenheim's 'You Can See Everything.' The Elizabeth Holmes documentary is in theaters on October 16.

Rasmus Aagaard reposted

Happy to announce the sixth session in Copenhagen Advanced Machine Learning Study Group (CAMeLS-Group 🐪). If you live in Copenhagen you are welcome to drop by and read the magnificent paper Bayesian Learning via Stochastic Gradient Langevin Dynamics by Max Welling and friends. luma.com/mhattbxq

luma.comCAMeLS-Group: sixth session in Copenhagen Advanced Machine Learning Study Group · LumaWelcome to the sixth instalment of the Copenhagen Advanced Machine Learning Study Group (CAMeLS-Group). We meet every second Monday to read and discuss a…

Presented our work on layer pruning of the Whisper encoder. We show that if we’re careful about which layers we prune away, we can remove 6 (18.5%) of them without major performance drops and even recover performance through simple distillation.

Had a really good time at the Danish Data Science Academy's Pre-Graduate retreat :) Was invited to participate in a panel discussion about the different ways of doing a PhD, representing the industrial PhD programme. Can highly recommend it if you’re a MSc student!

ddsa.dkDDSA Pre-Graduate Retreat 2026Are you a bachelor’s- or master’s student with data science as a key component of your study programme? Would you like to know more about pursuing a PhD in data science?

Any examples of orgs creating an internal SWE-bench? Curious about having ways to measure when local models reach a “good enough”-stage to be viable of x% of relevant coding tasks and this seems to be a promising way to communicate capabilities internally

Rasmus Aagaard reposted

Embedding models keep getting cheaper - what required ~300M parameters three years ago now requires only 11M. In practice, that means that what runs on the server today could run in the browser tomorrow.

MTEB@mteb.org

The best embedding score available at the end of 2023 needed a 304M-parameter model. Today the same score comes from an 11M one — 28x fewer active parameters.

Rasmus Aagaard reposted

Me and my agents, just out of frame, are having fun in this harness, laughing

Rasmus Aagaard reposted

NobodyWho Chat is live on iOS & Android! 🥳 A fully offline AI assistant. No internet, no accounts, no cloud. Run #Gemma, #Ministral, #Granite, #LFM, #Qwen and more, entirely on your device. Vision and hearing support included. Fully open-source. Links in comments 👇

Rasmus Aagaard reposted

The Danish Foundation Models (DFM) project is adapting our modular FlexOlmo architecture into a lighter-weight system that runs on commodity hardware—putting collaborative model building within reach of smaller research groups & organizations. 🧵

Got an extended abstract paper accepted at the GLOW workshop at IJCAI :) Turns out you can just delete 6 layers from the Whisper encoder and it doesn’t hurt transcription performance all that much (but you have to be pretty specific about which layers)

Rasmus Aagaard reposted

Seeing how SOTA models are evolving: becoming more restrictive in usage (decided by the company), less transparent (you cannot tell if the AI lab nerfed your model) + less private (your prompts are stored, no opt out) makes me much more interested in open models + local inference

Rasmus Aagaard reposted

getting your weights quantized probably feels amazing for the larger model

Rasmus Aagaard reposted

Very strongly recommend breaking out of the token discourse and touching grass from time to time to maintain a grip on reality

Rasmus Aagaard reposted

Legitimately feels like an unquantifiable vibe shift the last few weeks where the pendulum is swinging back to reasonable takes and people experimenting with model choice 🙏

Rasmus Aagaard reposted

We've recently implemented the fastest static embedding model in the world by an insanely large margin Read on for additional info ↓

Researchers identifies "Super Weights" which are at most a handful of weights (amongst billions!). Models end up generating complete gibberish if these weights are removed, underlining the brittleness of LLMs and importance and careful consideration of outlier features. arxiv.org/pdf/2411.07191

LLM cloud inference dominates usage, but should it? Local models and accelerators have improved massively over recent years. Perfect routing to best local model "reduce energy consumption by 80.4%, compute by 77.3%, and cost by 73.8% versus cloud-only deployment" arxiv.org/pdf/2511.07885

Rasmus Aagaard reposted

Introducing ✨Tiny Aya✨, a family of massively multilingual small language models built to run where people actually are. Tiny Aya delivers strong multilingual performance in 70+ global languages in a 3.35B parameter model, efficient enough to run locally, even on a phone.

Local AI inference through the browser is great. Transformers.js makes it feasible for someone like me who has little web dev experience :) Here's a simple transcription tool using Whisper-large-v3-turbo, making use of your local hardware and ensuring privacy. rasgaard.com/webai-stuff/...