Post

I'll get straight to the point. We trained 2 new models. Like BERT, but modern. ModernBERT. Not some hypey GenAI thing, but a proper workhorse model, for retrieval, classification, etc. Real practical stuff. It's much faster, more accurate, longer context, and more useful. 🧵

Ooh! This looks very promising. I’ve been thinking of replacing some classification steps in a workflow with local models. I’m curious how fast they can be on CPU only hardware(compared to slow sonnet api calls).

Yes, this was my thought exactly. There's tons of stuff you want a little bit language model smarts for but you don't need need a full chatbot. This could be great for that, especially if it can run in the web server directly.