Post

Nick Fisher
@hydroxide.dev

Inception's Mercury 3 is surprisingly capable (not to mention blindingly fast). I road-tested 2.5 and it wasn't reliable at all, degraded quickly, very dumb, misspelled filenames, language primitives, etc. None of that in 3 so far. I've been pleasantly surprised.

1 repost12 likes

Kai Jellinghaus
@kaij.party

Is it faster via the direct API? Doesn't feel that fast to me - DS 4.1 is also available at 150+ tps. And the 1000+ tps claim from Inception seems marketing only? I mean their volume has exploded but still...

Nick Fisher
@hydroxide.dev

I'm using Mercury 3 and DS 4.1 side-by-side right now, both via official API, and Mercury is easily 2-3x faster. I don't know about 1000 tps though (I previously tried mimo-2.5-ultraspeed which was literally 1000 tps and that was so fast I literally couldn't keep up)

Kai Jellinghaus
@kaij.party

Reasoning or no? From what I see Mercury has very weird latency patterns with reasoning. Maybe that is what throws me off

Nick Fisher
@hydroxide.dev

I leave it as provider default, which I think defaults to low for Mercury (though I don't even see any reasoning blocks), so that could explain it.

Nick Fisher
@hydroxide.dev

It's not frontier intelligence, but honestly for a good chunk of daily work, you don't need it. Speed can be much more important than smarts and that's where Mercury excels.