Post

It feels crazy to me that there's no TypeScript-native, local-first tool for testing LLM-powered apps. So, I'm building one. It's based on Vitest, and it's called Evalite. Here's an early preview. www.aihero.dev/evalite-an-e...

aihero.devEvalite - an Early PreviewAI Engineering for Curious Professional Developers

Christopher Little-Savage

@cjols.dev

It looks like you're exporting `Levenstein`, rather than using autoevals directly here. What's the thinking there? Does it need wrapping in some way?

2/12/24, 2:44 pm0 reposts0 likes

Matt Pocock

@mattpocock.com

2 Dec 2024

Could absolutely import from autoevals, but it also brings in a lot of guff with it that I don't need. Plus the Eval import conflicts with evalite.