Post

im not kidding and im sure @cameron.stream can back me up from another direction: if you arent capturing/mining your team's agent session logs, you are leaving it all on the table. we have a service that lets you run RAG tool calls against vectorized agent session summaries and it is 🔥🔥🔥

the fact that ant/oai dont trivially expose a "download all my org's inference logs" button makes me think that they realize those logs are worth almost as much as the output of the agent sessions themselves

That is super cool! Can you speak a little bit about how you're doing evals? Like is it measuring successful vs failed tool calls, or something like that?

postgres/qdrant corpus snapshots, ~100 hand-labeled “these are the minimum correct corpus items to surface for this question” examples, weighted by token cost

0 reposts2 likes

No replies yet.