Post

Do your airBnB's pans look pristine, but everything cooked on it tastes way too garlicky? Multi-tenant RAG/LLMs can be similar: broad semantic queries can leak "residual" context from other tenants. Be careful, though: That weird taste might be from macaroni, but it also might be methyline!

I have contemplated doing some long-term scientific research into Copilot but I don’t present at conferences anymore and don’t work for a team that publishes content. 🤔 I have thoughts about both how to cause leakage, and how to measure leakage.

Pro- tip: make sure you check out some @jhaddix.bsky.social videos on YouTube. Some of his ideas are simple, but simply brilliant. In fact, I have been inspired to create my own jailbreaks by mimicking* some of his. * "mimicking" meaning "blatantly plagiarizing"