Turns out building an index of millions of vector embeddings in real-time is not feasible on a $5 VPS.
No good alternatives that will give me enough CPU for reasonable cost either.
I’ll have to pivot my project due to technical limitations. #buildinpublic