Join Rob Mulla at 10:40 AM for our sponsored demo: Unifying & Accelerating Open-Source LLM Serving on Google Cloud TPUs with TorchTPU! See how it provides a unified backend for vLLM & SGLang, deploying SOTA models with minimal code changes. goo.gle/4gTLUhw
0 reposts2 likes