Post

It’s widely known that LLM’s can be costly and difficult to scale, but in the past few weeks I’ve learned about #llm-d, an open source framework for distributed AI inference on Kubernetes & put together this simple explainer blog ⤵️ What is llm-d & Why Do We Need It: www.redhat.com/en/blog/what...