Cedric Clyburn

Cedric Clyburn

@cedricclyburn.com

Developer Advocate at Red Hat • Organizer KCD New York • Previously at MongoDB • containers, k8s, & everything in between

255 followers346 following108 posts

Want to learn more about self-hosting your own models and agents? This Thursday at 10am ET I’m joining @hacktoberfest.com for some live demos and tips on using #vLLM 🎃 Bring your questions, I'll try to get to as many as I can :)

3 million views on the IBM Technology whiteboard explainers this week 🤯 Still doesn't feel real. Best part is it's free :) for students, engineers, managers, people with no technical background at all, everyone can learn AI and tech in an accessible way. Thanks for watching, and keep learning!

You might’ve noticed I love open source and the impact that these projects have on the community 👀 that’s why this past week @devbcn.bsky.social I had the coolest opportunity to join my COUSIN who’s a PhD candidate and show open models + cloud-native for multi agent systems for research :)

AI coding tools are about to get more expensive, and the @anthropic.com news yesterday is a good indicator of what’s to come ($20 to $100 for Claude Code). Understandable, because GPU compute isn’t cheap 👀 Running models in-house with #vLLM is starting to look quite nice!

Self-hosting LLM’s typically includes a set of requirements for our infrastructure, ex: 🏎️ Hardware accelerators ⚙️ System & model configuration 📚 Specific libraries/dependencies That’s why @cern.voxxeddays.ch I was honored to demo Ramalama.ai, a project that containers to safely run AI models 🤖

Cedric Clyburn reposted

LLM Inference workloads are becoming monolithic, heavy, & hard to scale. That's where platform engineers can embrace llm_d, a new open-source effort that’s starting to tackle a problem we’re seeing more and more in prod ML stacks!!! 🎧 to @cedricclyburn.com & Christopher Nuland👇 to learn more

Live from #KubeCon Europe in Amsterdam! 🇳🇱 Big announcement from the Red Hat booth: llm-d, a cloud-native way to run AI at scale with major performance & cost savings. + ran a workshop on RAG at scale using KubeFlow & Docling on Kubernetes. Slides below 👇

If you’ve seen my “silly slide” of all the open-source AI projects at past dev conferences, this week at #KubeCon we’re putting them together! Join me & friends for a hands-on workshop: build a sovereign RAG app on K8s with Kubeflow, Knative, Docling & vLLM. Wed 3/25 @ 11am 🚀 🔗 sched.co/2CW1f

What does it look like to integrate #MCP into real enterprise workflows? This week at @devnexus.bsky.social we showed how to run, inspect, and scale agentic AI for debugging a Kubernetes clusters, diagnosing Ansible jobs, and much more! Check out the slides below ⬇️ as well as the MCP servers used!

What does it look like to integrate #MCP into real enterprise workflows? This week at @devnexus.bsky.social we showed how to run, inspect, and scale agentic AI for debugging a Kubernetes clusters, diagnosing Ansible jobs, and much more! Check out the slides below ⬇️ as well as the MCP servers used!

What does it look like to integrate #MCP into real enterprise workflows? This week at @devnexus.bsky.social we showed how to run, inspect, and scale agentic AI for debugging a Kubernetes clusters, diagnosing Ansible jobs, and much more! Check out the slides below ⬇️ as well as the MCP servers used!

What does it look like to integrate #MCP into real enterprise workflows? This week at @devnexus.bsky.social we showed how to run, inspect, and scale agentic AI for debugging a Kubernetes clusters, diagnosing Ansible jobs, and much more! Check out the slides below ⬇️ as well as the MCP servers used!

🤖 AI Agents are awesome… until they aren’t! What just happened with an 🦞 OpenClaw (ClawdBot/MoltBot) agent in the Matplotlib project on GitHub shows the potential challenges with giving AI Agents (LLM + Tools + Reasoning) the ability to act autonomously. It’s why guardrails and auth are important!

Today kicks off @jfokus.se in Stockholm 🇸🇪 and we just delivered our workshop on building with open source AI models using: ⚡️ #vLLM serve local LLM’s as a local API endpoint 🦜 @langchain4j.dev for adding LLM capabilities in our Java application Was a huge hit! Slides ⬇️

Really excited to share that our team at Red Hat is HIRING! 🎉 We're looking for excited new graduates with a passion for open source AI, interested in creating content to help developers, and traveling to meetups/conferences! 🔗 AI Developer Advocate: redhat.wd5.myworkdayjobs.com/Jobs/job/Bos...

redhat.wd5.myworkdayjobs.comAI Developer AdvocateAbout the Job At Red Hat, we believe the future of AI is open source. The Red Hat Artificial Intelligence Business Unit (AI BU) is seeking to hire a Developer Advocate to help grow awareness of Red Ha...

We’re BACK to Sweden 🇸🇪 this February! Excited to share that I’ll be joining and speaking at @jfokus.se this Feb 2-4th with the wonderful Stockholm dev community 💻 come by for our Day 1 workshop on building, testing, and deploying Java ☕️ apps using open source AI models and containers/Kubernetes!

Cedric Clyburn reposted

⚙️ Deep Dive Monday at #Jfokus — Building with Open Source AI: A Crash Course with @cedricclyburn.com & Legare Kerrisson from Red Hat. Learn how open models, Linux & Kubernetes empower you to forge your own AI path. 🔥 www.jfokus.se #DeveloperConference #AI #OpenSource #RedHat #Kubernetes #LLMs

We had a BLAST this weekend in Boston for #DevConfUS and the #vLLM meetup talking all things open source and AI 🚀 from LLM compression, distributed model serving on Kubernetes, RAG/Agentic apps and so much more, the community is what drives things forward, and I’m so grateful!

OpenAI’s gpt-oss language model is a beast, and matches models like o3 and o4-mini on coding, tool use, and more 🤯 but how can you run it yourself with zero trust security, in containers + automatic GPU acceleration? The #Ramalama project has you covered: developers.redhat.com/articles/202...

developers.redhat.comHow to run OpenAI's gpt-oss models locally with RamaLama | Red Hat DeveloperLearn to run and serve OpenAI's gpt-oss models locally with RamaLama, a CLI tool that automates secure, containerized deployment and GPU optimization

Cedric Clyburn reposted

It’s widely known that LLM’s can be costly and difficult to scale, but in the past few weeks I’ve learned about #llm-d, an open source framework for distributed AI inference on Kubernetes & put together this simple explainer blog ⤵️ What is llm-d & Why Do We Need It: www.redhat.com/en/blog/what...

redhat.comWhat is llm-d and why do we need it?We're seeing a significant trend: more organizations are bringing their large language model (LLM) infrastructure in-house.

We keep hearing about open-source AI like GPT-OSS, DeepSeek, Qwen, Llama 🦙 & more: but how do you actually test and scale them? At #Ai4 in Vegas 🎰, we built a Blackjack coaching game to benchmark small language models on both CPU and GPU via #llama.cpp and #vLLM! I’ll link the slides and demo ⬇️

We keep hearing about open-source AI like GPT-OSS, DeepSeek, Qwen, Llama 🦙 & more: but how do you actually test and scale them? At #Ai4 in Vegas 🎰, we built a Blackjack coaching game to benchmark small language models on both CPU and GPU via #llama.cpp and #vLLM! I’ll link the slides and demo ⬇️