What actually happens when you call an LLM API? ๐ค I've been working on this visual explainer for a while! ๐ฌ Follow one request from client โ gateway โ router โ GPU โ streamed response. Plus KV caching, continuous batching, speculative decoding, and more. The entire journey in 5 minutes! ๐
Post
๐ฌ Watch in 4K: www.youtube.com/watch?v=vlfO... ๐ค Full #Hacktoberfest 2026 talk (45 min): www.twitch.tv/videos/29077... ๐ More details: sujee.dev/events/2026-...
youtube.comWhat Happens When We Call an LLM API? One request, traced to the GPU and backYouTube video by sujee_dev
1 repost3 likes
๐ ๏ธ Behind the scenes: Part of my open-source Visual Stories series, using AI-assisted animations to explain complex technical concepts. Source code and production details on GitHub. Check it out, remix it, and share! ๐ github.com/sujee/visual...
github.comvisual-stories/projects/tracing-llm-api-request at main ยท sujee/visual-storiesOpen-source, reproducible visual explainers for AI and software concepts. Watch them. Reproduce them. Remix them. - sujee/visual-stories