Post

Offline On-Device AI Agents with Gemma & Local Tool Calls (feat. @shivaylamba.bsky.social) How do you run an agentic healthcare workflow without sending private patient data to the cloud? Run local Speech-to-Text + a 12B Gemma model on-device to execute pharmacy tool calls 100% offline.

28/10/26, 5:22 am1 repost1 like

Alex Patterson

@codercat.dev

10h

Shivay Lamba breaks down how to run 100% offline on-device AI agents with Gemma and local tool calls!

CodingCat.dev

@codingcat.dev

10h

Explore Shivay Lamba's interactive Edge Inference walkthrough: https://inside-edge-inference.vercel.app/request/?phase=1 Full episode coming soon on CodingCat.dev: https://codingcat.dev/podcasts