Running a GenAI app locally with OpenAI SDK + Docker Model Runner? Yes, please. This demo uses Next.js + Docker Compose to serve up an LLM chatbot (Qwen 2.5) with hardware acceleration on Apple Silicon. Local, fast, secure. Watch it go! @wittek.dev #Docker #JavaScript #NextJS #LLM #AI #OpenAI
3 reposts14 likes