Logarithmic Spirals

Logarithmic Spirals

@logarithmicspirals.com

Local AI, GPUs, self-hosting & software engineering. Hands-on guides, benchmarks, calculators, and experiments. https://logarithmicspirals.com

40 followers69 following92 posts

Model-file size is only part of a local LLM’s memory budget. K/V-cache usage grows roughly linearly with active context, so moving from 8K to 32K needs about four times the cache memory before rounding. #localai

Want to run local LLMs but unsure if your GPU can handle the context? 🤖 I built a Local AI VRAM Calculator & GPU Planner to check K/V cache, estimate model fit, and project TPS. Try it here: logarithmicspirals.com/tools/local-ai-vram-calculator-gpu-planner #LLM #LocalAI #VRAM #GPU

logarithmicspirals.comLocal AI VRAM Calculator & GPU Planner | Logarithmic SpiralsCalculate local AI VRAM needs and check whether a specific GPU and system RAM target can run the models you care about.

Experimenting with Codex this evening. It helped me delete my Hashnode integration, enhance my DEV integration, and bulk edit some old posts. Kind of nice to get an assist on those things since they would've taken a while to do by hand.

Just reached the final stage before I start serving my AI-generated podcast content. This final stage is me deploying podcast-it to a production environment, then rebuild my website with the necessary updates to host the episodes 😎

Going to be making a follow up post on my podcast project within the next week. Stay tuned. I'll be talking about setting up LLM evaluations within a TypeScript project. #TypeScript #LLM #PromptEngineering #SideProject #Podcasting

Ouch, just finished adding image redirects and updating links to images I have in my various blog posts. A painful, slow process. Wish I could've automated the whole process, but had to "bite the bullet" and just get it out of the way.

Basically, Astro adds hashes to the names of images it optimizes. The hashes are unstable, so they can change between builds. I had to write some custom code to replace the unstable hashes with stable hashes. I'll probably be writing about this in an upcoming blog post.

My custom table of contents component had some issues with code-heavy articles recently. Writing a custom Rehype plugin has helped, but it’s slow progress and still buggy. Anyone else deal with tricky components or custom plugins? Share your stories—I’m curious how you handled it! 🙌 #CodingLife