Post

AirLLM AirLLM is a Python library for running very large language models on consumer GPUs with limited memory by loading model layers sequentially instead of keeping the entire model in VRAM. https://github.com/lyogavin/airllm