+16
Daily
+196
Weekly
39,003
stars
2,523
forks
114
watchers
936
prs
295
issues
138
releases
README
llmfit English · 中文 · 日本語 Find out which open-source Large Language Models (LLMs) your hardware can comfortably run. llmfit inspects your CPU, system RAM, GPU(s), VRAM, and accelerator configuration to recommend models across popular quantizations. 📊 New: benchmark & share — real numbers from your machine, better estimates for everyone. Download a model, serve it, and measure real tok/s on your hardware — then contribute the results back to the project as a PR, straight from the TUI. No gh CLI, no third-party account. Every run is saved locally first, your own measurements replace estimates in the fit table, and each merged submission ships in the next release: anyone on identical hardware gets measured ✓ numbers before they ever run a benchmark. Follow the step-by-step benchmarking guide → !llmfit demo: searching for a model, simulating different hardware, and planning a deployment Features - Hardware Auto-Detection: Detects CPU cores, system RAM, available discrete/integrated GPUs, VRAM, and unified memory architecture (NVIDIA CUDA, Apple Silicon, AMD ROCm, Intel OneAPI). - Model Compatibility Engine: Analyzes model parameter counts, context lengths, and quantization formats (GGUF, AWQ, GPTQ, EXL2) to project memory footprints and tokens-per-second performance. - Interactive TUI & Web Dashboard: Choose between a lightweight, zero-dependency terminal interface or a feature-rich web dashboard. - REST API Endpoint: Exposes standard HTTP JSON endpoints (/api/v1/system, /api/v1/models) for integration into orchestrators, dashboards, and automated deployment pipelines. - Multi-Platform Support: macOS (Apple Silicon & Intel), Linux (x86_64 & ARM64), and Windows (x86_64). - Hundreds of models & providers. One command to find what runs on your hardware. A terminal tool that right-sizes LLM models to your system's RAM, CPU, and GPU. Detects your hardware, scores each model across quality, speed, fit, and context dimensions, and tells you which ones will actually run well on your machine. Ships with an interactive TUI (default) and a classic CLI mode. Supports multi-GPU setups, MoE architectures, dynamic quantization selection, speed estimation, and local runtime providers (Ollama, llama.cpp, MLX, Docker Model Runner, LM Studio). --- Sister projects - sympozium — managing agents in Kubernetes. - llmserve — a simple TUI for serving local LLM models. Pick a model, pick a backend, serve it. - llama-panel — a native macOS app for managing local llama-server instances. - llmfit-gui — a Windows desktop GUI (PowerShell + WinForms) for llmfit: browse recommendations, download into LM Studio/Ollama, and benchmark, all point-and-click. --- Documentation | | | |---|---| | Get started | Install · Usage · How it works | | Guides | TUI guide · Benchmarking step-by-step · CLI & automation · Cluster mode (Ray / multi-node) · Runtime providers · OpenClaw integration | | Reference | How it works (full) · Platform & GPU s
Top issues
#638Detect multiple GPUs12 comments · 2026-06-17#301Request to add support for NPU and Hybrid models12 comments · 2026-03-31#81Feature: collect results on a website8 comments · 2026-02-25#914[Feature]: Recommendations for Tool-Using Coding Agents7 comments · 2026-08-19#635MacBook Neo shows no models under "Good" or "Runnable" due to conservative KV cache filtering7 comments · 2026-06-15#1090[Calibration]: Detect PCIe link speed/topology for accurate calibration and throughput estimates4 comments · 2026-09-27#1036Fit estimates don't account for Unsloth Studio's beyond-VRAM offload4 comments · 2026-09-14#928[Feature]: Support LM Studio in Inference Bench (Quality Benchmarks / Routing)4 comments · 2026-08-21
Discussions
#1178llmfit is #1 in Open models on Archestack (badge, if you want it)0 comments · 2026-10-21#1154llmfit included in AgentManager's tool catalog1 comments · 2026-10-18#1134Optional Packslip CLI manifests and release-matched advisor skill2 comments · 2026-10-11#1025abliterated/community models work?4 comments · 2026-09-11#989LLM Fit GUI — a Windows desktop wrapper for llmfit1 comments · 2026-09-02#956Export/Print1 comments · 2026-08-26#949Filtering Context size , filtering Quants, filtering Tps1 comments · 2026-08-24#929Possible to filter by nationality of model?4 comments · 2026-08-21
Latest release
v1.1.20 v1.1.20 2026-11-031.1.20 (2026-11-03) Bug Fixes NVFP4 and MXFP4 safetensors repos are no longer offered as llama.cpp fits, so they don't top the list on ROCm and CPU machines (1230) 39 large models now have real attention-head counts from their config.json (including Llama-3.1-405B and MiniMax-M1), so --cluster can check their tensor-parallel splits (1230) diff and the TUI compare view no longer put a model that doesn't fit, or whose cluster split is refused, ahead of one that fits (1230) cluster: the banner shows the VRAM pool actually used when --memory is set (1230) cluster: Ray discovery sets backe