Models · 60 tracked · 48 sizeable · target Interactive from the Plan "My stack (Plan)" · recomputed in 8670 ms
43 of 60 tracked models run on a machine you can buy — 37 of them at ≥ 15 tok/s, and 6 pipelines on memory and a supported backend, at 32K context, out of 89 machines the search could build.
What moved
- All 60 tracked models were already on record 24 h ago.
What this screen is showing
Every tracked model
| Model | Params B | Quantization | Needs GB | Machines | Onboarding | Confirmed at source |
|---|---|---|---|---|---|---|
| Gemma 4 E4B ITGoogle · dense · vision · 128K ctx max | 7.5 (derived)6.8 (derived) | Q3_K_M4.06 GB (observed) | 5.36 GB (estimate) | 89 of 89 (derived) | SIZEABLE | read — Gemma 4 E4B IT: the least recent read of its data from source (shape counted Oct 17, 9:01 AM ET from the tensor headers of https://huggingface.co/google/gemma-4-E4B-it; quantization sizes read Oct 17, 9:01 AM ET); never checked upstream. |
| Qwen3-VL 2B InstructAlibaba Qwen · dense · vision · 256K ctx max | 1.7 (derived)1.4 (derived) | UD-Q3_K_XL0.97 GB (observed) | 4.80 GB (estimate) | 89 of 89 (derived) | SIZEABLE | read — Qwen3-VL 2B Instruct: the least recent read of its data from source (shape counted Oct 17, 7:56 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3-VL-2B-Instruct; quantization sizes read Oct 17, 7:56 AM ET); never checked upstream. |
| Qwen3-ASR 0.6BAlibaba Qwen · dense · speech to text | 0.8 (derived)0.6 (derived) | Q8_00.80 GB (observed) | 4.63 GB (estimate) | 89 of 89 (derived) | SIZEABLE | read — Qwen3-ASR 0.6B: the least recent read of its data from source (shape counted Oct 17, 7:50 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3-ASR-0.6B; quantization sizes read Oct 17, 7:50 AM ET); never checked upstream. |
| MiniCPM-V 4.6OpenBMB · dense · vision · 256K ctx max | 0.8 (derived)0.5 (derived) | Q4_K_M0.53 GB (observed) | 0.97 GB (estimate) | 89 of 89 (derived) | SIZEABLE | read — MiniCPM-V 4.6: the least recent read of its data from source (shape counted Oct 17, 8:41 AM ET from the tensor headers of https://huggingface.co/openbmb/MiniCPM-V-4.6; quantization sizes read Oct 17, 8:41 AM ET); never checked upstream. |
| gpt-oss-20bOpenAI · MoE · reasoning · 128K ctx max | 20.9 (derived)3.6 (derived) | Q2_K_L11.8 GB (observed) | 13.5 GB (estimate) | 88 of 89 (derived) | SIZEABLE | read — gpt-oss-20b: the least recent read of its data from source (shape counted Oct 17, 6:37 AM ET from the tensor headers of https://huggingface.co/openai/gpt-oss-20b; quantization sizes read Oct 17, 6:37 AM ET); never checked upstream. |
| Kimi-VL A3B Thinking 2506Moonshot AI · MoE · vision · 128K ctx max | 16.0 (derived)2.6 (derived) | Q4_K_M10.5 GB (observed) | 12.4 GB (estimate) | 88 of 89 (derived) | SIZEABLE | read — Kimi-VL A3B Thinking 2506: the least recent read of its data from source (shape counted Oct 17, 8:54 AM ET from the tensor headers of https://huggingface.co/moonshotai/Kimi-VL-A3B-Thinking-2506; quantization sizes read Oct 17, 8:54 AM ET); never checked upstream. |
| Qwen3.6-35B-A3BAlibaba Qwen · MoE · coding, vision · 256K ctx max | 34.7 (derived)2.9 (derived) | IQ4_XS19.7 GB (observed) | 21.9 GB (estimate) | 86 of 89 (derived) | SIZEABLE | read — Qwen3.6-35B-A3B: the least recent read of its data from source (shape counted Oct 18, 3:39 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3.6-35B-A3B; quantization sizes read Oct 18, 3:39 AM ET); no upstream check after it. |
| Gemma 4 12B Unified ITGoogle · dense · vision · 256K ctx max | 11.9 (derived)10.9 (derived) | IQ4_NL6.72 GB (observed) | 7.86 GB (estimate) | 85 of 89 (derived) | SIZEABLE | read — Gemma 4 12B Unified IT: the least recent read of its data from source (shape counted Oct 17, 8:59 AM ET from the tensor headers of https://huggingface.co/google/gemma-4-12B-it; quantization sizes read Oct 17, 8:59 AM ET); never checked upstream. |
| Qwen3-VL 4B InstructAlibaba Qwen · dense · vision · 256K ctx max | 4.0 (derived)3.6 (derived) | IQ4_XS2.27 GB (observed) | 7.28 GB (estimate) | 85 of 89 (derived) | SIZEABLE | read — Qwen3-VL 4B Instruct: the least recent read of its data from source (shape counted Oct 17, 7:57 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3-VL-4B-Instruct; quantization sizes read Oct 17, 7:57 AM ET); never checked upstream. |
| GLM-4.6V-FlashZ.ai · dense · vision · 128K ctx max | 9.4 (derived)8.8 (derived) | IQ4_XS5.28 GB (observed) | 7.05 GB (estimate) | 85 of 89 (derived) | SIZEABLE | read — GLM-4.6V-Flash: the least recent read of its data from source (shape counted Oct 17, 8:52 AM ET from the tensor headers of https://huggingface.co/zai-org/GLM-4.6V-Flash; quantization sizes read Oct 17, 8:52 AM ET); never checked upstream. |
| TRELLIS.2 4BMicrosoft · pipeline · 3d generation | Unavailable — TRELLIS.2 4B is a pipeline of several component models, not one network, so it has no single total parameters figure. Its size is the memory its maintainers publish for the whole pipeline. (missing: not applicable to a pipeline) | not quantized as one file | 24.0 GB (observed: the maintainers’ published minimum) | 82 of 89 (derived) | SIZEABLE | Unavailable — TRELLIS.2 4B: A pipeline model is sized by the memory and backends its maintainers publish, recorded in the seed file; nothing about it is read from Hugging Face, so it has no read date and no upstream check. (missing: not applicable to a pipeline) |
| InternVL3.5 30B-A3BShanghai AI Lab (OpenGVLab) · MoE · vision · 40K ctx max | 30.5 (derived)3.1 (derived) | IQ4_NL17.4 GB (observed) | 22.0 GB (estimate) | 82 of 89 (derived) | SIZEABLE | read — InternVL3.5 30B-A3B: the least recent read of its data from source (shape counted Oct 17, 8:33 AM ET from the tensor headers of https://huggingface.co/OpenGVLab/InternVL3_5-30B-A3B; quantization sizes read Oct 17, 8:33 AM ET); never checked upstream. |
| Qwen3-VL 30B-A3B InstructAlibaba Qwen · MoE · vision · 256K ctx max | 30.5 (derived)3.0 (derived) | IQ4_NL17.3 GB (observed) | 21.9 GB (estimate) | 82 of 89 (derived) | SIZEABLE | read — Qwen3-VL 30B-A3B Instruct: the least recent read of its data from source (shape counted Oct 17, 8:06 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3-VL-30B-A3B-Instruct; quantization sizes read Oct 17, 8:06 AM ET); never checked upstream. |
| Ministral 3 14B Instruct (2512)Mistral AI · dense · vision · 256K ctx max | 13.5 (derived)12.8 (derived) | IQ4_XS7.43 GB (observed) | 13.4 GB (estimate) | 82 of 89 (derived) | SIZEABLE | read — Ministral 3 14B Instruct (2512): the least recent read of its data from source (shape counted Oct 17, 9:05 AM ET from the tensor headers of https://huggingface.co/mistralai/Ministral-3-14B-Instruct-2512; quantization sizes read Oct 17, 9:05 AM ET); never checked upstream. |
| Qwen3-VL 8B InstructAlibaba Qwen · dense · vision · 256K ctx max | 8.2 (derived)7.6 (derived) | IQ4_XS4.58 GB (observed) | 9.78 GB (estimate) | 82 of 89 (derived) | SIZEABLE | read — Qwen3-VL 8B Instruct: the least recent read of its data from source (shape counted Oct 17, 7:59 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3-VL-8B-Instruct; quantization sizes read Oct 17, 7:59 AM ET); never checked upstream. |
| InternVL3.5 8BShanghai AI Lab (OpenGVLab) · dense · vision · 40K ctx max | 8.2 (derived)7.6 (derived) | IQ4_XS4.56 GB (observed) | 9.76 GB (estimate) | 82 of 89 (derived) | SIZEABLE | read — InternVL3.5 8B: the least recent read of its data from source (shape counted Oct 17, 8:32 AM ET from the tensor headers of https://huggingface.co/OpenGVLab/InternVL3_5-8B; quantization sizes read Oct 17, 8:32 AM ET); never checked upstream. |
| gpt-oss-120bOpenAI · MoE · reasoning · 128K ctx max | 116.8 (derived)5.1 (derived) | BF1665.4 GB (observed) | 71.8 GB (estimate) | 74 of 89 (derived) | SIZEABLE | read — gpt-oss-120b: the least recent read of its data from source (shape counted Oct 17, 6:32 AM ET from the tensor headers of https://huggingface.co/openai/gpt-oss-120b; quantization sizes read Oct 17, 6:32 AM ET); never checked upstream. |
| Mistral Small 4 119B (2603)Mistral AI · MoE · vision, reasoning · 1M ctx max | 119.0 (derived)6.1 (derived) | IQ4_NL67.5 GB (observed) | 73.6 GB (estimate) | 70 of 89 (derived) | SIZEABLE | read — Mistral Small 4 119B (2603): the least recent read of its data from source (shape counted Oct 17, 9:07 AM ET from the tensor headers of https://huggingface.co/mistralai/Mistral-Small-4-119B-2603; quantization sizes read Oct 17, 9:07 AM ET); never checked upstream. |
| Muse Glimmer 30BMeta (meta-models) · dense · vision, coding, reasoning · 128K ctx max | 27.9 (derived)26.6 (derived) | UD-Q4_K_XL15.9 GB (observed) | 17.7 GB (estimate) | 61 of 89 (derived) | SIZEABLE | read — Muse Glimmer 30B: the least recent read of its data from source (shape counted Oct 17, 9:03 AM ET from the tensor headers of https://huggingface.co/meta-models/Muse-Glimmer-30B; quantization sizes read Oct 17, 9:03 AM ET); never checked upstream. |
| gemma-4-31B-itGoogle DeepMind · dense · vision, reasoning, coding · 256K ctx max | 30.7 (derived)29.3 (derived) | IQ4_NL17.3 GB (observed) | 20.9 GB (estimate) | 57 of 89 (derived) | SIZEABLE | read — gemma-4-31B-it: the least recent read of its data from source (shape counted Oct 17, 7:27 AM ET from the tensor headers of https://huggingface.co/google/gemma-4-31B-it; quantization sizes read Oct 17, 7:27 AM ET); never checked upstream. |
| Devstral-Small-2-24B-Instruct-2512Mistral AI · dense · coding · 384K ctx max | 23.6 (derived)22.9 (derived) | IQ4_NL13.5 GB (observed) | 19.9 GB (estimate) | 57 of 89 (derived) | SIZEABLE | read — Devstral-Small-2-24B-Instruct-2512: the least recent read of its data from source (shape counted Oct 17, 7:24 AM ET from the tensor headers of https://huggingface.co/mistralai/Devstral-Small-2-24B-Instruct-2512; quantization sizes read Oct 17, 7:24 AM ET); never checked upstream. |
| Qwen3.6-27BAlibaba Qwen · dense · coding, reasoning, vision · 256K ctx max | 26.9 (derived)25.6 (derived) | IQ4_XS15.4 GB (observed) | 18.8 GB (estimate) | 57 of 89 (derived) | SIZEABLE | read — Qwen3.6-27B: the least recent read of its data from source (shape counted Oct 18, 3:30 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3.6-27B; quantization sizes read Oct 18, 3:30 AM ET); no upstream check after it. |
| Qwen3.8-27BAlibaba Qwen · dense · coding, reasoning, vision · 256K ctx max | 26.9 (derived)25.6 (derived) | UD-Q4_K_S15.4 GB (observed) | 18.7 GB (estimate) | 57 of 89 (derived) | SIZEABLE | read — Qwen3.8-27B: the least recent read of its data from source (shape counted Oct 18, 3:31 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3.8-27B; quantization sizes read Oct 18, 3:31 AM ET); no upstream check after it. |
| SPAR3D (Stable Point-Aware 3D)Stability AI · pipeline · 3d generation | Unavailable — SPAR3D (Stable Point-Aware 3D) is a pipeline of several component models, not one network, so it has no single total parameters figure. Its size is the memory its maintainers publish for the whole pipeline. (missing: not applicable to a pipeline) | not quantized as one file | 10.5 GB (observed: the maintainers’ published minimum) | 53 of 89 (derived) | SIZEABLE | Unavailable — SPAR3D (Stable Point-Aware 3D): A pipeline model is sized by the memory and backends its maintainers publish, recorded in the seed file; nothing about it is read from Hugging Face, so it has no read date and no upstream check. (missing: not applicable to a pipeline) |
| Stable Fast 3D (SF3D)Stability AI · pipeline · 3d generation | Unavailable — Stable Fast 3D (SF3D) is a pipeline of several component models, not one network, so it has no single total parameters figure. Its size is the memory its maintainers publish for the whole pipeline. (missing: not applicable to a pipeline) | not quantized as one file | 6.00 GB (observed: the maintainers’ published minimum) | 53 of 89 (derived) | SIZEABLE | Unavailable — Stable Fast 3D (SF3D): A pipeline model is sized by the memory and backends its maintainers publish, recorded in the seed file; nothing about it is read from Hugging Face, so it has no read date and no upstream check. (missing: not applicable to a pipeline) |
| In the saved Plan: Hunyuan3D 2.1 (shape + PBR paint)Tencent Hunyuan · pipeline · 3d generation | Unavailable — Hunyuan3D 2.1 (shape + PBR paint) is a pipeline of several component models, not one network, so it has no single total parameters figure. Its size is the memory its maintainers publish for the whole pipeline. (missing: not applicable to a pipeline) | not quantized as one file | 29.0 GB (observed: the maintainers’ published minimum) | 48 of 89 (derived) | SIZEABLE | Unavailable — Hunyuan3D 2.1 (shape + PBR paint): A pipeline model is sized by the memory and backends its maintainers publish, recorded in the seed file; nothing about it is read from Hugging Face, so it has no read date and no upstream check. (missing: not applicable to a pipeline) |
| In the saved Plan: Qwen3-VL 32B InstructAlibaba Qwen · dense · vision · 256K ctx max | 32.8 (derived)32.0 (derived) | IQ4_NL18.7 GB (observed) | 28.8 GB (estimate) | 48 of 89 (derived) | SIZEABLE | read — Qwen3-VL 32B Instruct: the least recent read of its data from source (shape counted Oct 17, 8:02 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3-VL-32B-Instruct; quantization sizes read Oct 17, 8:02 AM ET); never checked upstream. |
| InternVL3.5 38BShanghai AI Lab (OpenGVLab) · dense · vision · 40K ctx max | 32.9 (derived)32.1 (derived) | IQ4_NL18.7 GB (observed) | 28.8 GB (estimate) | 48 of 89 (derived) | SIZEABLE | read — InternVL3.5 38B: the least recent read of its data from source (shape counted Oct 17, 8:37 AM ET from the tensor headers of https://huggingface.co/OpenGVLab/InternVL3_5-38B; quantization sizes read Oct 17, 8:37 AM ET); never checked upstream. |
| Step1X-3DStepFun · pipeline · 3d generation | Unavailable — Step1X-3D is a pipeline of several component models, not one network, so it has no single total parameters figure. Its size is the memory its maintainers publish for the whole pipeline. (missing: not applicable to a pipeline) | not quantized as one file | 27.0 GB (observed: the maintainers’ published minimum) | 35 of 89 (derived) | SIZEABLE | Unavailable — Step1X-3D: A pipeline model is sized by the memory and backends its maintainers publish, recorded in the seed file; nothing about it is read from Hugging Face, so it has no read date and no upstream check. (missing: not applicable to a pipeline) |
| TripoSGVAST AI Research · pipeline · 3d generation | Unavailable — TripoSG is a pipeline of several component models, not one network, so it has no single total parameters figure. Its size is the memory its maintainers publish for the whole pipeline. (missing: not applicable to a pipeline) | not quantized as one file | 8.00 GB (observed: the maintainers’ published minimum) | 35 of 89 (derived) | SIZEABLE | Unavailable — TripoSG: A pipeline model is sized by the memory and backends its maintainers publish, recorded in the seed file; nothing about it is read from Hugging Face, so it has no read date and no upstream check. (missing: not applicable to a pipeline) |
| GLM-4.6VZ.ai · MoE · vision · 128K ctx max | 106.9 (derived)12.8 (derived) | IQ4_NL60.6 GB (observed) | 71.6 GB (estimate) | 28 of 89 (derived) | SIZEABLE | read — GLM-4.6V: the least recent read of its data from source (shape counted Oct 17, 8:42 AM ET from the tensor headers of https://huggingface.co/zai-org/GLM-4.6V; quantization sizes read Oct 17, 8:42 AM ET); never checked upstream. |
| GLM-5.3-Flash — shown in full belowZ.ai (zai-org) · MoE · coding, vision · 1M ctx max | 313.3 (derived)16.7 (derived) | UD-IQ4_XS157 GB (observed) | 170 GB (estimate) | 22 of 89 (derived) | SIZEABLE | read — GLM-5.3-Flash: the least recent read of its data from source (shape counted Oct 18, 3:27 AM ET from the tensor headers of https://huggingface.co/zai-org/GLM-5.3-Flash; quantization sizes read Oct 18, 3:27 AM ET); no upstream check after it. |
| DeepSeek-V4-Flash-0731DeepSeek · MoE · reasoning, coding · 1M ctx max | 284.3 (derived)13.3 (derived) | UD-Q8_K_XL162 GB (observed) | 176 GB (estimate) | 18 of 89 (derived) | SIZEABLE | read — DeepSeek-V4-Flash-0731: the least recent read of its data from source (shape counted Oct 17, 5:35 AM ET from the tensor headers of https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731; quantization sizes read Oct 17, 5:35 AM ET); never checked upstream. |
| In the saved Plan: Qwen3-ASR 1.7BAlibaba Qwen · dense · speech to text | 2.0 (derived)1.7 (derived) | 6bit2.03 GB (observed) | 5.95 GB (estimate) | 18 of 89 (derived) | SIZEABLE | read — Qwen3-ASR 1.7B: the least recent read of its data from source (shape counted Oct 17, 7:50 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3-ASR-1.7B; quantization sizes read Oct 17, 7:50 AM ET); never checked upstream. |
| Unlimited-OCRBaidu · MoE · vision · 32K ctx max | 3.0 (derived)0.7 (derived) | 4bit2.45 GB (observed) | 4.66 GB (estimate) | 18 of 89 (derived) | SIZEABLE | read — Unlimited-OCR: the least recent read of its data from source (shape counted Oct 17, 9:09 AM ET from the tensor headers of https://huggingface.co/baidu/Unlimited-OCR; quantization sizes read Oct 17, 9:09 AM ET); never checked upstream. |
| Qwen3-VL 235B-A22B InstructAlibaba Qwen · MoE · vision · 256K ctx max | 235.1 (derived)21.6 (derived) | IQ4_NL133 GB (observed) | 150 GB (estimate) | 14 of 89 (derived) | SIZEABLE | read — Qwen3-VL 235B-A22B Instruct: the least recent read of its data from source (shape counted Oct 17, 8:11 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3-VL-235B-A22B-Instruct; quantization sizes read Oct 17, 8:11 AM ET); never checked upstream. |
| Qwen3.8-Flash-NextAlibaba Qwen · MoE · coding, vision · 256K ctx max | 176.9 (derived)57.9 (derived) | IQ4_NL100 GB (observed) | 109 GB (estimate) | 14 of 89 (derived) | SIZEABLE | read — Qwen3.8-Flash-Next: the least recent read of its data from source (shape counted Oct 18, 3:33 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3.8-Flash-Next; quantization sizes read Oct 18, 3:33 AM ET); no upstream check after it. |
| Mistral-Medium-3.5-128BMistral AI · dense · coding, reasoning, vision · 256K ctx max | 125.0 (derived)123.4 (derived) | IQ4_NL70.9 GB (observed) | 88.4 GB (estimate) | 11 of 89 (derived) | SIZEABLE | read — Mistral-Medium-3.5-128B: the least recent read of its data from source (shape counted Oct 17, 7:23 AM ET from the tensor headers of https://huggingface.co/mistralai/Mistral-Medium-3.5-128B; quantization sizes read Oct 17, 7:23 AM ET); never checked upstream. |
| Qwen3-Coder-NextAlibaba Qwen · MoE · coding · 256K ctx max | 79.7 (derived)3.6 (derived) | native44.8 GB (observed) | 49.2 GB (estimate) | 8 of 89 (derived) | SIZEABLE | read — Qwen3-Coder-Next: the least recent read of its data from source (shape counted Oct 17, 5:10 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3-Coder-Next; quantization sizes read Oct 17, 5:10 AM ET); never checked upstream. |
| NVIDIA-Nemotron-3-Super-120B-A12BNVIDIA · MoE · reasoning · 256K ctx max | 120.7 (derived)12.2 (derived) | 4bit68.0 GB (observed) | 73.7 GB (estimate) | 4 of 89 (derived) | SIZEABLE | read — NVIDIA-Nemotron-3-Super-120B-A12B: the least recent read of its data from source (shape counted Oct 17, 7:30 AM ET from the tensor headers of https://huggingface.co/nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16; quantization sizes read Oct 17, 7:30 AM ET); never checked upstream. |
| MiniMax-M2.7MiniMax · MoE · coding · 200K ctx max | 228.7 (derived)10.4 (derived) | 4bit129 GB (observed) | 147 GB (estimate) | 3 of 89 (derived) | SIZEABLE | read — MiniMax-M2.7: the least recent read of its data from source (shape counted Oct 17, 6:53 AM ET from the tensor headers of https://huggingface.co/MiniMaxAI/MiniMax-M2.7; quantization sizes read Oct 17, 6:53 AM ET); never checked upstream. |
| Kimi-K2.7-CodeMoonshot AI · MoE · coding · 256K ctx max | 1,026.4 (derived)31.7 (derived) | UD-Q4_K_XL584 GB (observed) | 633 GB (estimate) | 1 of 89 (derived) | SIZEABLE | read — Kimi-K2.7-Code: the least recent read of its data from source (shape counted Oct 17, 6:18 AM ET from the tensor headers of https://huggingface.co/moonshotai/Kimi-K2.7-Code; quantization sizes read Oct 17, 6:18 AM ET); never checked upstream. |
| MiniMax-M3MiniMax · MoE · coding, vision · 1M ctx max | 426.4 (derived)24.9 (derived) | 4bit241 GB (observed) | 265 GB (estimate) | 1 of 89 (derived) | SIZEABLE | read — MiniMax-M3: the least recent read of its data from source (shape counted Oct 17, 6:40 AM ET from the tensor headers of https://huggingface.co/MiniMaxAI/MiniMax-M3; quantization sizes read Oct 17, 6:40 AM ET); never checked upstream. |
| Kimi K3Moonshot AI · MoE · reasoning, coding, vision · 1M ctx max | 2,779.5 (derived)207.5 (derived) | UD-Q8_K_XL1,561 GB (observed) | 1,687 GB (estimate) | none: 0 of 89 (derived) | SIZEABLE | read — Kimi K3: the least recent read of its data from source (shape counted Oct 17, 5:57 AM ET from the tensor headers of https://huggingface.co/moonshotai/Kimi-K3; quantization sizes read Oct 17, 5:57 AM ET); never checked upstream. |
| Qwen3.8-2.4T-A95B (open Qwen3.8-Max)Alibaba Qwen · MoE · reasoning, coding · 256K ctx max | 2,419.8 (derived)93.3 (derived) | UD-IQ4_XS1,311 GB (observed) | 1,419 GB (estimate) | none: 0 of 89 (derived) | SIZEABLE | read — Qwen3.8-2.4T-A95B (open Qwen3.8-Max): the least recent read of its data from source (shape counted Oct 18, 3:40 AM ET from the tensor headers of https://huggingface.co/Qwen/Qwen3.8-2.4T-A95B; quantization sizes read Oct 18, 3:40 AM ET); no upstream check after it. |
| In the saved Plan: DeepSeek-V4-Pro-0813DeepSeek · MoE · reasoning, coding · 1M ctx max | 1,573.0 (derived)48.9 (derived) | native893 GB (observed) | 966 GB (estimate) | none: 0 of 89 (derived) | SIZEABLE | read — DeepSeek-V4-Pro-0813: the least recent read of its data from source (shape counted Oct 17, 5:20 AM ET from the tensor headers of https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro-0813; quantization sizes read Oct 17, 5:20 AM ET); never checked upstream. |
| In the saved Plan: GLM-5.3Z.ai (zai-org) · MoE · coding, reasoning · 1M ctx max | 743.4 (derived)40.3 (derived) | UD-Q4_K_XL467 GB (observed) | 508 GB (estimate) | none: 0 of 89 (derived) | SIZEABLE | read — GLM-5.3: the least recent read of its data from source (shape counted Oct 18, 3:21 AM ET from the tensor headers of https://huggingface.co/zai-org/GLM-5.3; quantization sizes read Oct 18, 3:21 AM ET); no upstream check after it. |
| Step-3.7-FlashStepFun · MoE · vision · 256K ctx max | 197.0 (derived)196.5 (derived) | 4bit111 GB (observed) | 121 GB (estimate) | none: 0 of 89 (derived) | SIZEABLE | read — Step-3.7-Flash: the least recent read of its data from source (shape counted Oct 17, 7:43 AM ET from the tensor headers of https://huggingface.co/stepfun-ai/Step-3.7-Flash; quantization sizes read Oct 17, 7:43 AM ET); never checked upstream. |
| Canary-Qwen 2.5BNVIDIA · dense · speech to text | 2.6 (derived)2.2 (derived) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. Nothing can be said about which machines run it until it can be sized. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | ONBOARDING — No quantization has been sized for this model, so the weights have no measured size to work from. Missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes. | read — Canary-Qwen 2.5B: the least recent read of its data from source (shape counted Oct 17, 7:52 AM ET from the tensor headers of https://huggingface.co/nvidia/canary-qwen-2.5b; no quantization size stored); never checked upstream. |
| Chandra OCR 2Datalab · dense · vision · 256K ctx max | 4.8 (derived)4.2 (derived) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. Nothing can be said about which machines run it until it can be sized. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | ONBOARDING — No quantization has been sized for this model, so the weights have no measured size to work from. Missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes. | read — Chandra OCR 2: the least recent read of its data from source (shape counted Oct 17, 9:12 AM ET from the tensor headers of https://huggingface.co/datalab-to/chandra-ocr-2; no quantization size stored); never checked upstream. |
| DeepSeek-OCR 2DeepSeek · MoE · vision · 8K ctx max | 3.2 (derived)0.8 (derived) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. Nothing can be said about which machines run it until it can be sized. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | ONBOARDING — No quantization has been sized for this model, so the weights have no measured size to work from. Missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes. | read — DeepSeek-OCR 2: the least recent read of its data from source (shape counted Oct 17, 9:09 AM ET from the tensor headers of https://huggingface.co/deepseek-ai/DeepSeek-OCR-2; no quantization size stored); never checked upstream. |
| DeepSeek-V4.1-FlashDeepSeek · MoE · reasoning, coding, vision · 1M ctx max | 477.2 (derived)12.4 (derived) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, Plan asks for quant "4bit" but no sized quantization of DeepSeek-V4.1-Flash has that name, quantization file sizes) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. Nothing can be said about which machines run it until it can be sized. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, Plan asks for quant "4bit" but no sized quantization of DeepSeek-V4.1-Flash has that name, quantization file sizes) | ONBOARDING — No quantization has been sized for this model, so the weights have no measured size to work from. Missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, Plan asks for quant "4bit" but no sized quantization of DeepSeek-V4.1-Flash has that name, quantization file sizes. | read — DeepSeek-V4.1-Flash: the least recent read of its data from source (shape counted Oct 17, 5:46 AM ET from the tensor headers of https://huggingface.co/deepseek-ai/DeepSeek-V4.1-Flash; no quantization size stored); never checked upstream. |
| Distil-Whisper distil-large-v3.5Hugging Face (distil-whisper) · dense · speech to text | 0.8 (derived)0.7 (derived) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. Nothing can be said about which machines run it until it can be sized. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | ONBOARDING — No quantization has been sized for this model, so the weights have no measured size to work from. Missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes. | read — Distil-Whisper distil-large-v3.5: the least recent read of its data from source (shape counted Oct 17, 7:55 AM ET from the tensor headers of https://huggingface.co/distil-whisper/distil-large-v3.5; no quantization size stored); never checked upstream. |
| dots.ocrrednote (dots-studio) · dense · vision · 128K ctx max | 1.8 (derived)1.5 (derived) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. Nothing can be said about which machines run it until it can be sized. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | ONBOARDING — No quantization has been sized for this model, so the weights have no measured size to work from. Missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes. | read — dots.ocr: the least recent read of its data from source (shape counted Oct 17, 9:11 AM ET from the tensor headers of https://huggingface.co/dots-studio/dots.ocr; no quantization size stored); never checked upstream. |
| Gemma 4 26B-A4B ITGoogle · MoE · vision, reasoning · 256K ctx max | Unavailable — The total parameters of Gemma 4 26B-A4B IT has not been read from its checkpoint yet, so nothing that depends on it can be computed. (missing: total_parameters) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — The model's shape has not been onboarded, so its weights and KV cache cannot be computed. (missing: model shape (tensor inventory and config formula both failed), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_XXS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q2_K (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q2_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_XXS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_XL (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ4_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ4_NL (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_0 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_1 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q6_K (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q6_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:Q4_0 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q4_K_M (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q6_K (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-4bit:4bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-5bit:5bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-6bit:6bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-8bit:8bit (model shape unknown), bits per weight for mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit:4bit (model shape unknown), bits per weight for mlx-community/gemma-4-26B-A4B-it-heretic-msq-2.6bit:2.6bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-4bit:4bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-6bit:6bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-8bit:8bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-mxfp8:mxfp8 (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-nvfp4:native (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:F16 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ2_XXS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ2_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q2_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ3_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ3_XXS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q3_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q3_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ4_XS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ4_NL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:MXFP4_MOE (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q8_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-NVFP4:native (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-MLX-8bit:8bit (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-UD-MLX-3bit:3bit (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit:4bit (model shape unknown), total_params_b, active_params_b, num_layers, attention_params) | Unavailable — The model's shape has not been onboarded, so its weights and KV cache cannot be computed. Nothing can be said about which machines run it until it can be sized. (missing: model shape (tensor inventory and config formula both failed), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_XXS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q2_K (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q2_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_XXS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_XL (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ4_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ4_NL (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_0 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_1 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q6_K (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q6_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:Q4_0 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q4_K_M (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q6_K (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-4bit:4bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-5bit:5bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-6bit:6bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-8bit:8bit (model shape unknown), bits per weight for mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit:4bit (model shape unknown), bits per weight for mlx-community/gemma-4-26B-A4B-it-heretic-msq-2.6bit:2.6bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-4bit:4bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-6bit:6bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-8bit:8bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-mxfp8:mxfp8 (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-nvfp4:native (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:F16 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ2_XXS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ2_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q2_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ3_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ3_XXS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q3_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q3_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ4_XS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ4_NL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:MXFP4_MOE (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q8_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-NVFP4:native (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-MLX-8bit:8bit (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-UD-MLX-3bit:3bit (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit:4bit (model shape unknown), total_params_b, active_params_b, num_layers, attention_params) | ONBOARDING — The model's shape has not been onboarded, so its weights and KV cache cannot be computed. Missing: model shape (tensor inventory and config formula both failed), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_XXS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q2_K (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q2_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_XXS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_XL (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ4_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ4_NL (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_0 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_1 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q6_K (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q6_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:Q4_0 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q4_K_M (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q6_K (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-4bit:4bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-5bit:5bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-6bit:6bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-8bit:8bit (model shape unknown), bits per weight for mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit:4bit (model shape unknown), bits per weight for mlx-community/gemma-4-26B-A4B-it-heretic-msq-2.6bit:2.6bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-4bit:4bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-6bit:6bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-8bit:8bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-mxfp8:mxfp8 (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-nvfp4:native (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:F16 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ2_XXS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ2_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q2_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ3_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ3_XXS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q3_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q3_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ4_XS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ4_NL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:MXFP4_MOE (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q8_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-NVFP4:native (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-MLX-8bit:8bit (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-UD-MLX-3bit:3bit (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit:4bit (model shape unknown), total_params_b, active_params_b, num_layers, attention_params. | Unavailable — Gemma 4 26B-A4B IT: No shape count (spec_sources.total_params_b) of google/gemma-4-26B-A4B-it and no stored quantization size (a model_quantizations row with a repository and a read time) is on record, so how current this model's data is cannot be dated. Other fields — licence, maximum context — may still have been read from its config, and a quantization listing may have been read without yielding a size; the onboarding state says what is owed. (missing: spec_sources.total_params_b, model_quantizations.verified_at) |
| Granite Speech 4.1 2BIBM · dense · speech to text · 4K ctx max | 2.3 (derived)2.1 (derived) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. Nothing can be said about which machines run it until it can be sized. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | ONBOARDING — No quantization has been sized for this model, so the weights have no measured size to work from. Missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes. | read — Granite Speech 4.1 2B: the least recent read of its data from source (shape counted Oct 17, 7:52 AM ET from the tensor headers of https://huggingface.co/ibm-granite/granite-speech-4.1-2b; no quantization size stored); never checked upstream. |
| PaddleOCR-VL (0.9B)Baidu PaddlePaddle · dense · vision · 128K ctx max | 0.5 (derived)0.4 (derived) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. Nothing can be said about which machines run it until it can be sized. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | ONBOARDING — No quantization has been sized for this model, so the weights have no measured size to work from. Missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes. | read — PaddleOCR-VL (0.9B): the least recent read of its data from source (shape counted Oct 17, 9:11 AM ET from the tensor headers of https://huggingface.co/PaddlePaddle/PaddleOCR-VL; no quantization size stored); never checked upstream. |
| Parakeet TDT 0.6B v3NVIDIA · dense · speech to text | 0.6 (derived) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, Plan asks for quant "Q8_0" but no sized quantization of Parakeet TDT 0.6B v3 has that name, quantization file sizes) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. Nothing can be said about which machines run it until it can be sized. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, Plan asks for quant "Q8_0" but no sized quantization of Parakeet TDT 0.6B v3 has that name, quantization file sizes) | ONBOARDING — No quantization has been sized for this model, so the weights have no measured size to work from. Missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, Plan asks for quant "Q8_0" but no sized quantization of Parakeet TDT 0.6B v3 has that name, quantization file sizes. | read — Parakeet TDT 0.6B v3: the least recent read of its data from source (shape counted Oct 17, 7:51 AM ET from the tensor headers of https://huggingface.co/nvidia/parakeet-tdt-0.6b-v3; no quantization size stored); never checked upstream. |
| Whisper large-v3OpenAI · dense · speech to text | 1.5 (derived)1.5 (derived) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. Nothing can be said about which machines run it until it can be sized. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | ONBOARDING — No quantization has been sized for this model, so the weights have no measured size to work from. Missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes. | read — Whisper large-v3: the least recent read of its data from source (shape counted Oct 17, 7:54 AM ET from the tensor headers of https://huggingface.co/openai/whisper-large-v3; no quantization size stored); never checked upstream. |
| Whisper large-v3-turboOpenAI · dense · speech to text | 0.8 (derived)0.7 (derived) | Unavailable — No quantization of this model is in the catalog yet, so there is nothing to size its weights from. (missing: model_quantizations) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | Unavailable — No quantization has been sized for this model, so the weights have no measured size to work from. Nothing can be said about which machines run it until it can be sized. (missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes) | ONBOARDING — No quantization has been sized for this model, so the weights have no measured size to work from. Missing: no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes. | read — Whisper large-v3-turbo: the least recent read of its data from source (shape counted Oct 17, 7:54 AM ET from the tensor headers of https://huggingface.co/openai/whisper-large-v3-turbo; no quantization size stored); never checked upstream. |
The machine search reported: 1333 platform combinations were collapsed. For each socket and memory size the search carries the CHEAPEST build and, when it is a different part, the one with the most CPU compute (which is what prefill depends on); the rest differ only in price. 8 CPU+GPU hybrid candidates were the same parts as a GPU rig already in the list and are listed once. Memory = weights + KV cache at 32K + runtime overhead (SPEC §8.1); the weights come from the measured file size when Hugging Face has been read, and from bits-per-weight when it has not — each figure says which, inside it. “Machines” counts the catalog rigs that run the model at ≥ 15 tok/s; the denominator is every machine the search could build. A model with no shape contributes nothing to either column and says so rather than showing a zero.
What onboarding still owes
llm_models — 12 of 60 cannot be sized yet
Why it matters: A model without a shape or a measured quantization contributes no memory figure, so it cannot be placed on a machine, cannot enter a Plan's total, and cannot be compared with one that can. Every count on this screen excludes these 12 and says so.
How it gets filled: npm run worker -- onboard It reads each model's config and its repository file listing from Hugging Face and records the real sizes.
| Still owed | Models | Which ones |
|---|---|---|
| no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes | 9 | name all 9Canary-Qwen 2.5B, Chandra OCR 2, DeepSeek-OCR 2, Distil-Whisper distil-large-v3.5, dots.ocr, Granite Speech 4.1 2B, PaddleOCR-VL (0.9B), Whisper large-v3, Whisper large-v3-turbo |
| active_params_b, attention_params, bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ2_XXS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ3_XXS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ4_NL (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:IQ4_XS (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q2_K (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q2_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q3_K_XL (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_0 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_1 (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q4_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_M (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q5_K_S (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q6_K (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q6_K_L (model shape unknown), bits per weight for bartowski/google_gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:Q4_0 (model shape unknown), bits per weight for ggml-org/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q4_K_M (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q6_K (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-4bit:4bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-5bit:5bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-6bit:6bit (model shape unknown), bits per weight for lmstudio-community/gemma-4-26B-A4B-it-MLX-8bit:8bit (model shape unknown), bits per weight for mlx-community/gemma-4-26B-A4B-it-OptiQ-4bit:4bit (model shape unknown), bits per weight for mlx-community/gemma-4-26B-A4B-it-heretic-msq-2.6bit:2.6bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-4bit:4bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-6bit:6bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-8bit:8bit (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-mxfp8:mxfp8 (model shape unknown), bits per weight for mlx-community/gemma-4-26b-a4b-it-nvfp4:native (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:BF16 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:F16 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:MXFP4_MOE (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:Q8_0 (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ2_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ2_XXS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ3_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ3_XXS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ4_NL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-IQ4_XS (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q2_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q3_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q3_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q4_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_M (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_S (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q5_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q6_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-GGUF:UD-Q8_K_XL (model shape unknown), bits per weight for unsloth/gemma-4-26B-A4B-it-NVFP4:native (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-MLX-8bit:8bit (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-UD-MLX-3bit:3bit (model shape unknown), bits per weight for unsloth/gemma-4-26b-a4b-it-UD-MLX-4bit:4bit (model shape unknown), model shape (tensor inventory and config formula both failed), num_layers, total_params_b | 1 | name the modelGemma 4 26B-A4B IT |
| Plan asks for quant "4bit" but no sized quantization of DeepSeek-V4.1-Flash has that name, no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes | 1 | name the modelDeepSeek-V4.1-Flash |
| Plan asks for quant "Q8_0" but no sized quantization of Parakeet TDT 0.6B v3 has that name, no quantized repos listed (GGUF/MLX) — only the native checkpoint can be sized, quantization file sizes | 1 | name the modelParakeet TDT 0.6B v3 |
GLM-5.3-Flash
What it needs, on any machine
- Weights
157 GB (observed)
- KV cache
0.37 GB (derived)
- Overhead
12.5 GB (estimate)
- Total
170 GB (estimate)
The weights figure is the measured UD-IQ4_XS download, not a bits-per-weight estimate. This requirement is a property of the model and the context — it is the same on every machine.
Where this model’s facts come from
- Repository
- zai-org/GLM-5.3-Flash
- Licence
- mit (permissive)
- Released
- 2026-08-25
- Maximum context
- tokens
1,048,576 (observed)
- Shape counted
- Oct 18, 3:27 AM ET (41 h ago) from the tensor headers of https://huggingface.co/zai-org/GLM-5.3-Flash — kept, not re-counted, while the repository has no new commit, and re-counted at least every 14 days
- Quantization sizes read
- Oct 18, 3:27 AM ET (41 h ago) — the listings behind all 14 of its quantization rows, re-read with every refresh
- Checked upstream
- Oct 18, 3:27 AM ET (41 h ago) — the nightly models stage asked Hugging Face whether any of its repositories changed since their stored reads
- Current as of
- — the least recent read from source, the newer of the two; stale past the 36 h freshness window in Settings
- Row last written
- Oct 18, 3:27 AM ET (41 h ago) — llm_models.verified_at, moved by every seed load and every refresh — not a read from source, and it dates none of the figures above
- Onboarding
- complete · via seed
Quantizations, with the size measured on Hugging Face
| Quantization | Bits/weight | File size GB | Quality Δ | Source |
|---|---|---|---|---|
| UD-IQ1_Sgguf · unsloth/GLM-5.3-Flash-GGUF | 2.38 (observed) | 93.09 (observed) | Unavailable — No published quality measurement for UD-IQ1_S, so the accuracy cost of choosing this quantization over the full-precision checkpoint is not known. (missing: quality_delta_pct) | 3 filesverified Oct 18, 3:27 AM ET |
| UD-IQ1_Mgguf · unsloth/GLM-5.3-Flash-GGUF | 2.49 (observed) | 97.58 (observed) | Unavailable — No published quality measurement for UD-IQ1_M, so the accuracy cost of choosing this quantization over the full-precision checkpoint is not known. (missing: quality_delta_pct) | 3 filesverified Oct 18, 3:27 AM ET |
| UD-IQ2_XXSgguf · unsloth/GLM-5.3-Flash-GGUF | 2.60 (observed) | 101.84 (observed) | Unavailable — No published quality measurement for UD-IQ2_XXS, so the accuracy cost of choosing this quantization over the full-precision checkpoint is not known. (missing: quality_delta_pct) | 4 filesverified Oct 18, 3:27 AM ET |
| UD-Q2_K_XLgguf · unsloth/GLM-5.3-Flash-GGUF | 2.78 (observed) | 108.72 (observed) | Unavailable — No published quality measurement for UD-Q2_K_XL, so the accuracy cost of choosing this quantization over the full-precision checkpoint is not known. (missing: quality_delta_pct) | 4 filesverified Oct 18, 3:27 AM ET |
| UD-IQ3_XXSgguf · unsloth/GLM-5.3-Flash-GGUF | 3.07 (observed) | 120.37 (observed) | Unavailable — No published quality measurement for UD-IQ3_XXS, so the accuracy cost of choosing this quantization over the full-precision checkpoint is not known. (missing: quality_delta_pct) | 4 filesverified Oct 18, 3:27 AM ET |
| UD-Q3_K_XLgguf · unsloth/GLM-5.3-Flash-GGUF | 3.77 (observed) | 147.54 (observed) | Unavailable — No published quality measurement for UD-Q3_K_XL, so the accuracy cost of choosing this quantization over the full-precision checkpoint is not known. (missing: quality_delta_pct) | 4 filesverified Oct 18, 3:27 AM ET |
| Currently selected: UD-IQ4_XSgguf · unsloth/GLM-5.3-Flash-GGUF | 4.00 (observed) | 156.82 (observed) | Unavailable — No published quality measurement for UD-IQ4_XS, so the accuracy cost of choosing this quantization over the full-precision checkpoint is not known. (missing: quality_delta_pct) | 5 filesverified Oct 18, 3:27 AM ET |
| UD-Q4_K_XLgguf · unsloth/GLM-5.3-Flash-GGUF | 5.10 (observed) | 199.71 (observed) | Unavailable — No published quality measurement for UD-Q4_K_XL, so the accuracy cost of choosing this quantization over the full-precision checkpoint is not known. (missing: quality_delta_pct) | 6 filesverified Oct 18, 3:27 AM ET |
| 4bitmlx · mlx-community/GLM-5.3-Flash-4bit | 5.21 (observed) | 203.99 (observed) | Unavailable — No published quality measurement for 4bit, so the accuracy cost of choosing this quantization over the full-precision checkpoint is not known. (missing: quality_delta_pct) | 62 filesverified Oct 18, 3:27 AM ET |
| UD-Q5_K_XLgguf · unsloth/GLM-5.3-Flash-GGUF | 6.14 (observed) | 240.31 (observed) | Unavailable — No published quality measurement for UD-Q5_K_XL, so the accuracy cost of choosing this quantization over the full-precision checkpoint is not known. (missing: quality_delta_pct) | 6 filesverified Oct 18, 3:27 AM ET |
Showing the 10 quantizations nearest 4.00 bits per weight — the realistic alternatives to the one selected. 4 more are in the catalog, from 3 repositories and 3 formats — show all 14.
Machines in the catalog that run it
| Machine | Verdict | Decode | TTFT 32K | Observed price |
|---|---|---|---|---|
NVIDIA DGX Station GB300 (Grace Blackwell Ultra), 748GB691 GB (derived)7,100 (observed) | Fast | 241 tok/s (estimate) | 627 ms (estimate) | $100,000 (derived) |
2× RTX PRO 6000 Blackwell Max-Q Workstation Edition, 96GB · EPYC 9015 · 8× M321R4GA3BB6-CQK 32GB DDR5-4800 RDIMM429 GB (derived)1,792 (observed) | Fast | 85.1 tok/s (estimate) | Unavailable — No prefill measurement or compute rating for DIY: 2× NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition, 96GB + AMD EPYC 9015. (missing: measured prefill_tokens_sec, compute_tflops_fp16) | $27,923 (derived) |
3× RTX PRO 6000 Blackwell Max-Q Workstation Edition, 96GB · EPYC 9015 · 8× M321R4GA3BB6-CQK 32GB DDR5-4800 RDIMM523 GB (derived)1,792 (observed) | Fast | 85.1 tok/s (estimate) | Unavailable — No prefill measurement or compute rating for DIY: 3× NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition, 96GB + AMD EPYC 9015. (missing: measured prefill_tokens_sec, compute_tflops_fp16) | $39,853 (derived) |
Apple Mac Studio (2026), M5 Ultra 30-core CPU / 64-core GPU, 256GB192 GB (derived)1,200 (observed) | Fast | 55.9 tok/s (estimate) | Unavailable — No prefill measurement or compute rating for Apple Mac Studio (2026), M5 Ultra 30-core CPU / 64-core GPU, 256GB. (missing: measured prefill_tokens_sec, compute_tflops_fp16) | $9,499 (derived) |
Apple Mac Studio (2026), M5 Ultra 36-core CPU / 80-core GPU, 256GB192 GB (derived)1,200 (observed) | Fast | 55.9 tok/s (estimate) | 16.5 s (estimate) | $10,799 (derived) |
Apple Mac Studio (2026), M5 Ultra 36-core CPU / 80-core GPU, 512GB384 GB (derived)1,200 (observed) | Fast | 55.9 tok/s (estimate) | 16.5 s (estimate) | Unavailable — No monitored retailer has published a price for this machine: Apple Mac Studio (2026), M5 Ultra 36-core CPU / 80-core GPU, 512GB. (missing: Apple Mac Studio (2026), M5 Ultra 36-core CPU / 80-core GPU, 512GB) |
1× RTX PRO 6000 Blackwell Workstation Edition, 96GB · EPYC 9015 · 8× M321R4GA3BB6-CQK 32GB DDR5-4800 RDIMM336 GB (derived)1,792 (observed) | Interactive | 22.2 tok/s (estimate) | Unavailable — No prefill measurement or compute rating for DIY: NVIDIA RTX PRO 6000 Blackwell Workstation Edition, 96GB + AMD EPYC 9015. (missing: measured prefill_tokens_sec, compute_tflops_fp16) | $14,857 (derived) |
1× RTX PRO 6000 Blackwell Max-Q Workstation Edition, 96GB · EPYC 9015 · 8× M321R4GA3BB6-CQK 32GB DDR5-4800 RDIMM336 GB (derived)1,792 (observed) | Interactive | 22.2 tok/s (estimate) | Unavailable — No prefill measurement or compute rating for DIY: NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition, 96GB + AMD EPYC 9015. (missing: measured prefill_tokens_sec, compute_tflops_fp16) | $15,992 (derived) |
Hybrid · RTX PRO 6000 Blackwell Workstation Edition, 96GB + EPYC 9015 · 8× M321R8GA0BB0-CQK 64GB DDR5-4800 RDIMM580 GB (derived)1,792 (observed) | Interactive | 22.2 tok/s (estimate) | Unavailable — No prefill measurement or compute rating for DIY: NVIDIA RTX PRO 6000 Blackwell Workstation Edition, 96GB + AMD EPYC 9015. (missing: measured prefill_tokens_sec, compute_tflops_fp16) | $15,519 (derived) |
Hybrid · RTX PRO 6000 Blackwell Max-Q Workstation Edition, 96GB + EPYC 9015 · 8× M321R8GA0BB0-CQK 64GB DDR5-4800 RDIMM580 GB (derived)1,792 (observed) | Interactive | 22.2 tok/s (estimate) | Unavailable — No prefill measurement or compute rating for DIY: NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition, 96GB + AMD EPYC 9015. (missing: measured prefill_tokens_sec, compute_tflops_fp16) | $16,655 (derived) |
Hybrid · RTX PRO 6000 Blackwell Workstation Edition, 96GB + EPYC 9015 · 8× Server Premier KSM64R52BD4-96MC 96GB DDR5-6400 RDIMM823 GB (derived)1,792 (observed) | Interactive | 22.2 tok/s (estimate) | Unavailable — No prefill measurement or compute rating for DIY: NVIDIA RTX PRO 6000 Blackwell Workstation Edition, 96GB + AMD EPYC 9015. (missing: measured prefill_tokens_sec, compute_tflops_fp16) | $42,159 (derived) |
Hybrid · RTX PRO 6000 Blackwell Max-Q Workstation Edition, 96GB + EPYC 9015 · 8× Server Premier KSM64R52BD4-96MC 96GB DDR5-6400 RDIMM823 GB (derived)1,792 (observed) | Interactive | 22.2 tok/s (estimate) | Unavailable — No prefill measurement or compute rating for DIY: NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition, 96GB + AMD EPYC 9015. (missing: measured prefill_tokens_sec, compute_tflops_fp16) | $43,294 (derived) |
Listed: the 12 fastest of the 22 machines that clear ≥ 15 tok/s, the speed floor the saved Plan asks for. 32 more hold GLM-5.3-Flash but fall below that floor. show all 54 machines that hold it. 35 more machines in the catalog cannot hold this model at all and are not listed. Prices are the listed price of the machine, before shipping and sales tax — the landed cost, and the shipping that is missing from it, are on Compare.
Published results
| Benchmark | Score | What was measured, and how |
|---|---|---|
| Vals AI Finance Agent Benchmark v2 (FAB v2) | 57.85 (observed) | accuracy % (overall); hosted full-precision API run; reasoning effort max; rank 9/61; independent (Vals AI)source |
| Vals AI TaxEval v2 | 75.59 (observed) | accuracy % (overall); hosted full-precision API run; reasoning effort max; rank 16/145; independent (Vals AI)source |
| Artificial Analysis Finance & Accounting IndexPROXY | 41.98 (observed) | AA Finance & Accounting Index (0-100); hosted full-precision API run; rank 14/25; independent (Artificial Analysis)source |
| tau3-Banking (Artificial Analysis run) | 47.20 (observed) | tau3-Banking pass rate %; hosted full-precision API run; rank 11/29; independent (Artificial Analysis)source |
| GDPval-AA v2 (Artificial Analysis)PROXY | 1,655.00 (observed) | GDPval-AA v2 Elo; hosted full-precision API run; rank 9/31; independent (Artificial Analysis)source |
| SciCode (Artificial Analysis run) | 51.60 (observed) | % of SciCode's 288 test-set subproblems solved (pass@1; code executed and graded by AA); Artificial Analysis's own run of "GLM-5.3-Flash" through an API endpoint (not local quantized inference); AA payload value 0.5162; read 2026-10-17 from the AA model pagesource |
| Terminal-Bench 2.1 (Artificial Analysis run) | 84.30 (observed) | % of Terminal-Bench 2.1's 89 tasks passed (Terminus 2 harness, pass@1 averaged over 3 repeats); Artificial Analysis's own run of "GLM-5.3-Flash" through an API endpoint (not local quantized inference); AA payload value 0.8427; read 2026-10-17 from the AA model pagesource |