Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,151

Base only

Active filters: llama.cpp

LiquidAI/LFM2.5-2.6B-GGUF

Text Generation • 3B • Updated 3 days ago • 68.5k • 173

badtheorylabs/BTL-4-Compact

Text Generation • 35B • Updated 3 days ago • 3.62k • 49

yuxinlu1/gemma-4-12B-agentic-fable5-composer2.5-v2-3.5x-tau2-GGUF

Text Generation • 12B • Updated Jun 19 • 357k • 1.41k

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 23 days ago • 809k • • 1.18k

AtomicChat/Ling-3.0-flash-GGUF

Text Generation • 124B • Updated about 14 hours ago • 30.6k • 38

empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Image-Text-to-Text • 9B • Updated 26 days ago • 445k • 2.58k

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated 23 days ago • 2.69M • 756

froggeric/Qwen-Fixed-Chat-Templates

Updated Jul 3 • 1.04k

yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1-GGUF

Text Generation • 12B • Updated Jun 19 • 283k • 2.82k

AtomicChat/DeepSeek-V4-Flash-0731-GGUF

Text Generation • 284B • Updated 5 days ago • 14.5k • 20

bottlecapai/ThinkingCap-Qwen3.6-27B-GGUF

Image-Text-to-Text • 27B • Updated 16 days ago • 93.8k • 240

fraQtl/Gemma-4-E2B-it-Hi-Fi-GGUF

Text Generation • 5B • Updated about 1 hour ago • 3.1k • 15

LiquidAI/LFM2.5-8B-A1B-GGUF

Text Generation • 8B • Updated May 29 • 62.7k • 269

empero-ai/Qwythos-27B-v1-GGUF

Image-Text-to-Text • 27B • Updated 11 days ago • 55k • 54

Ma7ee7/Qwen3.8_4B_Distilled_GGUF

Text Generation • 4B • Updated 4 days ago • 34.1k • 16

peculiar-ragdoll/Nail-Qwen3.6-35B-A3B-GGUF

Image-Text-to-Text • 35B • Updated about 8 hours ago • 13

Jackrong/Qwopus3.6-35B-A3B-Coder-MTP-GGUF

Image-Text-to-Text • 0.4B • Updated Jul 9 • 442k • 224

Jackrong/DeepSeek-V4-Pro-Qwen3.5-4B-MTP-GGUF

Image-Text-to-Text • 4B • Updated 3 days ago • 9.42k • 17

stamsam/maple-preview-gguf

Text Generation • 20B • Updated 3 days ago • 8.12k • 11

Akahsizrr/fuse-1-Lite-GGUF

Text Generation • 6B • Updated less than a minute ago • 195 • 10

LiquidAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated Mar 30 • 3.77k • 148

LiquidAI/LFM2.5-230M-GGUF

Text Generation • 0.2B • Updated 4 days ago • 14.6k • 83

hellohazime/Kimi-K3-REAP-512GB-GGUF

Text Generation • 1.8T • Updated 1 day ago • 858 • 11

el4/GRM-3.2-Sky-ONYX-GGUF

Text Generation • 35B • Updated 3 days ago • 4.54k • 9

LiquidAI/LFM2.5-1.2B-Thinking-GGUF

Text Generation • 1B • Updated 4 days ago • 13.3k • 116

tvall43/Qwen3.6-14B-A3B-FableVibes-GGUF

Text Generation • 14B • Updated Jun 15 • 102k • 171

LiquidAI/LFM2-2.6B-GGUF

Text Generation • 3B • Updated Mar 30 • 11.2k • 62

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated Jun 6 • 322k • 123

sahilchachra/Unlimited-OCR-GGUF

Image-Text-to-Text • 3B • Updated Jul 1 • 37.8k • 120

Jackrong/Qwopus3.6-27B-Fusion-GGUF

Text Generation • 27B • Updated 11 days ago • 12.4k • 44