Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

28

Base only

Active filters: q4-k-m

elix3r/gemma4-12b-with-proj-ltx-2.5-GGUF

Feature Extraction • 13B • Updated 19 days ago • 11.6k • 23

Jiunsong/SuperQwen3.8-27b-abliterated-GGUF

Image-Text-to-Text • 27B • Updated about 1 month ago • 12.2k • 28

steven0226/qwen3vl-8b-chartqa-gguf

Image-Text-to-Text • 8B • Updated 22 days ago • 226 • 1

daksh-neo/acervo-extractor-qwen3.5-9b-GGUF

Text Generation • 9B • Updated Mar 25 • 54 • 1

continuum-ai/qwen3.5-4b-code-forged

Text Generation • 4B • Updated Apr 11 • 160 • 1

continuum-ai/qwen3.5-4b-code-forged-defragged

Text Generation • 4B • Updated Apr 11 • 41

continuum-ai/qwen3.5-4b-code-forged-GGUF

Text Generation • 4B • Updated Apr 11 • 769 • 6

continuum-ai/qwen3-coder-30b-a3b-compacted-19b-256k

Text Generation • 20B • Updated Apr 11 • 1.16k • 3

regolo/brick-complexity-extractor-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 13 • 40

regolo/brick-complexity-2-eco-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 20 • 26 • 1

regolo/brick-complexity-2-max-Q4_K_M-GGUF

Text Classification • 0.8B • Updated Apr 20 • 22 • 1

helenk/gemma-4-E4B-finetune-GGUF

Text Generation • 7B • Updated May 9 • 97 • 1

helenk/gemma-4-E2B-finetune-GGUF

Text Generation • 5B • Updated May 9 • 59 • 2

josoroma/gemma-4-codigo-trabajo-gguf

Text Generation • 31B • Updated May 10 • 31

originalGeek/Orthrus-Qwen3-8B-GGUF

Text Generation • 10B • Updated Jun 13 • 22

shira-qwq/RUM-F2K-4B-1296000-GGUF

Text-to-Image • 4B • Updated Jul 1 • 43

shibatch/tinygemma3-2m

Text Generation • 1.56M • Updated Aug 13 • 17

coolthor/Laguna-S-2.1-attnQ8-DFlash-Q4-GGUF

Text Generation • 118B • Updated Jul 22 • 193 • 4

coolthor/Sulphur-2-distilled-Q4_K_M-GGUF

Text-to-Video • 21B • Updated Jul 22 • 3.33k • 2

empgces/gemma3-270m-grounded-behavior-finetuned-v9-GGUF

Text Generation • 0.3B • Updated Jul 28 • 68

FrontisAI/Frontis-MA1-30B-GGUF

Text Generation • 31B • Updated Jul 31 • 48 • 2

FrontisAI/Frontis-MA1-35B-GGUF

Image-Text-to-Text • 35B • Updated Jul 31 • 174 • 7

Tidalluna/DeepSeek-V4-Flash-0731-Tina-CQ4KM

Text Generation • Updated Aug 2 • 76 • 1

tahsinahsen/birag-gemma4-e2b-response-only-gguf

Text Generation • 5B • Updated Aug 4 • 26 • 1

stenml/BowLingual-12B-v1-GGUF

Text Generation • 12B • Updated Aug 6 • 17

shafire/OpenZero-Ouroboros-3.8B-GGUF

Text Generation • 4B • Updated Aug 19 • 102 • 2

divingclone/Hy-MT2-1.8B-NVFP4-Q4_K_M-GGUF

Translation • 2B • Updated 6 days ago • 302

nakanokazuha/Yume-Qwen3.5-4B-GGUF

Text Generation • 4B • Updated 1 day ago • 13 • 1