Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

842

Base only

Active filters: ggml

microsoft/VibeVoice-ASR-BitNet

Automatic Speech Recognition • 0.3B • Updated 5 days ago • 1.75k • 96

unsloth/LTX-2.3-GGUF

Image-to-Video • 21B • Updated Apr 20 • 273k • 534

unsloth/FLUX.2-klein-9B-GGUF

Image-to-Image • 9B • Updated Jan 16 • 88.9k • 289

remixerdec/Inflect-Nano-v2-GGUF

Text-to-Speech • 3.96M • Updated about 19 hours ago • 167 • 4

remixerdec/Inflect-Micro-v2-GGUF

Text-to-Speech • 9.34M • Updated 3 days ago • 169 • 4

Serveurperso/OmniVoice-GGUF

Text-to-Speech • 0.6B • Updated Apr 30 • 46.1k • 42

unsloth/FLUX.2-dev-GGUF

Image-to-Image • 32B • Updated Dec 10, 2025 • 16.4k • 81

unsloth/Z-Image-Turbo-GGUF

Text-to-Image • 6B • Updated Jan 8 • 49.5k • 239

unsloth/FLUX.2-klein-4B-GGUF

Image-to-Image • 4B • Updated Jan 16 • 155k • 188

Serveurperso/ACE-Step-1.5-GGUF

0.7B • Updated Apr 14 • 42.4k • 83

cstr/qwen3-tts-1.7b-voicedesign-GGUF

Text-to-Speech • 2B • Updated May 1 • 2.67k • 3

cstr/qwen3-tts-0.6b-customvoice-GGUF

Text-to-Speech • 0.9B • Updated May 1 • 1.36k • 3

cstr/m2m100-418m-GGUF

Translation • 0.5B • Updated 27 days ago • 752 • 2

mudler/depth-anything.cpp-gguf

Depth Estimation • 0.1B • Updated Jun 20 • 19.5k • 11

cstr/ark-asr-3b-GGUF

Automatic Speech Recognition • 4B • Updated 26 days ago • 2.46k • 2

afrideva/phi-2-uncensored-GGUF

Text Generation • 3B • Updated Dec 21, 2023 • 442 • 13

sujithatz/ggml-whisper-medium-ml

Updated Oct 3, 2025 • 2

unsloth/Qwen-Image-Layered-GGUF

Image-Text-to-Image • 20B • Updated Jan 9 • 12.5k • 62

unsloth/Qwen-Image-Edit-GGUF

Image-to-Image • 20B • Updated Dec 22, 2025 • 2.85k • 29

unsloth/Z-Image-GGUF

Text-to-Image • 6B • Updated Jan 28 • 10.7k • 186

cstr/canary-ctc-aligner-GGUF

Automatic Speech Recognition • 0.6B • Updated 18 days ago • 2.87k • 2

cstr/pyannote-v3-segmentation-GGUF

Voice Activity Detection • 1.49M • Updated Apr 12 • 161 • 1

unsloth/ERNIE-Image-Turbo-GGUF

Text-to-Image • 8B • Updated Apr 14 • 7.83k • 228

cstr/omniASR-CTC-300M-v2-GGUF

Automatic Speech Recognition • 0.3B • Updated Apr 26 • 160 • 1

cstr/qwen3-tts-0.6b-base-GGUF

Text-to-Speech • 0.9B • Updated Apr 30 • 2.22k • 2

cstr/qwen3-tts-tokenizer-12hz-GGUF

Audio-to-Audio • 0.2B • Updated Apr 29 • 3.41k • 3

cstr/kokoro-voices-GGUF

Text-to-Speech • 131k • Updated May 1 • 3.23k • 2

cstr/kokoro-82m-GGUF

Text-to-Speech • 81.7M • Updated May 1 • 2.59k • 1

cstr/qwen3-tts-1.7b-customvoice-GGUF

Text-to-Speech • 2B • Updated May 1 • 1.87k • 6

cstr/chatterbox-turbo-GGUF

Text-to-Speech • 0.3B • Updated Jun 21 • 1.43k • 2