"Not all quantized model perform good", serving framework ollama uses NVIDIA gpu, llama.cpp uses CPU with AVX & AMX
v1k
xbruce22
AI & ML interests
None yet
Recent Activity
new activity 5 days ago
Nanbeige/Nanbeige4.3-33B:Please release fp8 liked a model 5 days ago
Nanbeige/Nanbeige4.3-33B liked a model 6 days ago
deepseek-ai/DeepSeek-V4.1-Flash-1017