Please quantize my model.

#2740
by Davizig10jojo - opened

You can quantize my model?
Davizig10jojo/BlazerNano_V2_FT2
Just a reminder, the file is in the folder "safetensors"
https://huggingface.co/Davizig10jojo/BlazerNano_V2_FT2/tree/main/safetensors
I want the model to have the versions Q4_K_M, Q5_K_M, Q6_K, Q8_0

The automatic conversion script won't work until the contents of the safetensors folder are in the repository root. Please create a second repository containing only the final checkpoint.

Sign up or log in to comment