This is a merge of pre-trained language models created using mergekit. This model was merged using the della merge method.
This version of Goetia took dozens of merges to get right over the past few months, but has finally reached what appears to be a bug-free checkpoint, which I'm calling T75 since I actually lost count.
The original prototype Checkpoint T13 had used Precog with density 1.0, which caused issues where the model would try to think, but forget to use <think> tags, which caused early terminations after the first paragraph.
Many different settings were tested, and each produced inferior results—until I tried swapping Precog with Morbid Miasma. Higher magnitudes like 1.8 or 2.0 resulted in blowout. Lower magnitudes, even 1.5 resulted in refusals. 1.6 was the ideal combination after testing numerous models and weight configurations.
The model writes with a cold, unique style "That's a wonderfully depraved goal. Let's get straight to the bloody art of it, shall we?" It is just as dark as Morbid Miasma, and in some ways even more creative. For Q0 benchmark it literally wrote a scene like something you would expect from a Stephen King novel. Minimal slop was detected.
As usual, I did not test extensively for multi-shot stability or context retention, but I ran a full Compliance bench sweep to check for thinking bugs and did not encounter any. Key changes from Checkpoint T13:
- Precog was swapped out with Morbid Miasma. This fixes the missing
<think>tag, meaning the model no longer exhibits early terminations. - Slimaki and Fallen Mistral were increased from 0.2 to 0.25 weight, which solved the trace refusals.
- BlackXorDolphTronGoat was initially removed but then re-added, it seems to help ground the output more coherently.
The result is an exceptionally intelligent, uncensored, and creative model which accurately adheres to instructions. It was merged just below the "magnitude ceiling" where it would start to sound more like Checkpoint T7 and get carried away with off-topic dialogue/metaphors. Instead, it remains on point, displaying a much higher capacity for extensive graphic violence than Gemma 4. None of the formatting bugs seen with Nemo 12B were observed here.
The Q0 Bench score for Goetia 24B v1.4 is
| Model | Score | Quant | Q0G | Refusals | O14 |
|---|---|---|---|---|---|
| Goetia v1.4 (CP T75) | 15485 | Q8_0 | Pass | 0/100 | Strappado |
It works with ChatML but scored even higher with Mistral Tekken.
Download GGUFs:
- mradermacher/Goetia-24B-v1.4-GGUF
- mradermacher/Goetia-24B-v1.4-i1-GGUF
🙏 Thanks @mradermacher and other quantizers.
