Filter by type:
Filter by tags:
qwen3.8-27b-defiance-iq4
Defiance combines HauhauCS's uncensored Qwen3.8-27B weights with a
customized Turbo Brilliance chat template for reasoning and roleplay.
This IQ4_XS GGUF build uses llama.cpp and the embedded template,
with a 32,768-token context. Text input only; MTP is not enabled.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-defiance-q6
Defiance combines HauhauCS's uncensored Qwen3.8-27B weights with a
customized Turbo Brilliance chat template for reasoning and roleplay.
This Q6_K_P GGUF build uses llama.cpp and the embedded template,
with a 32,768-token context. Text input only; MTP is not enabled.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-imatrix-nvfp4-mtp
Qwen3.8-27B in cdiamond's iMatrix-calibrated mixed-precision NVFP4
build. Selected attention and feed-forward tensors retain higher
precision. Includes the F16 vision projector and enables the embedded
MTP draft head with one draft token per step.
Repository: localaiLicense: apache-2.0
swift-qwen3.8-27b
Swift-Qwen3.8-27B is UkisAI's reasoning-efficient fine-tune of Qwen3.8-27B.
The publisher reports 58.3% fewer thinking tokens with less than 1% quality loss.
This Q4_K_M GGUF includes the F16 vision projector and enables MTP speculative decoding.
The weights use the Swift Open License v1.0.
Repository: localaiLicense: swift-open-license-1.0
qwen3.8-27b-fable-5-coding-distilled
A 27B Qwen3.8 fine-tune for coding, debugging, and agentic reasoning.
This Q4_K_M GGUF build uses llama.cpp, the embedded chat template, and the F16 vision projector.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-fable-5-coding-distilled-q8
A 27B Qwen3.8 fine-tune for coding, debugging, and agentic reasoning.
This Q8_0 GGUF build uses llama.cpp, the embedded chat template, and the F16 vision projector.
Repository: localaiLicense: apache-2.0
thinkingcap-qwen3.8-27b
ThinkingCap is a 27B Qwen3.8 fine-tune trained to reduce reasoning tokens, with text and image input.
This Q4_K_M GGUF build uses llama.cpp, the embedded chat template, and the F16 vision projector.
Licensed under PolyForm Small Business 1.0.0 with the publisher's personal-use grant; see the model license for permitted use.
Repository: localaiLicense: polyform-small-business-1.0.0
thinkingcap-qwen3.8-27b-q8
ThinkingCap is a 27B Qwen3.8 fine-tune trained to reduce reasoning tokens, with text and image input.
This Q8_0 GGUF build uses llama.cpp, the embedded chat template, and the F16 vision projector.
Licensed under PolyForm Small Business 1.0.0 with the publisher's personal-use grant; see the model license for permitted use.
Repository: localaiLicense: polyform-small-business-1.0.0
qwen3.8-27b-jumbo-fusion-q4
DavidAU's Jumbo Fusion edition of Qwen3.8-27B merges community fine-tunes
and includes a custom template with reasoning and instruction modes.
This Q4_K_M GGUF build supports text chat with a 32,768-token default context.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-jumbo-fusion-q8
DavidAU's Jumbo Fusion edition of Qwen3.8-27B merges community fine-tunes
and includes a custom template with reasoning and instruction modes.
This Q8_0 GGUF build supports text chat with a 32,768-token default context.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-turbo-brilliance-50x-q4
DavidAU's Turbo Brilliance 50X edition of Qwen3.8-27B includes a custom
chat template with selectable reasoning and instruction modes. This
Q4_K_M GGUF build includes the F16 vision projector for image input.
Uses the embedded template with a 32,768-token context by default.
Repository: localaiLicense: apache-2.0
qwen3.8-27b-turbo-brilliance-50x-q8
DavidAU's Turbo Brilliance 50X edition of Qwen3.8-27B includes a custom
chat template with selectable reasoning and instruction modes. This
Q8_0 GGUF build includes the F16 vision projector for image input.
Uses the embedded template with a 32,768-token context by default.
Repository: localaiLicense: apache-2.0
qwen3.8-27b
# Qwen3.8-27B
> [!Note]
> This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format.
>
> These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed, etc.
> [!Tip]
> For users seeking managed, scalable inference without infrastructure maintenance, the official Qwen API service is provided by Qwen Cloud.
> In particular, **Qwen3.8-27B** will be available as a hosted version with more production features, e.g., 1M context length by default, official built-in tools. For more information, please refer to the Qwen3.8-27B Overview. The service is coming soon. Stay tuned for updates.
Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.
...
Repository: localaiLicense: apache-2.0
qwen3.8-27b-uncensored-hauhaucs-aggressive-mtp
# Qwen3.8-27B
> [!Note]
> This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format.
>
> These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed, etc.
> [!Tip]
> For users seeking managed, scalable inference without infrastructure maintenance, the official Qwen API service is provided by Qwen Cloud.
> In particular, **Qwen3.8-27B** will be available as a hosted version with more production features, e.g., 1M context length by default, official built-in tools. For more information, please refer to the Qwen3.8-27B Overview. The service is coming soon. Stay tuned for updates.
Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.
...
Repository: localaiLicense: apache-2.0
qwen3.8-27b-uncensored
# Qwen3.8-27B
> [!Note]
> This repository contains model weights and configuration files for the post-trained model in the Hugging Face Transformers format.
>
> These artifacts are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed, etc.
> [!Tip]
> For users seeking managed, scalable inference without infrastructure maintenance, the official Qwen API service is provided by Qwen Cloud.
> In particular, **Qwen3.8-27B** will be available as a hosted version with more production features, e.g., 1M context length by default, official built-in tools. For more information, please refer to the Qwen3.8-27B Overview. The service is coming soon. Stay tuned for updates.
Following the widespread community adoption of the Qwen3.5 and Qwen3.6 series, we are pleased to introduce Qwen3.8, the most capable generation in the Qwen open-model family to date.
...
Repository: localaiLicense: apache-2.0
qwen3.8-27b-turbo-fable-cold-fusion-735-882-heretic-uncensored-neo-coder-max-mtp
RELEASE #1 GGUFS [including detailed notes, how to use, benches and much more]:
https://huggingface.co/DavidAU/Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NEO-CODER-MAX-MTP-GGUF
Qwen3.8-27B-TURBO-Fable-Cold-Fusion-735-882-Heretic-Uncensored-NM-DAU (release #1, others pending...)
( repo has 10+ other versions (and 3 branches) noted below that EXCEED the performance of all QWEN 27B models, including fine tunes. )
First, special thanks to Nightmedia for working on the first three stages prior to heretic'ing/post staging and benching everything (3 sections below).
A number of my finetunes - both released and non-released - were used here as well as some third parties. Full details will be disclosed upon final release as the project shores up.
THREE example generations [snippets] from STAGE1-PART2, STAGE1b-PART2 and STAGE2-rplus2 at the bottom of the page.
Release(s) will be GGUFS first (linked here directly) then source code shortly thereafter [now released/open].
Some additional work and/ spawning of new branches from branch(es) below is still going on.
NEW: Branch 3 added, see below.
COMPLETED AND PENDING RELEASES:
...
Repository: localaiLicense: apache-2.0
byteshape-qwen3.8-27b
ByteShape's ShapeLearn quantization of Qwen3.8 27B for chat, reasoning,
coding, and image input. This IQ4_XS-3.84bpw build uses mixed tensor
precisions and includes a BF16 vision projector. MTP decoding is enabled.
Repository: localaiLicense: apache-2.0
byteshape-qwen3.8-27b-iq3-s
ByteShape's ShapeLearn quantization of Qwen3.8 27B for chat, reasoning,
coding, and image input. This IQ3_S-3.23bpw build uses mixed tensor
precisions and includes a BF16 vision projector. MTP decoding is enabled.
Repository: localaiLicense: apache-2.0
byteshape-qwen3.8-27b-iq3-xs
ByteShape's ShapeLearn quantization of Qwen3.8 27B for chat, reasoning,
coding, and image input. This IQ3_XS-3.01bpw build uses mixed tensor
precisions and includes a BF16 vision projector. MTP decoding is enabled.
Repository: localaiLicense: apache-2.0
byteshape-qwen3.8-27b-iq3-xxs
ByteShape's ShapeLearn quantization of Qwen3.8 27B for chat, reasoning,
coding, and image input. This IQ3_XXS-2.88bpw build uses mixed tensor
precisions and includes a BF16 vision projector. MTP decoding is enabled.
Repository: localaiLicense: apache-2.0
byteshape-qwen3.8-27b-iq2-xxs
ByteShape's ShapeLearn quantization of Qwen3.8 27B for chat, reasoning,
coding, and image input. This IQ2_XXS-2.56bpw build uses mixed tensor
precisions and includes a BF16 vision projector. MTP decoding is enabled.
Repository: localaiLicense: apache-2.0
Page 1