Model Gallery

3 models from 1 repositories

Filter by type:

Filter by tags:

qwen3.6-35b-a3b-ud-q4_k_xl-strata
Qwen3.6-35B-A3B, a 35B-parameter mixture-of-experts model with 3B active parameters, in Unsloth's 4-bit (Unsloth Dynamic), the smallest GGUF with the MTP layer (about 24 GB to download). It reads images through Unsloth's vision projector, and the Strata backend parses its reasoning and tool calls. Needs an NVIDIA or AMD GPU (the Intel Arc and Apple builds of Strata do not run this model) and about 32 GB of RAM: the engine keeps every expert it can in VRAM and computes the rest on the CPU. Runs only on the experimental strata backend. On the first load the strata backend exports the tokenizer and chat template from the GGUF file (seconds); the engine reads the GGUF as it is. The MTP draft layer inside the file is used for speculative decoding. Licensed under the Apache License 2.0 (Qwen/Qwen3.6-35B-A3B). The GGUF files are the Unsloth quantization; Strata is by Niko1221.

Repository: localaiLicense: apache-2.0

qwen3.6-35b-a3b-ud-q6_k_xl-strata
Qwen3.6-35B-A3B, a 35B-parameter mixture-of-experts model with 3B active parameters, in Unsloth's 6-bit (Unsloth Dynamic), closer to the full model GGUF with the MTP layer (about 34 GB to download). It reads images through Unsloth's vision projector, and the Strata backend parses its reasoning and tool calls. Needs an NVIDIA or AMD GPU (the Intel Arc and Apple builds of Strata do not run this model) and about 44 GB of RAM: the engine keeps every expert it can in VRAM and computes the rest on the CPU. Runs only on the experimental strata backend. On the first load the strata backend exports the tokenizer and chat template from the GGUF file (seconds); the engine reads the GGUF as it is. The MTP draft layer inside the file is used for speculative decoding. Licensed under the Apache License 2.0 (Qwen/Qwen3.6-35B-A3B). The GGUF files are the Unsloth quantization; Strata is by Niko1221.

Repository: localaiLicense: apache-2.0

qwen3.6-35b-a3b-q8_0-strata
Qwen3.6-35B-A3B, a 35B-parameter mixture-of-experts model with 3B active parameters, in Unsloth's 8-bit, the closest to the full model GGUF with the MTP layer (about 39 GB to download). It reads images through Unsloth's vision projector, and the Strata backend parses its reasoning and tool calls. Needs an NVIDIA or AMD GPU (the Intel Arc and Apple builds of Strata do not run this model) and about 52 GB of RAM: the engine keeps every expert it can in VRAM and computes the rest on the CPU. Runs only on the experimental strata backend. On the first load the strata backend exports the tokenizer and chat template from the GGUF file (seconds); the engine reads the GGUF as it is. The MTP draft layer inside the file is used for speculative decoding. Licensed under the Apache License 2.0 (Qwen/Qwen3.6-35B-A3B). The GGUF files are the Unsloth quantization; Strata is by Niko1221.

Repository: localaiLicense: apache-2.0