← All models

Qwen 3.8 (27B, Q2)

generalApache 2.0toolsreco 20

Alibaba's Qwen 3.8 at 27B parameters: a dense, multimodal agentic model with native text, image, and video understanding, 262K context, flexible reasoning effort, MTP, and native tool calling. Unsloth's dynamic UD-Q2_K_XL brings the 27B within reach of machines with 16GB+ usable memory while retaining more fidelity than the extreme IQ1_S build.

At a glance

Parameters
27B
Quantization
UD-Q2_K_XL
Context window
262K tokens
Approx. size
9.8 GB
Engines
llama.cpp
License
Apache-2.0 (open)
Version
v1.0.0 , released 2026-08-23
Family
qwen

Tuning

Defaults a gezel client applies out of the box, from real evaluation runs against this exact quantization.

sampling.temperature
1
sampling.topP
0.95
sampling.topK
20
sampling.minP
0
sampling.maxTokens
12288
sampling.repetitionPenalty
1
sampling.presencePenalty
0
reasoning.thinkingBudget
4096
reasoning.enableThinking
true
reasoning.templateKwargs
{"reasoning_effort":"medium"}
profiles
thinking-general, thinking-deep, thinking-coding, thinking-precise, instruct, creative

Model behaviors

Client-side behavior modules the catalog enables for this model (reasoning-tag handling, fabrication detection, prompt shaping).

Sources

llama.cpp (GGUF)
unsloth/Qwen3.8-27B-GGUF · Qwen3.8-27B-UD-Q2_K_XL.gguf · UD-Q2_K_XL
Upstream
https://huggingface.co/Qwen/Qwen3.8-27B
Manifest
View on GitHub

Tags