← All models

Qwen 3.5 (2B)

generalApache 2.0tools

Alibaba's Qwen 3.5 at 2B parameters. Multimodal (text + images) with native tool calling and a 256K context window. A very compact choice for constrained devices.

At a glance

Parameters
2B
Quantization
Q4_K_M
Context window
256K tokens
Approx. size
2.7 GB
Engines
llama.cpp, MLX, Ollama
License
Apache-2.0 (open)
Version
v1.1.0 , released 2026-04-26
Family
qwen

Tuning

Defaults a gezel client applies out of the box, from real evaluation runs against this exact quantization.

sampling.temperature
0.7
sampling.topP
0.8
sampling.topK
20
sampling.minP
0
reasoning.thinkingBudget
2048
reasoning.enableThinking
true
profiles
thinking-general, thinking-coding, thinking-precise, instruct, creative

Model behaviors

Client-side behavior modules the catalog enables for this model (reasoning-tag handling, fabrication detection, prompt shaping).

Sources

llama.cpp (GGUF)
unsloth/Qwen3.5-2B-GGUF · Qwen3.5-2B-Q4_K_M.gguf · Q4_K_M
MLX
mlx-community/Qwen3.5-2B-4bit
Ollama
qwen3.5:2b
Upstream
https://ollama.com/library/qwen3.5
Manifest
View on GitHub

Tags