Ornith 1.5 (35B-A3B, Q8)
Ornith AI's Ornith 1.5 at 35B total parameters with roughly 3B active per token — a self-improving, agentic-coding model trained for software engineering, tool use, and reasoning. The 8-bit build preserves more fidelity than Q4 while retaining fast MoE decode, with native tool calling and a 256K context window. MIT licensed; best suited to machines with 48GB+ usable memory.
At a glance
- Parameters
- 35B
- Quantization
- Q8_0
- Context window
- 262K tokens
- Approx. size
- 36.9 GB
- Engines
- llama.cpp, MLX
- License
- MIT (open)
- Version
- v1.0.0 , released 2026-08-19
- Family
- qwen
Tuning
Defaults a gezel client applies out of the box, from real evaluation runs against this exact quantization.
- sampling.temperature
0.6- sampling.topP
0.95- sampling.topK
20- sampling.minP
0- sampling.maxTokens
8192- sampling.repetitionPenalty
1- reasoning.thinkingBudget
4096- reasoning.enableThinking
true- profiles
- thinking-general, thinking-coding, thinking-precise, instruct, creative
Model behaviors
Client-side behavior modules the catalog enables for this model (reasoning-tag handling, fabrication detection, prompt shaping).
- reasoning.strip-think-tags
- prompt.private-reasoning-guidance
- prompt.tool-cookbook-condensed
- fabrication.detect-past-tense-no-tools
- turn.ollama-num-predict-bumped
- turn.preamble-folding
- turn.ramble-detection
- mcp.compact-tool-schemas
- tools.mlx-grammar
Sources
- llama.cpp (GGUF)
- ornith-ai/Ornith-1.5-35B-A3B-GGUF ·
Ornith-1.5-35B-Q8_0.gguf· Q8_0 - MLX
- ornith-ai/Ornith-1.5-35B-A3B-MLX-8bit
- Upstream
- https://huggingface.co/ornith-ai/Ornith-1.5-35B-A3B
- Manifest
- View on GitHub
Tags
- ornith
- coding
- agentic
- tools
- reasoning
- long-context
- moe