What Happened
Users running Qwen3.5 4B locally via Ollama have flagged a recurring issue: the model produces lengthy internal reasoning chains for straightforward requests, including basic greetings. A thread on Reddit's r/LocalLLaMA surfaced multiple examples where the 4B parameter model burns through hundreds of tokens on multi-step reasoning before producing what should be a one-line answer.
The behavior stems from Qwen3.5's "thinking mode," which Alibaba enabled by default across the model family to improve performance on complex reasoning tasks. On smaller parameter counts like the 4B variant, the balance between reasoning overhead and output quality appears miscalibrated. Users report the model generating extended internal deliberation on tasks as simple as "say hello" or "what day is it."
The problem is not unique to Qwen3.5. Other small reasoning models have exhibited similar patterns when thinking mode is carried over from larger variants without per-size tuning.
Why It Matters
For local deployment, token efficiency matters in a way it doesn't for cloud API users. People running inference on consumer hardware care about speed, memory usage, and practical responsiveness. When a 4B model spends 400-600 tokens reasoning through a trivial query, the interaction becomes noticeably slower and the model feels less useful than smaller, faster alternatives.
It also points to a gap in how model families are released. Thinking mode may need per-size tuning, or at minimum a cleaner mechanism for users to disable it at the configuration level without patching system prompts or editing Modelfiles manually.
The broader pattern is worth noting: reasoning capability designed for large models doesn't always scale down cleanly. A 70B model can afford the token overhead of extended thinking and still deliver fast, accurate results. A 4B model operating on constrained hardware has a different cost-benefit equation.
Our Take
The criticism is fair but the fix is accessible. Qwen3.5 4B supports disabling extended thinking through system prompt directives. Most users posting about this issue hadn't tried that option yet.
If you're running the model locally and hitting excessive reasoning on simple queries, try adding a system prompt instruction like "Be concise. Do not use extended thinking for simple tasks." Alternatively, the enable_thinking: false parameter is available in some Ollama configurations for the Qwen3.5 family.
The underlying model quality at 4B is solid for its size class. The overthinking behavior is a configuration and default-setting problem more than a fundamental flaw in the model's architecture. Alibaba should either ship with thinking mode off for the 4B variant or make the toggle more prominent in documentation. Right now users have to discover the workaround through community posts rather than official guidance.