Switch AI primary to qwen3.6:35b and raise timeout

arne commented

2026-06-07 21:11:57 +02:00

Owner

gemma4:26b has been removed from fox, so the configured primary (AI_MODEL default gemma4:26b) now errors and every summary falls back to cube. Switch the primary to qwen3.6:35b, which produced richer, more accurate Norwegian summaries in a 4-article comparison.

qwen3.6:35b is a 35B reasoning model and is ~2.5x slower than gemma4 — it exceeded the 60s OpenAI client timeout on 2 of 4 test articles (up to 79s). So the switch must also raise the OpenAI client timeout (to ~120s); otherwise long articles would time out mid-generation and fall back to cube, paying the latency without getting qwen's output. The app is an async background summarizer, so the higher latency is acceptable.

Scope: change AIPrimary default model to qwen3.6:35b, raise OpenAIClient timeout, update tests/README. cube (qwen3:14b via OLLAMA_URL) stays as fallback.

gemma4:26b has been removed from fox, so the configured primary (AI_MODEL default gemma4:26b) now errors and every summary falls back to cube. Switch the primary to qwen3.6:35b, which produced richer, more accurate Norwegian summaries in a 4-article comparison. qwen3.6:35b is a 35B reasoning model and is ~2.5x slower than gemma4 — it exceeded the 60s OpenAI client timeout on 2 of 4 test articles (up to 79s). So the switch must also raise the OpenAI client timeout (to ~120s); otherwise long articles would time out mid-generation and fall back to cube, paying the latency without getting qwen's output. The app is an async background summarizer, so the higher latency is acceptable. Scope: change AIPrimary default model to qwen3.6:35b, raise OpenAIClient timeout, update tests/README. cube (qwen3:14b via OLLAMA_URL) stays as fallback.

arne referenced this issue from a commit

2026-06-07 21:14:09 +02:00

Switch AI primary to qwen3.6:35b and raise timeout

arne referenced this issue from a pull request that will close it,

2026-06-07 21:14:19 +02:00

Switch AI primary to qwen3.6:35b and raise timeout #10

arne closed this issue

2026-06-07 21:14:20 +02:00

Rows
Columns

Switch AI primary to qwen3.6:35b and raise timeout #9