arne/news
0
0
Fork 1
Code Issues Pull requests Projects Releases Packages Wiki Activity
No description
110 commits 2 branches 0 tags 2.2 MiB
  • HTML 49.7%
  • Go 32.2%
  • CSS 16.7%
  • JavaScript 1%
  • Shell 0.4%
Find a file
Exact
Arne Skaar Fismen 4e9d43c36f Initialize orbit with design system and conventions (#1)
2026-04-07 09:27:48 +02:00
design Initialize orbit with design system and conventions (#1) 2026-04-07 09:27:48 +02:00
docs Initialize orbit with design system and conventions (#1) 2026-04-07 09:27:48 +02:00
scrapers refactor: table-driven content fetchers, eliminate 14 files 2026-03-30 14:50:54 +02:00
scripts fix: add HTTP timeout to Ollama client, disable unreachable Ollama URL 2026-03-29 23:16:48 +02:00
static feat: match frontpage exactly to design — edition header, nav, animations 2026-03-30 11:58:28 +02:00
templates feat: WebAuthn login/register page 2026-03-30 13:41:00 +02:00
ai_worker.go refactor: split content worker into ContentFetcher and AIAnalyzer 2026-03-30 09:28:29 +02:00
ai_worker_test.go refactor: split content worker into ContentFetcher and AIAnalyzer 2026-03-30 09:28:29 +02:00
auth.go feat: WebAuthn auth layer with ceremonies, sessions, middleware 2026-03-30 13:41:05 +02:00
auth_test.go feat: WebAuthn auth layer with ceremonies, sessions, middleware 2026-03-30 13:41:05 +02:00
CLAUDE.md Initialize orbit with design system and conventions (#1) 2026-04-07 09:27:48 +02:00
cluster.go fix: raise cluster threshold to 3, limit AI to 8 specific keywords 2026-03-30 12:12:59 +02:00
cluster_test.go fix: raise cluster threshold to 3, limit AI to 8 specific keywords 2026-03-30 12:12:59 +02:00
config.go feat: WebAuthn config, credential and session DB tables 2026-03-30 13:39:16 +02:00
config_test.go feat: WebAuthn config, credential and session DB tables 2026-03-30 13:39:16 +02:00
content_worker.go feat: extract and store article metadata (section, description, image, tags, modified_at) 2026-03-30 14:44:10 +02:00
content_worker_test.go refactor: split content worker into ContentFetcher and AIAnalyzer 2026-03-30 09:28:29 +02:00
conventions.yaml Initialize orbit with design system and conventions (#1) 2026-04-07 09:27:48 +02:00
db.go feat: extract and store article metadata (section, description, image, tags, modified_at) 2026-03-30 14:44:10 +02:00
db_articles.go refactor: remove dead code, wire DeleteExpiredSessions 2026-03-30 14:46:39 +02:00
db_auth.go refactor: split db.go into domain files 2026-03-30 14:40:25 +02:00
db_editions.go refactor: split db.go into domain files 2026-03-30 14:40:25 +02:00
db_metadata.go refactor: rename journalist → author tables and methods 2026-03-30 14:42:07 +02:00
db_scrapers.go refactor: remove dead code, wire DeleteExpiredSessions 2026-03-30 14:46:39 +02:00
db_test.go refactor: remove dead code, wire DeleteExpiredSessions 2026-03-30 14:46:39 +02:00
edition.go refactor: move edition formatting helpers from server.go to edition.go 2026-03-30 14:46:16 +02:00
edition_test.go feat: AI-generated keywords for clustering, switch to qwen3:14b 2026-03-30 09:25:11 +02:00
go.mod feat: WebAuthn auth layer with ceremonies, sessions, middleware 2026-03-30 13:41:05 +02:00
go.sum feat: WebAuthn auth layer with ceremonies, sessions, middleware 2026-03-30 13:41:05 +02:00
main.go refactor: remove dead code, wire DeleteExpiredSessions 2026-03-30 14:46:39 +02:00
ollama.go fix: drop Ollama format schema (hangs qwen3), parse JSON from free-text response 2026-03-30 12:43:12 +02:00
ollama_test.go feat: AI-generated keywords for clustering, switch to qwen3:14b 2026-03-30 09:25:11 +02:00
README.md rename app from news to nyheter 2026-03-29 22:34:01 +02:00
scheduler.go refactor: remove dead code, wire DeleteExpiredSessions 2026-03-30 14:46:39 +02:00
scheduler_test.go feat: edition generation at 6am and 6pm 2026-03-29 21:45:59 +02:00
server.go refactor: move edition formatting helpers from server.go to edition.go 2026-03-30 14:46:16 +02:00
server_test.go feat: wire WebAuthn — protect /desk, add /login routes 2026-03-30 13:43:53 +02:00
smoke_test.go feat: wire WebAuthn — protect /desk, add /login routes 2026-03-30 13:43:53 +02:00

README.md

nyheter

A Norwegian news syndication app. Scrapes major news sites, tracks story prominence, and produces daily morning and evening editions of the 10 most important stories with AI-generated summaries.

How it works

  1. Scrapes the front pages of NRK, VG, TV2, Dagbladet, ABC Nyheter, and Aftenposten every 10 minutes
  2. Tracks which stories stay near the top and appear across multiple sites
  3. At 6am and 6pm, generates an edition of the top 10 stories
  4. Summaries are generated via Ollama (ai.fismen.no)

Stack

  • Go
  • SQLite
  • HTMX
  • Ollama

Configuration

Variable Default Description
DATABASE_PATH news.db Path to SQLite database
LISTEN_ADDR :8080 HTTP listen address
OLLAMA_URL https://ai.fismen.no Ollama instance URL
OLLAMA_MODEL — Model to use for summaries
SCRAPE_INTERVAL 10m Polling interval

Routes

  • / — Current edition with navigation to past editions
  • /desk — Admin interface (scraper status, article browser, ranking preview)