7b443b40a4
- http_post: POST to external URLs with per-user URL prefix allowlist
(home/{user}/http_allowlist.json); admin-only, confirm-required
- nc_talk_history: read recent NC Talk messages via Basic Auth (requires
nc_username + nc_app_password in channels.json under nextcloud)
- openai_orchestrator: _chat_with_retry() wraps both API calls with
exponential backoff (3 attempts, 1s/2s) on connection errors and
transient status codes (429, 500, 502, 503, 504)
- Docs updated: CLAUDE.md, HELP.md, TODO, MASTER, ROADMAP (50 tools)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
4.0 KiB
4.0 KiB
Cortex — Roadmap
Phases and priorities. For active tasks see
TODO__Agents.md. Last updated: 2026-05-09
Phase 0 — Foundation ✅
- Syncthing fleet sync (
agents_sync/) operational - MCP tools (
ae_*) available in all Claude Code sessions - Fleet agents running independently on each machine
Phase 1 — Dispatcher Core ✅
- FastAPI service with streaming SSE responses
- Claude CLI and Gemini CLI subprocess backends
- Session context management (rolling window, file persistence)
- Nextcloud Talk bot (HMAC-signed webhook)
- Memory distiller (APScheduler — short/mid/long cycles)
- Local web UI (single-page, mobile-responsive)
- Auth status monitoring (
/auth/status, UI banner) - Session logging and file browser
Phase 2 — Identity & Multi-User ✅
- Inara persona formalized (
IDENTITY.md,SOUL.md,PROTOCOLS.md, context tiers) - Two-level user/persona layout (
home/{user}/persona/{name}/) - Session auth: bcrypt passwords, JWT cookies, invite tokens, Google OAuth
- Multi-user live: Scott, Holly, Brian
- Per-user channel config (
channels.json) - Per-user Gemini API key (settings UI)
- Help & Reference system (shared base + per-persona additions)
- Lucide icons, persona picker page, session persistence across navigation
Phase 3 — Intelligence Layer (In Progress)
- ✅ Gemini API orchestrator (tool loop → Claude responder)
- ✅ Tool suite: web search, AE Journal read/write, tasks, scratch, reminders, cron, system, email_send (+ per-user allowlist), nc_talk_send
- ✅ Agent mode in UI (async job, poll for result); role-based tool access + confirmation gate
- ✅ Local LLM backend (Open WebUI/Ollama, per-user multi-model config); inline model edit in registry UI
- ✅ Proactive cron (
message/briefjob types → NC Talk) - ✅ Session search (full-text across past session logs)
- ✅ Distill notifications (NC Talk after mid/long runs)
- ✅ Local backend for distillation (DISTILL_BACKEND_MID/LONG in .env)
- ✅ Local orchestrator — OpenAI-compatible ReAct loop; fires when orchestrator role → local model
- ✅ Web push notifications — VAPID;
web_pushtool; PWA-installable; subscribe via ☰ menu - ✅ Proactive notifications — daily reminder check (09:00);
notify()routes to any configured channel; dedicated settings page - ✅ Sub-agent spawning —
spawn_agenttool; per-host concurrency limit; Gemini API + local OpenAI backends - ✅ Web content extraction —
web_readvia trafilatura; strips ads/nav/boilerplate; 128K cap - ✅ Session log reader —
session_read(date)tool; complementssession_search - ✅
http_post— POST to external URLs with per-user URL prefix allowlist; admin-only, confirm-required - ✅
nc_talk_history— read recent NC Talk messages; requires nc_username + nc_app_password in channels.json - ✅ Local orchestrator retry — exponential backoff on 429/5xx/connection errors (3 attempts)
- Knowledge import — markdown → AE Journals (import script)
- Dev agent pipeline — specialist agents + supervisor + approval gate
- Gitea webhook integration + Actions CI
Phase 4 — Channel Expansion
- ✅ Web UI
- ✅ Nextcloud Talk
- ✅ Google Chat
- WhatsApp (Business API or bridge — investigating)
- Webhook triggers from Aether platform events
Phase 5 — Routing Intelligence & Scale
- Intelligent model routing (by task type, privacy, context length)
- Agent-to-agent task delegation across fleet
Phase 6 — Infrastructure
- Server DMZ finalized
- WireGuard for all Cortex-accessing devices
- Camera/IoT VLAN segmentation
Deferred / Watching
- Speculative decoding — llama.cpp supports it (E4B + E2B draft ≈ 2x speed); Ollama does not yet
- RAG via Open WebUI — feed Nextcloud docs into local knowledge collections; possible complement to AE Journals search
- Multi-host local models — per-user config already supports multiple hosts; routing logic TBD
- WhatsApp — requires Business API account or a bridge; not started