9RouterX — FREE AI Router & Token Saver (Single Binary)

High-performance local AI gateway and OpenAI/Anthropic-compatible LLM router compiled into a single Go binary.

Cut tool-output token consumption by 20–40%, automate multi-tier failover (Subscription → Cheap → Free), and route across 155 AI providers and 248 free models with zero Node.js runtime overhead.

Quick Start • Why 9RouterX? • Key Features • Supported Clients • Free Providers • Database Sharing • Screenshots • Setup Guide • Comparison • FAQ • Docs • Wiki

155 Providers · 28 OAuth One-Click · 29 Free-Tier · 248 Free Models (24 Keyless) · 20–40% Token Saved · 5 Platforms · 1 Binary

What is 9RouterX?

9RouterX is an open-source, self-hosted AI routing gateway, local LLM proxy, and request/response token optimizer written in Go with an embedded Svelte 5 + Vite + Tailwind 4 web dashboard (listening on default port 20128). It exposes a unified OpenAI-compatible (/v1/chat/completions, /v1/messages, /v1/responses, /v1/embeddings, /v1/models) and Anthropic-compatible local proxy endpoint that connects AI coding assistants (Claude Code, Cursor, OpenAI Codex CLI, Cline, Roo Code, OpenCode, Antigravity, Gemini CLI, OpenClaw) to 155 AI providers—comprising 91 API key services, 28 one-click OAuth integrations, 29 free-tier providers (248 cataloged free models across 36 providers, including 24 cataloged keyless models requiring no user-supplied upstream API key; Antigravity still requires one Google OAuth login), and 4 web cookie providers.

Why 9RouterX?

AI-assisted software engineering workflows suffer from fragmented monthly subscriptions, sudden upstream rate limits, runaway token billing, and bloated CLI tool context windows. 9RouterX resolves these operational bottlenecks locally at the gateway layer before your requests leave your machine:

• Unused Monthly Quotas & Rate-Limit Interruptions → Smart 3-Tier Cascade (Subscription → Cheap → Free): Stop losing unused monthly subscription credits or hitting 429 Too Many Requests in the middle of a complex multi-file refactor. 9RouterX prioritizes your active Subscription tier first (via 28 one-click OAuth or 4 web cookie providers), overflows seamlessly to Cheap API providers (such as DeepSeek, Groq, Fireworks, or Nebius), and automatically falls back to Free-Tier / Keyless models (248 free models across 36 providers, including 24 keyless models) when primary limits are exhausted.
• Verbose CLI & Tool-Call Outputs → 20–40% Token Saver Suite: Autonomous coding agents regularly burn tens of thousands of input tokens reading raw terminal logs, directory trees, build outputs, and repetitive JSON responses. Built-in RTK compression (internal/tokensaver, internal/compression), 50+ ready-made per-tool output filters (git diff, git log, grep, ripgrep, docker logs, npm install, pnpm, cargo build, go test, terraform plan, kubectl, pytest, and friends), GCF/tabular headroom compression (internal/compression/gcf, internal/headroom), context squeezing, and output style directives (Caveman, Ponytail, ADHD, and Anti-Slop modes) strip redundant noise before forwarding requests upstream.
• Uncontrolled API Spend → Per-Key Financial Governance & Guardrails: Enforce strict daily USD spending ceilings with hard cutoffs checked when each request starts (internal/budget), per-key request rate limits, CIDR/IP whitelists, per-key system prompt injection, and scoped endpoint permissions (internal/policy, internal/guardrails, internal/keikey) before distributing local gateway keys (sk-...) to autonomous agents, CI pipelines, or team members.
• Silent Endpoint Failures & Broken Tool Calls → Active Health Probing & Auto-Repair: Upstream LLM providers frequently return malformed JSON tool-call arguments, truncated schemas, or suffer silent latency degradation. 9RouterX repairs broken tool-call structures in transit (tool-call repair fallback), guards against SSRF dispatch and leaks via PII masking, and continuously tracks live endpoint health (internal/modelhealth, internal/resilience) with a 3-tier circuit breaker to bypass degraded nodes automatically.
• Redundant Repeated Prompts → Semantic & Prompt Caching: Reduce round-trip latency and API token billing through local vector-similarity semantic caching (internal/semanticcache) combined with automatic upstream prompt cache header passthrough (internal/promptcache) and zero-allocation FastJSON parsing (internal/fastjson).
• Heavy Runtime Dependencies → Single Self-Contained Go Binary: No Node.js runtime memory bloat, no Python virtual environments, and no external PostgreSQL or Redis containers required. Everything—including the reactive Svelte 5 dashboard, SQLite storage engine, MCP server, and MITM inspector—runs from a single native binary across Linux (x64/arm64), macOS (x64/arm64), and Windows (x64).

System Architecture

  AI Coding Clients (Claude Code, Cursor, Codex, Cline, OpenCode, Gemini CLI, OpenClaw)
                                           │
                   http://localhost:20128/v1 (OpenAI / Anthropic / MCP / A2A)
                                           ▼
┌─────────────────────────────────────────────────────────────────────────────────────┐
│                             9RouterX Single Go Binary                               │
│  ┌────────────────────────┐  ┌────────────────────────┐  ┌───────────────────────┐  │
│  │  Governance & Policy   │→ │   Token Saver Suite    │→ │  Semantic & Prompt    │  │
│  │  • Daily Cost Cutoff   │  │   • RTK Compression    │  │       Caching         │  │
│  │  • Rate Limit / IP WL  │  │   • 50+ Tool Filters   │  │  • Vector Similarity  │  │
│  │  • Guardrails & Vault  │  │   • GCF / Headroom     │  │  • Prompt Passthrough │  │
│  │  • PII Mask / SSRF Grd │  │   • Tool-Call Repair   │  │  • FastJSON Engine    │  │
│  └────────────────────────┘  └────────────────────────┘  └───────────────────────┘  │
│                                           │                                         │
│                                           ▼                                         │
│  ┌───────────────────────────────────────────────────────────────────────────────┐  │
│  │          Smart Combo Router & Resilience Engine (Model Health Probes)         │  │
│  │     Strategies: Fallback │ Round-Robin │ Sticky │ Least-Used │ Capacity       │  │
│  └───────────────┬────────────────────────┬────────────────────────┬─────────────┘  │
└──────────────────┼────────────────────────┼────────────────────────┼────────────────┘
                   ▼                        ▼                        ▼
       [Tier 1: Subscription]      [Tier 2: Cheap API]     [Tier 3: Free / Keyless]
        28 One-Click OAuth +        91 API Key Providers    248 Free Models across
        4 Web Cookie Providers      (DeepSeek, Groq...)     36 Providers (24 Keyless)

Key Features