ComfyUI-Agent-Kit

Local-first ComfyUI for every AI coding agent (Claude Code, Codex, Gemini CLI, Qwen Code). Your GPU, your models, no cloud, no account.

By AI VFX NEWS.

Make Claude Code, Codex, Gemini CLI, or Qwen Code drive ComfyUI at full power on your own machine - generate images, video, and audio, build and run workflows, pick the model variant that fits your hardware, and show the graph live in your own ComfyUI canvas. No hosted service, no per-generation billing: one installer wires the same stack into every agent you run, then you hand the whole setup to someone else with one command.

This is the portable, machine-independent, multi-agent version of a working ComfyUI setup. One shared core (the knowledge + the MCP driver) plus a thin adapter per agent. Clone it, run the installer, and each of your agents gets the same stack, wired to your hardware. GLM (z.ai) run through Claude Code is covered by the claude adapter. See docs/AGENTS.md for how each agent connects.

Local-first, for experts and everyday users alike. It scales from one-command image / video generation to a professional VFX color pipeline: v2 ships ComfyUI-OCIO (nine Nuke-style OpenColorIO nodes - Read a sequence, grade in ACES, write ProRes, preview on an on-node player, fully color-managed) and the field guide to building your own custom nodes.

Local-first by design. Prefer the cloud? The official Comfy Cloud MCP runs your workflows on Comfy's GPUs, no local setup. This kit is the local-first counterpart: everything runs on hardware you control, with no account and no per-generation cost, the model picker sizes each job to your VRAM, and it serves four agents, not one. Use whichever fits the job.

What it can do

• Drive ComfyUI from four agents (Claude Code, Codex, Gemini CLI, Qwen Code) off one shared core. GLM via Claude Code is covered too. (docs/AGENTS.md)
• ~90-tool MCP driver. The agent operates ComfyUI directly: generate, build / edit / validate graphs, queue, download models, manage VRAM, read logs, diagnose.
• Per-model "mega-brain": 71 prompt recipes distilled from official sources (image, video, audio, 3D); the agent auto-pulls the right recipe when you name a model, so it prompts each one in its own dialect.
• Knows where each model runs: a full index of all 152 library models (recipe / utility / template-only), local vs API.
• Hardware-aware model selection: detects your VRAM, RAM, and free disk, then recommends the variant that fits (fp8 / offload / multi-GPU / quant) and refuses a download that won't fit, before wasting the bandwidth.
• 18 enhancement and utility tools: upscale / restore (Real-ESRGAN, SUPIR, SeedVR2), frame interpolation (FILM, RIFE), segmentation / depth / pose (SAM3, BiRefNet, Depth Anything), plus restoration chains.
• 545-template library (and 94 official Subgraph Blueprints, reusable subgraph bricks) as the source of truth, plus fetch any shared workflow by hash and a model shootout (run a prompt through many models small, pick the winner, then scale up).
• Assembles new workflows from parts: decomposes a task into stages, mixes templates and blueprint subgraphs, and wires the nodes correctly (output-to-input by type, with converters where needed), validated against /object_info before running. Not a preset runner.
• Expert color + custom nodes (new in v2): ships ComfyUI-OCIO
  • nine Nuke-style OpenColorIO nodes (Read / Write a still, sequence or video, grade in ACES, write ProRes / EXR, preview on an on-node player, fully color-managed) - and the agent knows each node's I/O plus the field guide to building a custom node pack. (docs/NODE_LIBRARY/ocio.md, docs/BUILDING_NODES.md)
• Starts ComfyUI for you: when the server is down, the agent launches it headless in the background and generates (no need to open the app first); to peek, you open http://127.0.0.1:8188 in a browser. For an unattended pipeline the start policy is configurable per project (env vars or a .comfyui-agent.json), so it never blocks on a prompt.
• GUI bridge + persistence: the agent writes graphs into your ComfyUI canvas, and SAVES every workflow it builds or runs to ComfyUI's workflows folder, so you can open it later from the Workflows sidebar (an API generation alone leaves no trace on the canvas).
• Stays current on its own: check_updates.py diffs the template repo and reads the blog RSS; an optional weekly task adds recipes for new models and pushes them. (docs/UPDATING.md)
• Portable and idempotent: one installer, auto-detects your agents, re-runnable. MIT, no vendored third-party code (everything heavy is fetched at install).

The four-layer stack

Plus a GUI bridge: the agent writes graphs to <ComfyUI>/user/default/workflows/, you open them in the built-in Workflows sidebar and tweak them. No extra "agent panel" node required.

See docs/LAYERS.md for each layer, and docs/AGENTS.md for the per-agent matrix.

The template library is the source of truth

The kit clones the official Comfy-Org/workflow_templates and builds a compact lookup index so the agent can match any request to the right template. 549 templates (plus 94 official Subgraph Blueprints, reusable subgraph bricks) span every task, image, video, 3D, audio, utilities:

It knows every model's dialect

Each generative model rewards a different prompt approach: SDXL wants comma tags, FLUX wants natural-language sentences, video models want camera and motion direction, audio models want genre/tempo/instruments, and negative-prompt support varies wildly. The kit ships MODELS.md, a per-model prompting reference distilled from official sources (each maker's docs and model cards, docs.comfy.org, and the per-model templates from the anthropic-claude node). When you name a model in a request or a workflow, the agent reads that model's entry first and prompts it correctly.

Covered today (71 models with recipes): FLUX.1/.2 + Kontext, Z-Image, Boogu, Qwen-Image/Edit, SDXL, SD1.5/3.5, HiDream, Ideogram, Nano Banana Pro/2, Seedream, Recraft, GPT-Image, Grok, Reve, Kandinsky, BRIA, OmniGen, Chroma, Krea 1/2, ERNIE-Image, FireRed/LongCat/ChronoEdit (edit), Capybara, Bernini-R, Anima, NewBie, PixelDiT, Ovis-Image, Lens, Quiver, Wan 2.1-2.7, LTX-2.3/2 Pro, Hunyuan Video, SVD, Kling, Veo, Sora, Seedance, Luma, Runway, MiniMax, PixVerse, Vidu, Pika, HappyHorse, HuMo, SCAIL-2, Stable Audio, ACE-Step, ElevenLabs, ChatterBox, Sonilo, Hunyuan3D, Tripo, Rodin, Meshy. Plus a separate Enhancement and utility section (not prompt-driven, settings not prompts): upscalers and restorers (Real-ESRGAN, SUPIR, SeedVR2, FlashVSR, Topaz, Magnific), frame interpolation (FILM, RIFE), conditioning helpers (SAM3, BiRefNet, Depth Anything, DWPose, MoGe, IP-Adapter, LivePortrait, Mediapipe), and video object removal (VOID). Anything else falls back to the template library.

Full model index: every model in the library and exactly what the kit has for it (recipe / utility / template-only): docs/MODEL_INDEX.md.

Coverage table: every model and whether a prompt recipe is ready

✅ recipe = a dedicated, up-to-date prompting guide in MODELS.md. 🔧 tool = an enhancement/utility note (settings, not prompts). Updated: 2026-06-25.

One table, columns aligned to the widest row (the video models).