AgentOps

AgentOps is the operating loop a coding agent follows: one intent, one bounded build, one fresh judge, one durable verdict. It also ships skills to orchestrate multi-agent systems. For contested calls, opt into council (independent judges) or idea-genie duel mode (sealed perspectives before Plan).

RPI -> Plan -> Implement -> fresh Validate -> durable verdict -> report and stop

Quickstart

brew install beads
npx skills@latest add boshu2/agentops --all -g

Use plan, implement, validate, and learn — or rpi to run the loop once.

Plugins (Claude Code / Codex)

Prefer a managed bundle that updates with the release:

# Claude Code
claude plugin marketplace add boshu2/agentops
claude plugin install agentops@agentops-marketplace

# Codex
codex plugin marketplace add boshu2/agentops
codex plugin add agentops@agentops-marketplace

Two install paths:

• npx / skills.sh copies skills you can edit.
• Plugins keep a read-only bundle current with the repo.

Remove with your runtime's plugin uninstall, or delete the linked skill directories.

Intent lives in a bead

Beads is the preferred tracker. Plan writes BDD acceptance and DDD ubiquitous language into the bead; Implement builds against it; Validate judges a hashed snapshot under .agents/ao/intents/sha256/. No beads? Plan shapes the caller's issue or chat text and the runtime snapshots those bytes the same way.

validate must run in a fresh context (not the author session). Same model or a different one — both are supported.

Multi-agent systems

The default loop is one agent, one writer. When you need a fleet, swarm, agent-native, ntm, and using-gc orchestrate multi-agent work. They dispatch; they do not own the verdict.

AgentOps already borrows heavily from that ecosystem. Two stacks people run around the same loop:

• Gas City — orchestration-builder for multi-agent coding workflows
• Jeffrey Emanuel's Agentic Coding Flywheel — coordinated multi-agent tooling (mail, beads, NTM, and friends)

Optional: ao CLI

Deterministic checks, inspection, and skill linking. Skip it if you only need the skills.

brew tap boshu2/agentops https://github.com/boshu2/homebrew-agentops
brew install agentops

Without Homebrew: go install github.com/boshu2/agentops/cli/cmd/ao@latest

To track skills from a local checkout instead of a release bundle, run ao skills link from that checkout.

Why AgentOps exists

1. The agent said it was done

Same session that wrote the code also declared victory. AgentOps separates authorship from judgment: implement produces a candidate; validate must run in a fresh context and may use a different model. It issues PASS, FAIL, or NOT_PROVEN.

2. One perspective rubber-stamped another

A single context can share blind spots with the author. Opt into idea-genie or council for sealed or multi-judge review. They return a report; validate writes verdict.v2.

3. Acceptance drifted mid-flight

Without a fixed behavior and write scope, "done" is whatever the agent improvised. plan locks acceptance in the bead before anyone builds. Later phases bind to that digest.

4. Nobody can replay what was judged

Chat scrolls away. validate writes a content-addressed verdict.v2 under .agents/ao/verdicts/sha256/ with checked scope, omissions, and evidence refs. Plain JSON. No hosted service required.

Core skills

Optional later: learn. Strategies: council, idea-genie, premortem, postmortem.

One skill, many shapes

AgentOps prefers a smaller skill set you can steer over dozens of near-duplicate skills. Modes and flags change behavior inside one contract.

Read the skill's mode table before inventing a sibling skill. Full inventory: Skill Router.

Evidence contract

A PASS binds unchanged acceptance, a deterministic subject manifest, complete changed-path coverage inside write scope, distinct author and validator context IDs, a freshness attestation, and criterion-level evidence.

Missing identity, mutation, or incomplete coverage → NOT_PROVEN. Proven out-of-scope change or failed criterion → FAIL.

Operating loop · CLI · Docs

Contributing: docs/CONTRIBUTING.md. License: Apache-2.0.