Hermes Talk

Realtime duplex voice for your own agent — talk to it, it runs real work in the background, it reports back out loud.

Hermes Talk is a realtime voice plugin for Hermes Agent: you speak, it answers out loud, and it calls the agent's own tools without leaving the conversation. It runs in the terminal (hermes talk), in a Discord voice channel (/talk join), in the Hermes dashboard Talk tab, and in Hermes Desktop.

It rides your ChatGPT or SuperGrok subscription. No API key required.

The realtime lanes are OpenAI Realtime (gpt-realtime-2.1, on your ChatGPT subscription through codex login), xAI Grok Voice (on an X Premium or SuperGrok login, no key), and Gemini Live (which does need a GEMINI_API_KEY — free-tier AI Studio keys work); GPT-Live is selected separately by TALK_VOICE_MODE=live and runs gpt-live-1-codex on the Codex subscription or gpt-live-1 on explicitly chosen API billing.

Talk calls the host's tools, delegates background work while you keep talking, reports results, and handles current approval requests. Provider support differs by surface; see the tables below.

What it is: a plug-in that adds interruptible, duplex speech-to-speech voice to an existing Hermes Agent install — one bidirectional audio session in which the agent uses its real tools, hands work to background agents, and speaks the results when they land.

Who it is for: people already running Hermes Agent who would rather talk to it than type at it, and who want to keep talking while it works. It is not a standalone assistant, and it does not replace Hermes's built-in turn-based voice mode — that is a different shape, and a good one.

🔊 Watch the 2:27 cut with sound — delegate, keep talking, hear the result land.

Real Realtime session, 8× speed in the GIF, recorded at v0.3.0. It does not demonstrate the new GPT-Live or Codex-worker integration.

Install

hermes plugins install --ref 7ad833e4fcedb2c9a9947d84d7fd89bdbd15d256 TheSmokeDev/hermes-talk --enable
pip install "hermes-talk[audio]"   # mic + speaker support (sounddevice); skip if dashboard-only

Needs Python ≥ 3.11 and a Hermes host ≥ v0.17. GPT-Live, shared task attachment and Codex workers need additional host capabilities; the full list is in Prerequisites.

The commit above is the published v0.22.0 source. Hermes v0.22.5 requires a full 40-character commit SHA for --ref; it does not accept a tag there. This also avoids an older community-catalog pin. For an existing pinned install, preserve local plugin edits, then run:

hermes plugins install --force --ref 7ad833e4fcedb2c9a9947d84d7fd89bdbd15d256 --enable TheSmokeDev/hermes-talk

Restart the gateway/dashboard and Desktop afterward. An unpinned Git install can use hermes plugins update hermes-talk.

Quickstart

Terminal — start here:

hermes talk

You are live: speak, and it answers out loud in the same breath. Ctrl+C hangs up. → Use

Discord — the call happens inside a voice channel, not in chat:

/voice join     # put Hermes in the voice channel first
/talk join      # Talk borrows that connection — it never opens a second one

Talk answers in the room everyone can hear; /talk leave ends it. Mutating tools stay denied until you set TALK_DISCORD_OPERATOR_USER_IDS. → Discord voice

Dashboard — browser audio, no local mic drivers:

hermes dashboard    # then open the Talk tab and hit Start

Allow the microphone and talk. You see the live transcript plus a list of background runs. → Dashboard tab

New in 0.22.0: run your Desktop sessions by voice

With OpenAI Realtime in Desktop, you can now say:

• “Start a new session for this project and run its tests.”
• “Check what the other agent is working on.”
• “Tell that session to check the failing test next.”
• “Steer the running session toward this approach.”
• “Show my capabilities, scheduled jobs, and messaging status.”

Talk discovers the actual project directories and saved conversations on the current connection/profile. It creates a separate session with your opening task, reads live progress and recent replies, and queues or steers your instructions while the original call stays connected. Local and SSH backends use their own supported session contracts. A queued message is reported as accepted, not completed.

Also fixed: Stop → Connect in the same conversation, Hermes-managed ChatGPT login detection, the current Hermes capability catalog, and typed input during unbound realtime calls. Grok's expanded built-in voice list and a speech-tag reference are included too.

Tested on stock Hermes v0.22.5 over SSH, including creating a session in a chosen directory, a real pwd tool call, a follow-up to another session, and steering a running task. These Desktop controls stay within the selected connection/profile. They do not add arbitrary screen control or external message sending. GPT-Live and shared voice-history attachment still require the additional host support described in the Desktop guide.

Every version with its receipts: CHANGELOG.md.

Providers and billing

The provider knob is fail-closed and never inferred from which keys exist. Grok supports all 28 documented built-in voices through TALK_GROK_VOICE (for example, carina); see the voice list. Per-lane detail and the credential order: docs/PROVIDERS.md. Speaking in a voice of your own: docs/CASCADE.md. Experimental xAI speech effects and phrase wrappers, including how native Talk differs from verbatim TTS: docs/XAI-SPEECH-TAGS.md.

Surfaces

Is it working?

hermes plugins list        # → hermes-talk · enabled · current version
hermes talk doctor         # → read-only: auth lane, provider, model/voice, audio, host lanes
hermes talk check          # → doctor + one live provider turn + one bounded Hermes run
# then, in any session: say "status report" — talk_status answers with
# version, auth lane, agent lane, and audio state.

Doctor is read-only by design: it names which lane came up and what is missing, and never writes, probes, or refreshes a token. check is the other half and is deliberately not read-only — one short provider turn and one short agent run, exit 0 only if every step passed. A mock can never go green.

Filing an issue? hermes talk diagnostics --bundle writes one redacted, owner-only file — versions, the names of the variables you have set, device and host facts, and every doctor outcome; no values,