qwen-audio-agent

Name: qwen-audio-agent
Author: QwenAudio

Pending

A realtime voice runtime that keeps Agents talking, working, and present. Real-time Voice Runtime for AI Agents

2,010stars

146forks

JavaScript

Installation

# Add to your Claude Code skills
git clone https://github.com/QwenAudio/qwen-audio-agent

Getting Started

Guides for using ai agents skills like qwen-audio-agent.

Caveman: Cut Claude Token Use by 65%
How agent-side prompt compression works, when to use it, and when not to.
What is an AI Skills Marketplace?
Definitions, how marketplaces work, and how to choose between them in 2026.
Getting Started with AI Skills

README.md

Frequently Asked Questions

What is qwen-audio-agent?

qwen-audio-agent is an open-source ai agents skill for AI coding assistants such as Claude Code, Codex CLI, and ChatGPT, built by QwenAudio. A realtime voice runtime that keeps Agents talking, working, and present. Real-time Voice Runtime for AI Agents. It has 2,010 GitHub stars.

Is qwen-audio-agent safe to use?

qwen-audio-agent's catalog security scan is still queued. You can run an instant dependency and prompt-injection check now with the "Scan for vulnerabilities" button above.

How do I install qwen-audio-agent?

Clone the repository with "git clone https://github.com/QwenAudio/qwen-audio-agent" and add it to your Claude Code skills directory (see the Installation section above).

What programming language is qwen-audio-agent written in?

qwen-audio-agent is primarily written in JavaScript. It is open-source under QwenAudio on GitHub, so you can review or fork the full source.

Are there alternatives to qwen-audio-agent?

Yes. SkillsLLM lists many other AI Agents skills you can browse and compare side by side. Open the AI Agents category from the badge at the top of this page, or use the Related Skills and comparison links further down to weigh qwen-audio-agent against similar tools.

Agentic AI for Beginners

Build your first AI agent from scratch - tool use, ReAct pattern, memory, deployment

41 minBeginner

Comments (0)

to leave a comment.

No comments yet. Be the first to share your thoughts!

Related Skills

ECC

by affaan-m

The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.

238,849

agency-orchestrator designer-skills

Qwen Audio Agent

中文 | English

Agent Presence

Real conversation should not leave you waiting after a single sentence, nor should it grind to a halt just because the Agent is looking something up, calling a tool, or working on a task.

Conversation should keep flowing, and the Agent should always be present.

That is why we built qwen-audio-agent—a realtime voice runtime that keeps Agents talking, working, and present. Whether chatting with you, thinking through a problem, or working on a task, your Agent remains in the conversation. It listens, responds, and when the task is complete, naturally tells you:

"It's ready."

News

2026-08-09 · v1.8.0 🆕 Adds Qwen Code backend; 🔧 fixes known issues.
2026-08-07 · v1.7.0 🎨 The orb now supports skins, with custom look imports; 🪟 improved Windows backend Agent startup.
2026-08-07 · v1.6.1 ⚡ Task delegation and permission decisions confirm instantly; 🖥️ built-in computer-use lets backend Agents operate the computer out of the box; 🎙️ more reliable wake; 📚 fully bilingual docs.
2026-08-06 · v1.6.0 🪟 Desktop app now officially supports Windows; 🧠 adds invisible memory with automatic extraction after each session.
2026-08-05 · v1.5.0 ⏰ Adds scheduled reminders and progress reporting; 🗣️ adds the voice wake word ("你好千问"); 🐧 desktop build support for Linux; the desktop app now uses a data directory isolated from the CLI.
2026-08-05 · v1.4.2 🔧 Improves desktop backend Agent installation, login, and status detection; refines long-term memory behavior.
2026-08-04 · v1.4.1 🧰 Adds one-click backend Agent install; desktop floating orb supports auto-hide and shortcut recall.
2026-08-04 · v1.4.0 🧠 Adds personalized rules and checklist management; desktop app supports auto-sleep and shortcut wake.
2026-08-03 · v1.3.0 🎙️ Adds 🤗 speech-to-speech frontend integration, supporting fully local VAD, STT, LLM, and TTS.
2026-08-01 · v1.2.0 ⚡ Desktop app adds auto-update, faster startup, and improved backend Agent detection.
2026-07-31 · v1.1.0 🤝 Adds Kimi Code CLI backend with native ACP integration.
2026-07-30 · v1.0.0 🚀 First stable release, introducing a macOS desktop app with a built-in Gateway.
2026-07-28 · v0.9.0 🌍 Project officially open-sourced; backend Agents unified under the ACP architecture.

Conversation Continues, Tasks Too

Conversation doesn't stop for background tasks; when a task completes, the result naturally returns to the current conversation:

https://github.com/user-attachments/assets/42022655-36d1-46b2-9c26-ff0765284000

Core Features

Full-duplex realtime voice interaction, natural interruption, and sustained multi-turn conversation
One-click selection of your preferred coding Agent, reusing existing tools, MCP, and Skills
Frontend conversation and background tasks run in parallel; ask about progress or cancel at any time
Create multiple independent tasks executed asynchronously by the backend Agent, with continuous status tracking
Task results automatically return to the current conversation, supporting follow-up questions and modifications
WebUI, terminal TUI, and desktop floating orb (macOS / Windows / Linux)
Local user profile and cross-session personal memory

Architecture

qwen-audio-agent architecture

Questions that can be answered directly are answered immediately; when tools or sustained processing are needed, the task is delegated to the backend Agent. Throughout, the user always faces the same assistant.

qwen-audio-agent reference architecture

For the full design and module breakdown, see the architecture document.

Agent Support

Backend Agent	Integration	Setup	Rating
None	N/A	Frontend-only mode, no config needed	★★★★★
OpenCode	Native ACP	One-click install + Bailian config	★★★★★
OpenClaw	Built-in ACP bridge	One-click install + Bailian config	★★★★★
Qoder	Native ACP	One-click install, user config required	★★★★★
Qwen Code	Native ACP	One-click install, user config required	★★★★☆
Kimi Code	Native ACP	One-click install, user config required	★★★★★
Hermes	Native ACP	One-click install, user config required	★★★★☆
CodeBuddy	Native ACP	One-click install, user config required	★★★★☆
Codex	External ACP adapter	One-click install (base + adapter), user config required	★★★★☆
Claude Code	External ACP adapter	One-click install (base + adapter), user config required	★★★★☆

Ratings reflect current integration completeness, compatibility, and verification level: five stars indicate a thoroughly tested recommended integration; four stars indicate active development or not yet fully verified. For detailed configuration and capability boundaries, see the configuration guide.

Installation

Requires Node.js 22.22.2+ or 24.15.0+, npm 10+. One-click install (recommended):

npm install -g qwen-audio-agent

For building from source, installing from GitHub, and obtaining a DashScope API Key, see the installation guide.

Quick Start

Create your config and fill in the API Key:

qwenaudio config

DASHSCOPE_API_KEY=your-key
# Voice frontend model: qwen-audio-3.0-realtime-flash or qwen-audio-3.0-realtime-plus (default)
QWEN_AUDIO_REALTIME_MODEL=qwen-audio-3.0-realtime-plus
# Backend Agent: optional, leave empty or set to none for frontend-only mode
AGENT_PROTOCOL=openclaw
# Backend model: can be empty; if empty, uses the Agent's own user config
QWEN_AUDIO_AGENT_BACKEND_MODEL=qwen3.7-max

Uses DashScope realtime voice frontend by default; alternatively, switch to a local speech-to-speech frontend, no cloud API Key needed.

Start the Gateway, then open another terminal to start the TUI (or use qwenaudio webui for the browser UI):

qwenaudio        # Terminal 1: Gateway
qwenaudio tui    # Terminal 2: TUI

For full configuration options, speech-to-speech frontend setup, and TUI platform notes, see quick start, voice frontends, and TUI notes.

Desktop App

The desktop app provides a floating voice orb that stays on your desktop, with a built-in Gateway, auto-hide, shortcut recall, and voice wake word. Download the installer for your platform from the releases page, or build from source:

npm run desktop:build:local      # macOS
npm run desktop:build:win        # Windows
npm run desktop:build:linux      # Linux (AppImage + deb, no signing)

For visuals, orb behavior, and build instructions, see the desktop documentation.

Backend Agent

AGENT_PROTOCOL is optional. Leave empty for frontend-only mode; when set, it reuses the installed Agent's user-level models, tools, MCP, Skills, and authentication. OpenCode and OpenClaw support one-click install with Bailian configuration.

qwenaudio setup   # View available backend Agents

For Agent selection, persistent background service, generic ACP entry, and permission modes, see the backend Agent documentation.

User Profile and Memory

User data is stored in ~/.config/qwaudio/ (USER.md, frontend-memory.json, tasks.json, logs/), kept local only, never committed to the repository. See user profile and memory.

Important Notes

Do not store passwords, API Keys, verification codes, or access tokens in the user profile or conversation.
Microphone audio and realtime conversation are sent to the configured Realtime frontend service (DashScope or speech-to-speech).
Background tasks may invoke the selected Agent's models, tools, MCP, and external services.
full permission allows the backend to execute commands and modify files; use only in trusted projects.
The Gateway is for local use only; do not expose it directly to the network or public internet.
On Linux / Windows with full-duplex without echo cancellation, wear headphones.

For detailed data bou