by ddalcu
Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation.
From $49 · 30 days · terms & refunds
⚠️ Third-Party Software Notice
This skill is third-party open-source software developed and hosted independently on GitHub. SkillsLLM lists this project for discovery and does not control or maintain the underlying repository.
Any security checks, ratings, or warnings displayed by SkillsLLM are automated and limited in scope. They do not constitute a security certification or guarantee that the software is safe, error-free, or free from malicious code, vulnerabilities, compromised dependencies, or prompt-injection risks.
Review the source code, permissions, dependencies, and configuration before installing or running any third-party skill. Use is at your own risk. To the maximum extent permitted by applicable law, SkillsLLM is not liable for losses arising from third-party software.
Automated security scan — not a certification.
# Add to your Claude Code skills
git clone https://github.com/ddalcu/mlx-serveGuides for using ai agents skills like mlx-serve.
Last scanned: 7/7/2026
{
"issues": [],
"status": "PASSED",
"scannedAt": "2026-07-07T07:37:13.110Z",
"npmAuditRan": true,
"pipAuditRan": true,
"promptInjectionRan": true
}See how mlx-serve compares with popular alternatives.

Run open models on your Mac: chat, coding agents, images, video, music, speech and 3D. One native app and one local server that speaks the OpenAI, Anthropic and Ollama APIs. It runs offline, needs no Python and no account, and it's MIT licensed.
Download for Mac · Homebrew · iPhone · Linux · mlxserve.com · 简体中文

The app. Download MLX-Serve, drag it to Applications and open it. It needs macOS 26.2 or later on Apple Silicon, suggests a model that fits your Mac, and updates itself.
Homebrew.
brew tap ddalcu/mlx-serve https://github.com/ddalcu/mlx-serve
brew trust ddalcu/mlx-serve
brew install --cask mlx-serve # the app
brew install mlx-serve # or only the command-line server
The terminal, if you know Ollama:
mlx-serve run gemma4 # downloads Gemma 4 E4B, serves it and chats right here
mlx-serve pull gemma4:26b # download only, resumable
mlx-serve serve # serve everything you downloaded; models load when asked for
The server listens on http://localhost:11234. Point any OpenAI, Anthropic or Ollama client at it, or open that address in a browser for the built-in web console.
MLX-Serve puts the same engine on your iPhone: chat with Gemma 4, clone your voice, and make pictures and music, all on the phone and offline. It needs an A17 Pro-class iPhone or newer with iOS 26.
Every release has Linux downloads for NVIDIA GPUs: x64 for RTX 20 to 50 cards, arm64 for DGX Spark, GH200 and Jetson Thor. On Windows with an NVIDIA card, one script builds it. Details are in docs/building.md.
mlx-serve launch claude starts Claude Code against your Mac, set up with the model's real context window. Codex, OpenCode, pi, Grok and others work the same way. IntegrationsThe app suggests a first model for your Mac's memory:
| Memory | Suggested model |
|---|---|
| 16 GB | Gemma 4 E4B |
| 18–24 GB | Gemma 4 12B |
| 32 GB | Qwen 3.8 27B |
| 36 GB | Qwen 3.8 27B 6-bit |
| 48–64 GB | Qwen 3.8 27B 8-bit |
| 96 GB and up | Qwen3.8-Flash-Next (125B, about 6B active per token) |
| 128 GB | Also GLM-5.3-Flash and DeepSeek-V4.1-Flash, their experts streamed from the SSD |
| 256 GB | Also GLM-5.3-Flash in memory (NVIDIA's FP4 pack) |
Thousands more run too: any MLX model with a supported architecture, and any GGUF. The tier list ranks the popular ones, and docs/models.md lists every architecture.
Decode speed in v26.11.1 on an M5 Ultra with 256 GB, on a code prompt, with speculative decoding on:
| Model | Tokens per second |
|---|---|
| Qwen3.6 35B-A3B, 4-bit | 421 |
| Qwen3.8 27B, 4-bit | 243 |
| Gemma 4 E4B, 4-bit | 200 |
| Gemma 4 26B-A4B, 4-bit | 184 |
| Qwen3.8-Flash-Next, 4.7 bits | 180 |
On an M4 Max, the same models decode 10% to 51% faster than they did in v26.8. Every release is measured the same way in benchmarks.md; speculative decoding and tuning are in docs/performance.md.
You need Xcode 26.2 or later and Homebrew:
git clone --recurse-submodules https://github.com/ddalcu/mlx-serve && cd mlx-serve
./app/build.sh
The script fetches the pinned Zig, builds MLX and llama.cpp, and signs the app ad hoc. There's no Python anywhere in the build. Server-only builds are in docs/building.md.
Questions, ideas and things you made: the community chat on X and GitHub issues. Builds and deep dives go out on YouTube and X.
Thank you to the sponsors who back mlx-serve: @jcprichard, @skudinov, @davidfekke, @lojza3d, @cpko, @d-b, @alinselea, Johnny Dang and @R0xr1te. If it's useful to you, you can support it on GitHub Sponsors or Buy Me a Coffee. Nothing is paywalled: it's MIT now and stays MIT.
Thank you also to everyone who sends code, reports and ideas. The contributors page shows the code side, and the changelog thanks people release by release.
mlx-serve builds on MLX, mlx-c, mlx-lm, llama.cpp, antirez/ds4, mlx-stream, Sushi, jinja.cpp, nlohmann/json, stb_image, libwebp, Hugging Face tokenizers and Zig. It runs the open models their authors published, and the app uses the Anthropic and MCP Swift SDKs.
Licenses and required notices are in NOTICE. If we missed you, please open a PR.
If mlx-serve is useful to you, a star helps other people find it.
MIT, see LICENSE. Bundled third-party code keeps its own license: NOTICE lists it with the required attributions, and LICENSE-APACHE-2.0 has the Apache license text.
mlx-serve is an open-source ai agents skill for AI coding assistants such as Claude Code, Codex CLI, and ChatGPT, built by ddalcu. Native LLM inference server for Apple Silicon. OpenAI + Anthropic API compatible. No Python. Zig backend, Swift frontend macOS app with chat, music, voice, video generation. It has 2,499 GitHub stars.
Yes. mlx-serve passed SkillsLLM's automated security scan — a dependency vulnerability audit plus prompt-injection heuristics — with no high-severity issues. You can read the full report in the Security Report section on this page.
Clone the repository with "git clone https://github.com/ddalcu/mlx-serve" and add it to your Claude Code skills directory (see the Installation section above).
mlx-serve is primarily written in Zig. It is open-source under ddalcu on GitHub, so you can review or fork the full source.
Yes. SkillsLLM lists many other AI Agents skills you can browse and compare side by side. Open the AI Agents category from the badge at the top of this page, or use the Related Skills and comparison links further down to weigh mlx-serve against similar tools.
No comments yet. Be the first to share your thoughts!