by synchopate
Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs).
From $49 · 30 days · terms & refunds
⚠️ Third-Party Software Notice
This skill is third-party open-source software developed and hosted independently on GitHub. SkillsLLM is an informational directory and does not control or maintain the underlying repository.
Any security checks, ratings, or warnings displayed by SkillsLLM are automated and limited in scope. They do not constitute a security certification or guarantee that the software is safe, error-free, or free from malicious code, vulnerabilities, compromised dependencies, or prompt-injection risks.
Review the source code, permissions, dependencies, and configuration before installing or running any third-party skill. Use is at your own risk. To the maximum extent permitted by applicable law, SkillsLLM is not liable for losses arising from third-party software.
Automated security scan — not a certification.
# Add to your Claude Code skills
git clone https://github.com/synchopate/llama-modchipGuides for using ai agents skills like llama-modchip.
Last scanned: 11/3/2026
{
"issues": [],
"status": "PASSED",
"scannedAt": "2026-11-03T11:40:39.329Z",
"npmAuditRan": true,
"pipAuditRan": true,
"promptInjectionRan": true
}See how llama-modchip compares with popular alternatives.
Qwen3.8-Flash-Next, DeepSeek-V4 284B & Nemotron-3.5 30B100% Donor-Free MaxQ Compression · Built-In NextN MTP + Stockfish-PVS v2 · Zero-Collision v3.0 ABI · Linux, macOS Metal, CUDA, Vulkan & Windows 11
Quickstart (./modchip setup) · 3-Tier RAM Matrix · Gate 4 & 4D-1 Benchmarks · Engine Architecture (v3.0) · Supported Hardware · Leaderboard · FAQ
MaxQ v3.0 RAM MatrixOne unified llama-modchip v3.0 binary (GLIBC <= 2.30, static libstdc++ & libgomp, zero external OpenMP .so needed) automatically detects your CPU ISA (AVX-512 VBMI/VNNI, AVX2, ARM64 NEON, Apple Metal) and system RAM to run the strongest open-weights model that fits cleanly on your machine:
| System RAM Tier | Recommended Aligned Checkpoint (+ Opt-In Abliterated) |
Disk Footprint (Shards) |
Peak VmHWM (-c 32768) |
Verified v3.0 Speed (16C Zen 5, 0 GPU) |
Backend Compatibility |
|---|---|---|---|---|---|
64 GB Tier(Flagship Default) |
Qwen3.8-Flash-Next-MaxQ-64GB(--preset qwen38-64gb · opt-in qwen38-64gb-ablit, +0.18% ΔPPL) |
53.99 GiB (57,969,748,352 B)(43.26 Trunk + 10.73 PLE) |
45.08 GiB(RssAnon = 1.81 GiB) |
72.0 t/s pp51212.66 t/s tg128 (93.0% MTP) |
100% Standard ggml (types <= 42: CPU, Metal, CUDA, Vulkan; v3.0 loader) |
64 GB Tier(284B Alternative) |
DeepSeek-V4-Flash-0731-MaxQ-v4(--preset dsv4-maxq · 284.3B Total / 13.2B Active) |
57.99 GiB (62,270,037,248 B)(3 shards, 34L ConeCollapse) |
58.6–59.1 GiB(anonymous heap) |
36.1–44.4 t/s pp8.8–19.2+ t/s tg (ngram-simple) |
100% Standard ggml (0 custom types: CPU, Metal 27.0 t/s M5 Max, CUDA, Vulkan) |
32 GB Tier(Consumer Default) |
Qwen3.8-Flash-Next-MaxQ-32GB(--preset qwen38-32gb · opt-in qwen38-32gb-ablit, +0.32% ΔPPL) |
35.71 GiB (38,341,683,424 B)(24.98 RAM + 10.73 lazy NVMe PLE) |
26.91–28.40 GiB <= 28.5 GiB(Cgroup v2 Swap=0 PASS) |
74.6 t/s pp51211.45–14.29 t/s tg128 (draft-mtp) |
100% Standard ggml (types <= 42: CPU + NVMe mmap demand-paged PLE) |
16 GB Tier(CPU-Turbo / GPU) |
Nemotron-3.5-30B-A3B-VQ3-64 (v3.0 CPU-Turbo)Nemotron-3.5-30B-A3B-MaxQ-16GB (Std ggml)(opt-in nemotron-ablit) |
13.30 / 13.39 GiB(1 file, 256K Mamba-2+MoE) |
14.30–16.0 GiB(14.30 GiB <= 15.0 GiB cgroup) |
VQ3-64: 24.2–60.4 t/s (111.6 TR)MaxQ-16GB: 188.3 pp / 15.10 t/s N=1 (27.80 refactor) |
VQ3-64: v3.0 (types 44/45)MaxQ-16GB: 100% Upstream ggml (llama.cpp, Metal, CUDA, LM Studio) |
git clone https://github.com/synchopate/llama-modchip.git
cd llama-modchip
./modchip setup # Auto-detects 16GB / 32GB / 64GB RAM + CPU ISA, verifies SHA-256, writes start_server.sh
./modchip chat # Starts background server + SSE Gateway (:8787) and opens live streaming terminal chat
Or bootstrap directly on a clean Linux host without cloning manually:
curl -sL https://raw.githubusercontent.com/synchopate/llama-modchip/main/install.sh | bash
GLIBC_2.30 Linux x86_64 -avx512 / -avx2)All 12 v3.0 Linux x86_64 binaries link libstdc++, libgcc, and libgomp.a statically (NEEDED = [libdl.so.2, libpthread.so.0, libm.so.6, libc.so.6, ld-linux-x86-64.so.2], max_glibc <= 2.30, 0 %zmm instructions in -avx2, 0 vdpbf16ps in -avx512):
# 1. Auto-select -avx512 (Zen 4/5, Ice Lake+) or -avx2 (Haswell+, Zen 1-3, Alder/Raptor Lake) and verify SHA-256:
BIN_ISA=$(grep -q "avx512f" /proc/cpuinfo && grep -Eq "avx512_?vbmi" /proc/cpuinfo && grep -Eq "avx512_?vnni" /proc/cpuinfo && echo "avx512" || echo "avx2")
curl -fLO "https://github.com/synchopate/llama-modchip/releases/download/v3.0/llama-server-modchip-linux-x86_64-${BIN_ISA}"
curl -fLO "https://github.com/synchopate/llama-modchip/releases/download/v3.0/SHA256SUMS"
sha256sum -c SHA256SUMS --ignore-missing
chmod +x "llama-server-modchip-linux-x86_64-${BIN_ISA}"
# Non-convoy thread count: leave 1 physical core free for HTTP/OS threads paired with --poll 0 --poll-batch 0
N_CORES=$(lscpu -p=CORE,SOCKET 2>/dev/null | grep -v '^#' | sort -u | wc -l)
THREADS=$(( N_CORES > 1 ? N_CORES - 1 : 1 ))
# 2A. [64 GB Tier Default] Qwen3.8-Flash-Next-MaxQ-64GB (53.99 GiB, default --repack ON, NextN draft-mtp -> 12.66 t/s):
hf download Synchopate/Qwen3.8-Flash-Next-MaxQ-64GB-GGUF \
--include "Qwen3.8-Flash-Next-MaxQ-64GB-*.gguf" --local-dir ./qwen38-64gb
env RC_TABLES_DIR=/nonexistent "./llama-server-modchip-linux-x86_64-${BIN_ISA}" \
-m ./qwen38-64gb/Qwen3.8-Flash-Next-MaxQ-64GB-00001-of-00002.gguf \
-c 32768 -np 1 -fa on -ctk q8_0 -ctv q8_0 --spec-type draft-mtp --jinja \
-t "$THREADS" -tb "$THREADS" --poll 0 --poll-batch 0 --slot-save-path /dev/shm --port 8080
# 2B. [32 GB Tier Default] Qwen3.8-Flash-Next-MaxQ-32GB (24.98 GiB Shard 1 + lazy NVMe PLE -> 26.9 GiB RSS, 11.45-14.29 t/s):
hf download Synchopate/Qwen3.8-Flash-Next-MaxQ-32GB-GGUF \
--include "Qwen3.8-Flash-Next-MaxQ-32GB-*.gguf" --local-dir ./qwen38-32gb
env RC_TABLES_DIR=/nonexistent "./llama-server-modchip-linux-x86_64-${BIN_ISA}" \
-m ./qwen38-32gb/Qwen3.8-Flash-Next-MaxQ-32GB-00001-of-00002.gguf \
-c 32768 -np 1 -fa on -ctk q8_0 -ctv q8_0 --spec-type draft-mtp --jinja --ctx-checkpoints 0 \
--temp 0.6 --top-p 0.95 --top-k 20 --presence-penalty 0.2 --repeat-penalty 1.05 \
-t "$THREADS" -tb "$THREADS" --poll 0 --poll-batch 0 --slot-save-path /dev/shm --port 8080
# 2C. [16 GB Tier] NVIDIA-Nemotron-3.5-30B-A3B-VQ3-64 (v3.0 CPU-Turbo) or MaxQ-16GB (100% standard ggml):
# ./install.sh --preset nemotron-vq3 # 13.30 GiB v3.0 CPU-Turbo (AVX-512 VBMI)
# ./install.sh --preset nemotron-maxq-16gb # 13.39 GiB 100% standard ggml (CPU / Metal / CUDA / LM Studio)
[!IMPORTANT] Critical Runtime Best Practices (
v3.0):
- Non-Convoy Threading (
-t $((N_CORES - 1)) -tb $((N_CORES - 1)) --poll 0 --poll-batch 0): Leaving 1 core free for HTTP/OS dispatch and disabling busy-polling eliminates thread-pool barrier convoys (+25.9%pp512,+31.3%tg128over oversubscribed-t N --poll 50)../modchipconfigures this automatically.- Vocabulary Isolation (
RC_TABLES_DIR=/nonexistenton Non-Nemotron Models): When servingQwen3.8(248Kvocab) orDeepSeek-V4(129Kvocab) from a working directory containing./workspace/routecrackNemotron tables, always setRC_TABLES_DIR=/nonexistent(not merely unset) soStockfish-PVS v2runs in clean online248Ksession mode../modchipenforces this automatically.- Default
--repackON (v3.0) vs. Unpatched Upstreamllama.cpp:llama-modchip v3.0fixes upstreamCPU_REPACKq8_cache/repack.cppbugs while preserving zero-copymmapon 3D MoE tensors (RssAnon = 1.81–1.92 GiB,93.0%MTP accept onMaxQ-64GB). Users loadingQwen3.8GGUFs on unpatched upstreamllama.cppshould pass--no-repack(-nr);--no-repackis not needed on `llama
llama-modchip is an open-source ai agents skill for AI coding assistants such as Claude Code, Codex CLI, and ChatGPT, built by synchopate. Run 284B DeepSeek-V4-Flash (<59GiB RAM: 41.1 cold pp, 9.1 N=1 tg, up to 25.3 spec tok/s) & 30B MoEs (22.4 N=1 / 111.6 spec tok/s) on 64GB CPU (0 GPUs). It has 1,321 GitHub stars.
Yes. llama-modchip passed SkillsLLM's automated security scan — a dependency vulnerability audit plus prompt-injection heuristics — with no high-severity issues. You can read the full report in the Security Report section on this page.
Clone the repository with "git clone https://github.com/synchopate/llama-modchip" and add it to your Claude Code skills directory (see the Installation section above).
llama-modchip is primarily written in Python. It is open-source under synchopate on GitHub, so you can review or fork the full source.
Yes. SkillsLLM lists many other AI Agents skills you can browse and compare side by side. Open the AI Agents category from the badge at the top of this page, or use the Related Skills and comparison links further down to weigh llama-modchip against similar tools.
No comments yet. Be the first to share your thoughts!