by aza-ali
🌐 Real-browser web fetching for AI agents.
Requires a passing catalog security scan. Resolve the flagged issues and resubmit to enable featuring.
# Add to your Claude Code skills
git clone https://github.com/aza-ali/turbowebfetchGuides for using ai agents skills like turbowebfetch.
Last scanned: 7/25/2026
{
"issues": [
{
"type": "npm-audit",
"message": "@hono/node-server: @hono/node-server has authorization bypass for protected static paths via encoded slashes in Serve Static Middleware",
"severity": "high"
},
{
"type": "npm-audit",
"message": "@modelcontextprotocol/sdk: @modelcontextprotocol/sdk has cross-client data leak via shared server/transport instance reuse",
"severity": "high"
},
{
"type": "npm-audit",
"message": "@typescript-eslint/eslint-plugin: Vulnerability found",
"severity": "high"
},
{
"type": "npm-audit",
"message": "@typescript-eslint/parser: Vulnerability found",
"severity": "high"
},
{
"type": "npm-audit",
"message": "@typescript-eslint/type-utils: Vulnerability found",
"severity": "high"
},
{
"type": "npm-audit",
"message": "@typescript-eslint/typescript-estree: Vulnerability found",
"severity": "high"
},
{
"type": "npm-audit",
"message": "@typescript-eslint/utils: Vulnerability found",
"severity": "high"
},
{
"type": "npm-audit",
"message": "ajv: ajv has ReDoS when using `$data` option",
"severity": "medium"
},
{
"type": "npm-audit",
"message": "body-parser: body-parser vulnerable to denial of service when invalid limit value silently disables size enforcement",
"severity": "low"
},
{
"type": "npm-audit",
"message": "brace-expansion: brace-expansion: Zero-step sequence causes process hang and memory exhaustion",
"severity": "high"
},
{
"type": "npm-audit",
"message": "fast-uri: fast-uri vulnerable to path traversal via percent-encoded dot segments",
"severity": "high"
},
{
"type": "npm-audit",
"message": "flatted: flatted vulnerable to unbounded recursion DoS in parse() revive phase",
"severity": "high"
},
{
"type": "npm-audit",
"message": "form-data: form-data: CRLF injection in form-data via unescaped multipart field names and filenames",
"severity": "high"
},
{
"type": "npm-audit",
"message": "hono: Hono vulnerable to XSS through ErrorBoundary component ",
"severity": "high"
},
{
"type": "npm-audit",
"message": "js-yaml: JS-YAML: Quadratic-complexity DoS in merge key handling via repeated aliases",
"severity": "high"
},
{
"type": "npm-audit",
"message": "minimatch: minimatch has a ReDoS via repeated wildcards with non-matching literal in pattern",
"severity": "high"
},
{
"type": "npm-audit",
"message": "path-to-regexp: path-to-regexp vulnerable to Denial of Service via sequential optional groups",
"severity": "high"
},
{
"type": "npm-audit",
"message": "picomatch: Picomatch: Method Injection in POSIX Character Classes causes incorrect Glob Matching",
"severity": "high"
},
{
"type": "npm-audit",
"message": "postcss: PostCSS has XSS via Unescaped </style> in its CSS Stringify Output",
"severity": "high"
},
{
"type": "npm-audit",
"message": "qs: qs's arrayLimit bypass in comma parsing allows denial of service",
"severity": "medium"
},
{
"type": "npm-audit",
"message": "rollup: Rollup 4 has Arbitrary File Write via Path Traversal",
"severity": "high"
},
{
"type": "npm-audit",
"message": "vite: Vite Vulnerable to Path Traversal in Optimized Deps `.map` Handling",
"severity": "high"
},
{
"type": "npm-audit",
"message": "vitest: When Vitest UI server is listening, arbitrary file can be read and executed",
"severity": "critical"
},
{
"type": "npm-audit",
"message": "ws: ws: Uninitialized memory disclosure",
"severity": "high"
}
],
"status": "FAILED",
"scannedAt": "2026-07-25T06:19:52.865Z",
"npmAuditRan": true,
"pipAuditRan": true,
"promptInjectionRan": true
}Real browsers. Real content. Full fidelity.
Your AI agents need to read web pages. Documentation, product info, articles, research. But standard fetch tools use plain HTTP - they cannot handle modern client-side rendering or bot mitigation layers, and return empty shells.
TurboWebFetch runs actual Chrome browsers. Your agents see what users see.
14 parallel browsers. Zero API keys. Runs locally.
Before installing, verify you have:
node --version # Need 18+
python3 --version # Need 3.8+
Google Chrome must be installed (not Chromium).
claude mcp add turbowebfetch npx turbowebfetch
That's it. Your agents now have access to the fetch and fetch_batch tools.
TurboWebFetch helps your AI agents access content you have the right to access. It renders JavaScript-heavy pages that standard tools cannot handle.
It is for:
It is not for:
The challenge-handling exists because many legitimate sites use broad bot mitigation that affects even authorized access. If a site restricts access and you don't have permission, respect that.
| Scenario | WebFetch | TurboWebFetch |
|---|---|---|
| Static HTML pages | Works | Works (overkill) |
| JavaScript SPAs | Empty content | Full render |
| Sites with JS challenges | Fails | Negotiates automatically |
| Bot mitigation layers | Fails | Negotiates automatically |
| Parallel agents | One at a time | 14 simultaneous browsers |
| JS-heavy sites (docs, e-commerce) | Blocked or empty | Works |
Rule of thumb: Use WebFetch for simple pages. Use TurboWebFetch when that fails.
Single page:
mcp__turbowebfetch__fetch(url: "https://react.dev/learn", format: "markdown")
Response:
{
"success": true,
"url": "https://react.dev/learn",
"title": "Quick Start - React",
"content": "# Quick Start\n\nWelcome to the React documentation...",
"status": 200
}
Batch (parallel):
mcp__turbowebfetch__fetch_batch(
urls: [
"https://react.dev/learn",
"https://nextjs.org/docs",
"https://www.target.com/p/some-product"
],
format: "text"
)
All three fetch simultaneously in separate browsers.
| Parameter | Default | Description |
|---|---|---|
url |
required | The URL to fetch |
format |
"text" |
"text", "markdown", or "html" |
timeout |
60000 |
Milliseconds. Increase to 90000+ for slow sites |
wait_for |
- | CSS selector to wait for (rarely needed) |
The tool auto-detects when content has loaded. Use wait_for only if auto-detection fails on a specific site.
Sites that don't work:
Performance:
Not for scale: This is a user assistant, not a scraping service. Rate-limited to 60 requests/minute per domain.
Optional environment variables:
| Variable | Default | Description |
|---|---|---|
TURBOFETCH_MAX_PROCESSES |
14 |
Max concurrent browsers |
TURBOFETCH_HUMAN_MODE |
true |
Human-like scrolling/delays |
TURBOFETCH_HEADLESS |
true |
Headless mode (auto-switches if blocked) |
Most users won't need to change these.
"Python not found"
# macOS
brew install python3
# Ubuntu/Debian
sudo apt install python3 python3-venv
"Chrome not launching"
Install Google Chrome from https://google.com/chrome (not Chromium).
"Content is empty"
Some heavily lazy-loaded sites need an explicit selector:
mcp__turbowebfetch__fetch(
url: "https://www.bestbuy.com/site/searchpage.jsp?st=laptop",
wait_for: "[class*=\"product\"]",
timeout: 90000
)
"Page not loading on [site]"
Some sites require interactive verification that automated browsers cannot complete. Open an issue with the URL.
Each fetch is isolated. No cookies or state persist between requests.
Clone and build locally:
git clone https://github.com/aza-ali/turbowebfetch.git
cd turbowebfetch
npm install
npm run build
Python setup (virtual environment + nodriver) runs automatically during npm install. If it fails, run manually:
npm run setup:python
Then register with Claude Code:
claude mcp add turbowebfetch node /path/to/turbowebfetch/dist/index.js
MIT License. See LICENSE for details.
Copyright (c) 2026 Mourtaza Ali
turbowebfetch is an open-source ai agents skill for AI coding assistants such as Claude Code, Codex CLI, and ChatGPT, built by aza-ali. 🌐 Real-browser web fetching for AI agents. It has 103 GitHub stars.
turbowebfetch failed SkillsLLM's automated security scan, which flagged one or more high-severity issues. Review the Security Report section carefully before using it.
Clone the repository with "git clone https://github.com/aza-ali/turbowebfetch" and add it to your Claude Code skills directory (see the Installation section above).
turbowebfetch is primarily written in Python. It is open-source under aza-ali on GitHub, so you can review or fork the full source.
Yes. SkillsLLM lists many other AI Agents skills you can browse and compare side by side. Open the AI Agents category from the badge at the top of this page, or use the Related Skills and comparison links further down to weigh turbowebfetch against similar tools.
No comments yet. Be the first to share your thoughts!