web-scout-mcp | SkillsLLM
Home AI Agents web-scout-mcp A powerful MCP server extension providing web search and content extraction capabilities. Integrates DuckDuckGo search functionality and URL content extraction into your MCP environment, enabling AI assistants to search the web and extract webpage content programmatically.
ai-assistant ai-tools cheerio content-extraction crawler
# Add to your Claude Code skills
git clone https://github.com/pinkpixel-dev/web-scout-mcp
<p align="center">
<img src="assets/logo.png" alt="Web Scout MCP Logo" width="300"/>
</p>
<h1 align="center">Web Scout MCP Server</h1>
<p align="center">
<a href="https://www.npmjs.com/package/@pinkpixel/web-scout-mcp"><img src="https://img.shields.io/npm/v/@pinkpixel/web-scout-mcp.svg" alt="npm version"></a>
<a href="https://github.com/pinkpixel-dev/web-scout-mcp/blob/main/LICENSE"><img src="https://img.shields.io/badge/license-MIT-blue.svg" alt="License"></a>
<a href="https://nodejs.org/en/"><img src="https://img.shields.io/badge/node-%3E%3D18.0.0-brightgreen.svg" alt="Node.js Version"></a>
<a href="https://smithery.ai/badge/@pinkpixel-dev/web-scout-mcp"><img alt="Smithery Badge" src="https://smithery.ai/badge/@pinkpixel-dev/web-scout-mcp"></a>
<a href="https://mseep.ai/app/f19a6453-c635-4bc8-b26a-3e9e36428a98"><img src="https://mseep.ai/badge.svg" alt="Verified on MseeP"></a>
</p>
<p align="center">
An MCP server for web search using DuckDuckGo and content extraction, with support for multiple URLs and memory optimizations.
</p>
✨ Features
🔍 DuckDuckGo Search : Fast and privacy-focused web search capability
📄 Content Extraction : Clean, readable text extraction from web pages
🚀 Parallel Processing : Support for extracting content from multiple URLs simultaneously
💾 Memory Optimization : Smart memory management to prevent application crashes
⏱️ Rate Limiting : Intelligent request throttling to avoid API blocks
🛡️ Error Handling : Robust error handling for reliable operation
📦 Installation
Installing via Smithery
To install Web Scout for Claude Desktop automatically via
duckduckgo
duckduckgo-search
google-search
mcp
mcp-server
web-content
web-crawler
web-scraper
web-scraping
web-search
web-search-agent
npx -y @smithery/cli install @pinkpixel-dev/web-scout-mcp --client claude
Global Installation npm install -g @pinkpixel/web-scout-mcp
Local Installation npm install @pinkpixel/web-scout-mcp
🚀 Usage
Command Line After installing globally, run:
With MCP Clients Add this to your MCP client's config.json (Claude Desktop, Cursor, etc.):
{
"mcpServers": {
"web-scout": {
"command": "npx",
"args": [
"-y",
"@pinkpixel/web-scout-mcp@latest"
]
}
}
}
Environment Variables Set the WEB_SCOUT_DISABLE_AUTOSTART=1 environment variable when embedding the package and calling createServer() yourself. By default running the published entrypoint (for example node dist/index.js or npx @pinkpixel/web-scout-mcp) automatically bootstraps the stdio transport.
🧰 Tools The server provides the following MCP tools:
🔍 DuckDuckGoWebSearch Initiates a web search query using the DuckDuckGo search engine and returns a well-structured list of findings.
