name: decodo-scraper
description: Search Google, scrape web pages, Amazon product pages, YouTube subtitles, or Reddit (post/subreddit) using the Decodo Scraper OpenClaw Skill.
homepage: https://decodo.com
credentials:
DECODO_AUTH_TOKEN
env:
required:
DECODO_AUTH_TOKEN
Decodo Scraper OpenClaw Skill
Use this skill to search Google, scrape any URL, or fetch YouTube subtitles via the Decodo Web Scraping API. Search outputs a JSON object of result sections; Scrape URL outputs plain markdown; Amazon and Amazon search output parsed product-page or search results (JSON). Amazon search uses --query. YouTube subtitles outputs transcript/subtitles. Reddit post and Reddit subreddit output post/listing content (JSON).
Authentication: Set DECODO_AUTH_TOKEN (Basic auth token from Decodo Dashboard → Scraping APIs) in your environment or in a .env file in the repo root.
Errors: On failure the script writes a JSON error to stderr and exits with code 1.
Tools
1. Search Google
Use this to find URLs, answers, or structured search results. The API returns a JSON object whose results key contains several sections (not all may be present for every query):
| Section | Description |
|--------|--------------|
| organic | Main search results (titles, links, snippets). |
| ai_overviews | AI-generated overviews or summaries when Google shows them. |
| paid | Paid/sponsored results (ads). |
| related_questions | “People also ask”–style questions and answers. |
| related_searches | Suggested related search queries. |
| discussions_and_forums | Forum or discussion results (e.g. Reddit, Stack Exchange). |
The script outputs only the inner results object (these sections); pagination info (page, last_visible_page, ) is not included.
README.md
Decodo Scraper OpenClaw Skill
Overview
This OpenClaw skill integrates Decodo's Web Scraping API into any OpenClaw-compatible AI agent or LLM pipeline. It exposes these tools that agents can call directly:
| Tool | Description | Perfect for |
| :---------------- | :------------------------------------------------------------------- | :--------------------------------------------------------------------------------------- |
| google_search | Real-time Google Search (SERP) results as structured JSON. | Market research, competitor analysis, news monitoring, fact-checking, RAG pipelines. |
| universal | Scrape & parse any public webpage into clean Markdown. | Summarizing articles, content aggregation, building custom datasets, general web browsing for AI agents. |
| amazon | Parse Amazon product page data (price, reviews, specs, ASIN). | eCommerce monitoring, price tracking, competitive intelligence, product research. |
| amazon_search | Search Amazon for products by keyword and get parsed results. | Discovering products, tracking trends, and broad market analysis. |
| | Extract subtitles/transcripts from YouTube videos (by video ID). | Video summarization, content analysis, sentiment tracking, accessibility. |
| | Fetch a Reddit post's content, comments, and metadata (by post URL). | Social listening, community sentiment analysis, trend tracking, and gathering user feedback. |
| | Scrape Reddit subreddit listings (by subreddit URL). | Monitoring specific communities, content discovery, niche market research. |
Use this to get parsed data from an Amazon product (or other Amazon) page. Pass the product page URL as --url. The script sends parse: true and outputs the inner results object (e.g. ads, product details, etc.).
Backed by Decodo's residential and datacenter proxy infrastructure, the skill handles JavaScript rendering, bot detection bypass, and geo-targeting out of the box.
Why use Decodo for your OpenClaw agent?
Zero blocks & CAPTCHAs. Backed by Decodo's proxy infrastructure from 125M+ locations, the skill automatically handles JavaScript rendering, bot detection, and CAPTCHA bypass.
Real-time data. Access fresh, up-to-the-minute web data directly within your AI agent's workflow.
LLM-optimized output. Data is returned in structured JSON or clean Markdown, making it easy for LLMs to understand and process.
Scalability. Designed for high-volume data collection, ensuring your agent can scale from small tasks to complex projects.
Minimal Friction. Easy setup with a single authentication token.
Features
Real-time Google Search results scraping
Universal URL scraping
Amazon product page parsing (by URL)
Amazon search (by query)
YouTube subtitles/transcript by video ID
Reddit post content by URL
Reddit subreddit listing by URL
Structured JSON or Markdown results
Simple CLI interface compatible with any OpenClaw agent runtime
Designed for scalable AI agent web scraping
Minimal dependencies — just Python with Requests
Authentication via a single Base64 token from the Decodo dashboard
Set your Decodo auth token as an environment variable (or create a .env file in the project root):
# Linux/macOS Terminal
export DECODO_AUTH_TOKEN="your_base64_token"
# Windows (PowerShell)
$env:DECODO_AUTH_TOKEN="your_base64_token"
# .env file
DECODO_AUTH_TOKEN=your_base64_token
OpenClaw agent integration
This skill ships with a SKILL.md file that defines all tools in the OpenClaw skill format. OpenClaw-compatible agents automatically discover and invoke the tools from this file without additional configuration.
To register the skill with your OpenClaw agent, point it at the repo root — the agent will read SKILL.md and expose google_search, universal, amazon, amazon_search, youtube_subtitles, reddit_post, and reddit_subreddit as callable tools.
Usage
Google Search
Search Google and receive structured JSON. Results are grouped by type: organic (main results), ai_overviews (AI-generated summaries), paid (ads), related_questions, related_searches, discussions_and_forums, and others depending on the query.
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflows - all through natural language commands.
