Tag “web-scraping” — 54

Octoparse MCP Server

octoparse.com

Official Octoparse MCP server for template discovery, cloud tasks, and structured data export.

SparkForge

smithery.ai

Access a versatile collection of tools for media generation, web scraping, and cryptocurrency research. Convert between data formats, summarize long documents, and extract text from images or PDFs with ease. Streamline your workflow by automating tasks like SEO metadata extraction, code reviews, and content creation.

NEXUS Intelligence API

smithery.ai

58-endpoint utility hub - DNS lookup, web scraping, CVE scanning, AI translation, PII detection, domain health audit, company intelligence. Pay per call via x402 on Base.

Web Scraper — Clean Markdown from Any URL

smithery.ai

Web content extraction API for AI agents. Scrape any URL and get clean, structured Markdown content with navigation, ads, and scripts stripped. Full JavaScript rendering via headless Chromium. Single and batch (10 URLs) modes. Built for RAG pipelines and AI research. Tools: web_scrape_to_markdown (single), web_scrape_batch (up to 10 URLs). Use this for RAG ingestion, research, content analysis, data extraction, or competitive intelligence. IMPORTANT: For screenshots/PDFs of

zlurp

smithery.ai

Web scraping for AI agents. Convert any URL to clean markdown via x402 micropayments on Base.

Apify

smithery.ai

Web scraping and automation platform. Run scrapers, extract structured data, and automate browser-based workflows.

AgentScrape

smithery.ai

**Pay-per-call web scraping for AI agents — no signup, no API keys, just USDC.** AgentScrape is a production MCP server giving agents six paid tools for web scraping, structured extraction, screenshots, and metadata — all on Cloudflare Workers, all settled in USDC on Base via x402. ## Tools - **`scrape_webpage`** — fetch as markdown, html, text, or json - **`extract_structured_data`** — AI-powered extraction with natural-language prompts + JSON schemas - **`screenshot_webp

Tap

smithery.ai

Turn interface operations into deterministic programs. AI forges taps once, then any agent replays them forever at zero AI cost. 31 tools for browser automation, web scraping, and agent orchestration. 200+ community skills included.

scrape-agent-mcp

smithery.ai

Pay-per-use web scraping API built on x402. Extract clean text, links or HTML from any URL for $0.01 USDC on Base. No API key, no subscription needed. Perfect for AI agents that need web data on demand. Endpoint paths: /api/scrape/x402 Notes: Endpoint returns HTTP 402 with valid accepts[] payload on both GET and POST requests without X-PAYMENT header. Custom domain, landing page at root, OpenAPI spec at /openapi.json.

ScrAPI MCP

smithery.ai

Web scraping using ScrAPI. Extract website content that is difficult to access because of bot detection, captchas or even geolocation restrictions.

Apify

smithery.ai

Apify is the world's largest marketplace of tools for web scraping, data extraction, and web automation. You can extract structured data from social media (Instagram, TikTok, Twitter, Facebook), e-commerce (Amazon, eBay, Shopify), search engines (Google, Bing), maps, travel sites, or any other website.

ScrapeGraph AI Integration Server

smithery.ai

Enable language models to perform advanced AI-powered web scraping with enterprise-grade reliability. Transform webpages into structured markdown, extract data using AI, and execute AI-powered web searches seamlessly. Enhance your applications with powerful web data extraction capabilities through this integration. It could also make web search, browser automation and markdownification

FourA

smithery.ai

Web scraping for AI agents. One smart tool fetches any public page and picks the method automatically (direct request, rotating proxy, or full headless browser), getting past anti-bot challenges. Four tools + six prompts, one API key.

crw

smithery.ai

Web search and web scraping for AI agents in one fast, single-binary MCP server. crw searches the web, scrapes any URL to clean markdown or HTML, maps a site's links, runs bounded recursive crawls, and extracts structured JSON from pages. Built-in anti-bot handling, JavaScript rendering, and proxy rotation recover content that a plain fetch and lighter scrapers miss. Open source (AGPL), local-first, and zero-config via npx, or use this managed cloud endpoint. A leaner, self-h

ai.buywhere/catalog-api

buywhere.ai

Agent-native product catalog: 300M+ products across US+SEA. Search, compare, deals.

ai.usestring/web-access

usestring.ai

The most accurate web access API. Stop getting blocked.

Vaaya

vaaya.ai

Pay-per-call agent superpowers: media/video gen, product demos, research, GTM, scraping, compute.

com.agishub/agent-memory

agishub.com

Persistent semantic memory for AI agents: store and recall text by meaning (RAG). x402

McpMux

mcpmux.com

McpMux — configure MCP servers once, connect every AI client through one local gateway.

Scrapeer

scrapeer.com

Run Scrapeer visual web-scraping flows from AI agents.

com.scrapeunblocker/scrapeunblocker-mcp

scrapeunblocker.com

Fetch any web page's HTML or AI-parsed JSON through the ScrapeUnblocker anti-bot API.

MCPfinder - MCP Server Discovery

mcpfinder.dev

Your AI discovers and installs MCP servers across Official Registry, Glama, and Smithery.

StackResolve

stackresolve.dev

Find, compare, and audit software for AI agents. Scored registry of tools and MCP servers.

MCP Trust Index

staas.fund

Curated, trust-first index of vetted MCP servers — scored tiers, monthly re-verified. Read-only.

Anakin

anakin.io

Web data for AI agents: scrape, crawl, search, deep research, site monitoring, browser automation

Scrapling MCP Server

scrapling.readthedocs.io

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

io.github.Deesmo/arch-tools-mcp

archtools.dev

63 production tools for AI agents — one API key, pay per call in USDC (x402) or Stripe credits.

io.github.H129hj/checkmcp

checkmcp.dev

Audit any MCP server's security & quality — OWASP MCP Top 10 + explainable 0-100 MCP Score

Career Site Job Feed

apify.com

Read job postings live from employer career sites across 10 applicant tracking systems.

io.github.IronSecCo/ironclaw

ironclaw.sh

Sandboxed shell exec for MCP clients: run untrusted agent commands in a gVisor container.

io.github.Jackalope-Dev/allmcps-server

allmcps.com

Search, browse, and submit MCP servers to the AllMCPs.com directory.

io.github.JessieJanie/skim402

skim402.com

Web reader for AI agents — output ~4x smaller than raw HTML. Card API key or x402. Free tier.

Tap

taprun.dev

Browser MCP for logged-in tasks. Uses your Chrome — credentials stay local. Zero-token replay.

io.github.LorgAI/lorg-mcp-server

lorg.ai

Shared, peer-validated knowledge archive for AI agents — search, contribute, and validate via MCP

io.github.ModelPiper/toolpiper

modelpiper.com

300+ on-device MCP tools for macOS — local AI, voice, vision, browser automation, system control.

io.github.OpenWeb-Ninja/openwebninja-mcp

openwebninja.com

Official MCP server for OpenWeb Ninja APIs - 40+ real-time web data and SERP APIs as MCP tools