crw

smithery.ai

Web search and web scraping for AI agents in one fast, single-binary MCP server. crw searches the web, scrapes any URL to clean markdown or HTML, maps a site's links, runs bounded recursive crawls, and extracts structured JSON from pages. Built-in anti-bot handling, JavaScript rendering, and proxy rotation recover content that a plain fetch and lighter scrapers miss. Open source (AGPL), local-first, and zero-config via npx, or use this managed cloud endpoint. A leaner, self-h

Description

Installation

Not sure where to start — ask an assistant to walk you through:

Specs

Type	MCP server
Section	MCP servers
Pricing	free
Platform	Command line
Systems	cli, api
Hosting	cloud
Install	mcp
Protocols	mcp
Site language	en
Vendor	fastcrw
Views	5

Can do

agents web-scraping

Platforms

Protocols

Tags

agents web scraping

Hashtags

mcpserver #webscraping #agents #mcpservers

Social

X GitHub Discord

Found in sources

Similar in «MCP servers»

Official ClickHouse MCP server for querying and exploring ClickHouse clusters and chDB.

JustCall MCP Server

JustCall MCP Server enables LLMs and AI agents to make voice calls and send SMS via JustCall APIs.

Octoparse MCP Server

Official Octoparse MCP server for template discovery, cloud tasks, and structured data export.

Parallel Search MCP

The best web search for your AI Agent

AI-moderated research platform: create and launch studies and query interview results.

io.gainium/gainium-mcp

MCP server for Gainium — manage trading bots, deals, and balances via AI assistants