Type

Tag “web crawler” — 8

ScrapeGraphAI

scrapegraphai.com

An open-source Python library for AI-powered web scraping using LLMs

Framework Automation Command line 30 028

Firecrawl

firecrawl.dev

Get clean, AI-ready data from any website, fast and reliably.

Agent Data & analytics Command line

Chat4Data

chat4data.ai

Extract web data by chatting with AI. No coding needed.

Agent Data & analytics Browser extension

Otto

ottogrid.ai

Automate data gathering from websites and documents with AI.

Agent Data & analytics Web only

Apify

apify.com

Apify extracts live web data for training and running AI.

Agent Data & analytics API only

Read job postings live from employer career sites across 10 applicant tracking systems.

MCP server MCP servers Command line

Live aviation data for AI agents: METAR weather, airports, aircraft, glossary & FAA questions.

MCP server MCP servers Command line

17 market-data tools for AI agents: eBay sold prices, company KYC, SEC filings, patents, auctions

MCP server MCP servers Command line

Submit a site to the catalog

Just send the link — we will work out the rest.

We will review what you send and add it to the catalog if it fits.